-- Logs begin at Thu 2022-02-10 20:17:24 UTC, end at Thu 2022-02-10 21:48:12 UTC. -- Feb 10 20:45:00.037237 dv-cinder-825688-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 10 20:45:00.048251 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 10 20:45:00.053390 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Feb 10 20:45:00 2022] *** Feb 10 20:45:00.053390 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 10 20:45:00.053390 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 10 20:45:00.053390 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: nodename: dv-cinder-825688-3-iscsi Feb 10 20:45:00.053390 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: machine: x86_64 Feb 10 20:45:00.053390 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: clock source: unix Feb 10 20:45:00.053390 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: pcre jit disabled Feb 10 20:45:00.053390 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: detected number of CPU cores: 4 Feb 10 20:45:00.053390 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: current working directory: / Feb 10 20:45:00.053390 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: detected binary path: /usr/bin/uwsgi-core Feb 10 20:45:00.053390 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: your processes number limit is 47680 Feb 10 20:45:00.053390 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: your memory page size is 4096 bytes Feb 10 20:45:00.053390 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: detected max file descriptor number: 2048 Feb 10 20:45:00.053390 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: lock engine: pthread robust mutexes Feb 10 20:45:00.053390 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: thunder lock: enabled Feb 10 20:45:00.053390 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 10 20:45:00.053390 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 10 20:45:00.097874 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: Python main interpreter initialized at 0x55e7875009c0 Feb 10 20:45:00.097874 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: python threads support enabled Feb 10 20:45:00.097874 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: your server socket listen backlog is limited to 100 connections Feb 10 20:45:00.097874 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: your mercy for graceful operations on workers is 90 seconds Feb 10 20:45:00.098305 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: mapped 403077 bytes (393 KB) for 2 cores Feb 10 20:45:00.098305 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: *** Operational MODE: preforking *** Feb 10 20:45:00.098620 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: *** uWSGI is running in multiple interpreter mode *** Feb 10 20:45:00.098620 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: spawned uWSGI master process (pid: 79111) Feb 10 20:45:00.098827 dv-cinder-825688-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 10 20:45:00.101746 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: spawned uWSGI worker 1 (pid: 79128, cores: 1) Feb 10 20:45:00.105383 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: spawned uWSGI worker 2 (pid: 79129, cores: 1) Feb 10 20:45:00.105383 dv-cinder-825688-3-iscsi devstack@keystone.service[79111]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 10 20:45:05.744711 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 10 20:45:05.744711 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: from cryptography.utils import int_from_bytes Feb 10 20:45:05.745729 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 10 20:45:05.745729 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: from cryptography.utils import int_from_bytes Feb 10 20:45:05.746161 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 10 20:45:05.746161 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: from cryptography.utils import int_from_bytes Feb 10 20:45:05.746269 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 10 20:45:05.746269 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: from cryptography.utils import int_from_bytes Feb 10 20:45:05.789792 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 10 20:45:05.789946 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 10 20:45:05.790031 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 10 20:45:05.790113 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 10 20:45:05.790176 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] command line args: [] {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 10 20:45:05.790240 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] command line args: [] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 10 20:45:05.790463 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 10 20:45:05.790552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 10 20:45:05.790625 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ================================================================================ {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 10 20:45:05.790690 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ================================================================================ {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 10 20:45:05.790856 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] admin_token = **** {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.790939 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] admin_token = **** {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.791084 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] config_dir = [] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.791161 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] config_dir = [] {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.791233 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.791292 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.791349 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] config_source = [] {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.791457 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] config_source = [] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.791627 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] debug = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.791717 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] debug = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.791780 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.794192 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.794192 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.794353 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.794425 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.794485 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.794549 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.794607 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.794670 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.794738 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.794803 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] list_limit = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.794866 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] list_limit = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.794924 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] log_config_append = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.794980 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] log_config_append = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.795037 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.795103 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.795168 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] log_dir = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.795226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] log_dir = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.795281 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] log_file = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.795343 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] log_file = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.795401 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.795464 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.795527 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.795585 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.795647 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.795712 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.795775 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.795847 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.795916 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.795982 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.796041 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.796105 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.796165 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.796231 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.796291 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.796361 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.796418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.796479 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.796537 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.796605 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.796669 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.796728 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.796785 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.796847 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.796910 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.796978 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.797038 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.797093 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.797149 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.797206 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.797272 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.31/identity {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.797332 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.31/identity {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.798176 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] publish_errors = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.798413 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] publish_errors = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.798582 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.798769 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.798954 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.799138 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.799331 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.799517 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.799760 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.800053 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.800222 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.800444 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.800606 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] standard_threads = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.800790 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] standard_threads = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.800980 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.801184 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.801402 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.801600 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.801767 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.801953 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.802143 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] use_journal = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.802331 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] use_journal = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.802516 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] use_json = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.802712 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] use_json = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.803002 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] use_stderr = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.803138 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] use_stderr = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.803283 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] use_syslog = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.803442 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] use_syslog = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.803571 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.803720 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 20:45:05.803853 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.803980 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.804138 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.804293 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.804426 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.804564 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.804690 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.804814 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.804944 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.805070 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.805200 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.805441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.805586 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.805718 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.805844 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.805968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.806092 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.806225 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.806350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.806480 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.806605 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.806729 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.806860 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.807008 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.807140 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.807266 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.807406 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.807545 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.807683 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.807810 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.807935 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.808060 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.808185 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.808309 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.808445 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.808577 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.808709 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.808840 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.808965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.809100 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.809236 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.809425 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.809567 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.809694 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.809819 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.809943 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.810075 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.810200 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.810324 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.810448 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.810579 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.810704 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.810849 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.810975 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.811105 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.811230 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.811354 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.811484 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.811688 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.811817 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.811941 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.812065 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.812188 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.812311 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.812443 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.812569 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.812709 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.812835 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.812960 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.813090 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.813223 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.813371 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.813504 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.813629 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.813753 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.813886 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.814020 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.814145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.814269 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.814402 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.814527 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.814651 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.814782 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.814912 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.815037 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.815161 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.815285 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.815416 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.815541 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.815664 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.815788 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.815788 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.816022 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.817416 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.817612 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.817802 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.817988 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.818176 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.818361 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.818591 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.818753 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.819001 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.819202 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.819416 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.819574 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.819796 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.819977 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.820165 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.820351 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.820536 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.820720 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.820941 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.821109 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.821333 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.821557 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.821743 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.821927 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.822129 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.822301 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.822433 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.822657 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.822821 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.822990 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.823119 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.823253 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.823391 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.823518 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.823681 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.823823 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.823952 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.824084 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.824222 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.824351 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.824496 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.824624 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.824755 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.824883 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.825046 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.825178 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.825305 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.825453 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.825581 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.825706 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.825843 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.825970 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.826096 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.826231 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.826365 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.826493 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.826627 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.826754 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.826880 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.827005 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.827136 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.827262 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.827473 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.827652 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.827811 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.828007 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.828140 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.828278 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.828413 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.828542 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.828669 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.828795 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.828921 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.829046 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.829183 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.829311 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.829527 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.829656 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.829781 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.829921 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.830055 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.830193 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.830319 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.830444 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.830615 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.830756 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.831028 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.831186 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.831318 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.831444 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.831570 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.831696 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.831823 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.831958 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.832085 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.832222 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.832349 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.832474 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.832600 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.832735 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.832862 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.832995 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.833122 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.833248 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.833392 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.833535 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.833663 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.833789 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.833927 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.834053 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.834179 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.834316 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.834452 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.834579 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.834705 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] auth.external = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.834831 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.834958 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.835092 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] auth.external = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.835219 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.835348 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.835502 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.835642 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.835782 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] auth.password = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.835916 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.836045 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] auth.token = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.836180 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] auth.password = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.836307 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.836434 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] auth.token = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.836560 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.836686 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.836813 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.836951 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.837088 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.837247 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.837480 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.837651 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.837782 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.837922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.838052 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.838180 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.838377 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] credential.caching = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.838510 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.838646 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.838776 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] credential.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.838903 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.839036 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.839165 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.839292 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.839431 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.839569 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.839697 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.839824 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.839950 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.840077 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.840212 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.840342 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.840469 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.840595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.840721 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.840848 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.840982 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.841110 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.841250 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.841412 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.841559 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.841689 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.841824 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.841952 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.842078 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.842206 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.842332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.842459 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.842593 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] federation.caching = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.842721 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.842848 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.842974 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] federation.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.843111 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.843239 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.843448 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.843578 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.843706 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.843832 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.843959 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.844086 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.844220 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.844349 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.844484 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.844612 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.844739 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.844875 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.845012 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.845155 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.845284 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.845472 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.845602 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.845799 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.845954 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] identity.caching = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.846084 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.846211 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.846343 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.846470 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.846597 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.846733 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.846872 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.847000 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.847133 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.847260 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.847386 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.847533 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.847664 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.847791 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.847917 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.848045 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.848171 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.848312 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.848441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.848627 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.848759 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.848887 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.849013 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.849148 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.849277 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.849428 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.849559 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.849687 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.849813 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.849964 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.850094 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.850222 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.850348 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.850486 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.850626 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.850755 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.850882 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.851008 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.851134 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.851261 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.851395 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.851561 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.851693 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.851820 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.851946 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.852072 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.852220 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.852349 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.852481 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.852648 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.852777 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.852903 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.853037 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.853165 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.853292 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.853454 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.853583 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.853709 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.853845 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.854047 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.861484 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.861571 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.861635 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.861697 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.861697 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.861828 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.861890 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.861950 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.862016 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.862077 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.862147 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.862208 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.862267 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.862327 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.862386 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.862444 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.862510 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.862571 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.862630 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.862688 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.862747 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.862805 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.862873 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.862933 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.862993 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.863051 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.863109 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.863167 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.863235 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.863296 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.863355 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.863420 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.863482 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.863563 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.863635 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.863697 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.863755 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.863814 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.863872 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.863930 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.863997 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.user = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.864064 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.864126 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.864185 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.864243 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.864301 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.864369 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.864429 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.864487 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.864545 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.864609 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.864670 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.864744 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.864807 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.864865 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.864923 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.864981 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.865038 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.865104 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.865170 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.865230 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.865230 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.865333 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.865429 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.865506 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.865580 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.865580 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.865684 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.865741 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.865798 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.865798 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.865911 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.865984 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.866055 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.866055 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.866196 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.866268 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.866339 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.866339 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.866473 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.866543 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.866621 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.866693 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.866764 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.866835 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.866905 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.866974 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.867052 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.867124 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.867196 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.867265 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.867336 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.867405 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.867482 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.867559 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.867631 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.867701 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.867772 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.867842 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.867919 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.867993 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.868063 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.868133 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.868202 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.868272 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.868349 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.868422 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.868492 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.868561 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.868631 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.868707 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.868853 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.868927 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.868998 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] resource.caching = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.869069 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.869141 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.869216 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.869295 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.869409 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.869484 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.869583 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] resource.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.869654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.869724 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.869808 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.869881 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.869958 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.870030 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.870113 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.870188 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.870267 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.870340 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.870410 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.870480 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.870549 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] role.caching = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.870619 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.870696 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] role.driver = sql {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.870768 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.870839 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.870909 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.870979 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.871049 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] role.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.871126 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.871199 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] role.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.871271 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.871341 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.871412 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.871482 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.871560 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.871632 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.871705 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.871775 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.871844 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.871914 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.871992 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.872064 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.872134 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.872204 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.872274 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.872355 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.872435 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.872507 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.872578 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.872647 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.872717 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.872795 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.872795 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.872923 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.872994 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.873063 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.873133 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.873210 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.873210 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.873340 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.873427 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.873497 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.873570 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.873653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.873727 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.873798 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.873868 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.873938 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.873997 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.874063 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.874123 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.874180 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.874238 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.874295 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.874351 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.874415 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.874475 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.874532 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.874597 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.874659 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.874716 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.874781 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.874841 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.874899 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.874956 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.875012 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.875074 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.875145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.875205 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.875262 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.875319 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] token.caching = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.875375 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.875433 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.875497 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.875557 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.875614 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.875671 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.875728 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] token.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.875785 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.875850 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.875917 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.875975 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.876032 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.876089 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.876510 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.876583 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.876643 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.876700 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.876757 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.876814 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.876872 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.876936 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.876936 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.876936 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.876936 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.877127 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.877190 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.877190 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.877293 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.877364 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.877364 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.877472 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.877542 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.877542 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.877646 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.877703 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.877703 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.connection = **** {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.877703 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.877865 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.877931 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.877931 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.878044 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.878119 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.878119 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.878222 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.878279 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.878279 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.878279 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.878435 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] database.connection = **** {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.878500 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.878500 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.878612 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.878678 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.878678 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.878795 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.878853 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.878853 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.878853 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.879007 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.879075 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.879075 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.879180 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.879245 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.879245 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 10 20:45:05.879350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.879350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.879350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.879350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.879350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.879350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.879350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.879350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.879350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.879847 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.879847 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.879847 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.879847 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.879847 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 20:45:05.879847 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 10 20:45:05.903779 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:05.904003 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:05.904208 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:05.905606 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:05.905898 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:05.906342 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:05.912838 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:05.914768 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:05.942794 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:05.942993 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:05.943118 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:05.943240 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:05.996751 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:05.997066 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.047773 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.048023 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.048296 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.048477 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.112177 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.112448 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.112757 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.112937 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.112937 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.113203 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.113342 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.113342 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.113601 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.113723 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.113845 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.113966 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.138901 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.139150 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.139333 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.139465 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.139607 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.139747 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.139870 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.139991 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.140111 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.140111 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.140349 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.140600 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.140869 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.141137 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.151356 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.151561 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.164052 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.164287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.164468 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.164598 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.164721 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.164862 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.164862 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.165093 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.165215 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.165215 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.165503 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.165733 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.166005 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.166272 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 20:45:06.182679 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.182877 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.183028 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 10 20:45:06.183155 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 10 20:45:06.183507 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.183684 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.183829 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 10 20:45:06.183968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 10 20:45:06.184193 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.184371 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.184543 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.184677 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.185003 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.185194 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.185329 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.185476 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.197338 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.197839 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.198084 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.198384 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.199032 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.199539 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.199868 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.200207 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.206470 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.208462 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.209676 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.209952 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.210225 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.210499 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.210770 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.211023 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.211279 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.211541 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.211806 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.212155 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.212353 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.212484 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.212739 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.213078 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.213530 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.213870 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.214170 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.214494 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.214823 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.215151 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.215578 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.215902 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.238155 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.239754 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.240031 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.241614 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.243240 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.243580 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.245279 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.245581 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.245850 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.249132 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.249500 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.249839 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.253255 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.253559 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.257417 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.257788 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.257965 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.258099 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.258400 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.258684 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.258953 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.259328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.259598 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.259838 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.262747 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.263094 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.263432 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.263772 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.264105 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.264548 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.264878 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.265205 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.277930 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.278203 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.282755 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.283406 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.283746 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.286289 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.286580 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.288455 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.291489 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.292239 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.292592 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.295030 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.297630 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.298621 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.298835 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.299141 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.299522 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.299790 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.300082 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.301586 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.305159 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.305536 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.305887 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.306343 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.306684 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.307045 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.321024 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.321311 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.321601 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.321867 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.325804 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.326153 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.326475 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.326794 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.329729 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.331525 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.331793 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.334743 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.334832 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.335018 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.335285 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.335560 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.335832 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.336737 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.337069 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.340176 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.340513 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.340845 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.341185 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.341548 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.348849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.349122 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.349416 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.349693 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.349971 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.350237 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.350510 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.355166 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.355506 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.355851 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.356184 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.356517 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.356845 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.357183 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.370025 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.373280 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.374793 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.377200 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.378779 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.380253 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.380382 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.380596 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.380870 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.383886 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.385641 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.387302 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.387670 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.388052 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.389257 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.390870 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.393988 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.394268 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.394539 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.394800 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.397130 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.398834 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.402132 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.402512 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.402879 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.403242 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.403634 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.403909 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.404208 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.412692 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.413140 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.413540 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.515939 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.516196 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.516505 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.516789 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.517053 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.517316 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.517619 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.517880 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.518141 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.518418 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.518695 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.518947 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.519200 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.519445 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.526166 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 20:45:06.526166 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.526166 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.526473 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.526840 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.527198 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.527575 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.527925 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.528312 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.528677 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.529055 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.529422 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.529777 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.530167 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 20:45:06.556766 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e7875009c0 pid: 79128 (default app) Feb 10 20:45:06.560194 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc5b8d-c419-473e-a22c-ed40f4600bf9 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:06.560477 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc5b8d-c419-473e-a22c-ed40f4600bf9 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:06.560750 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc5b8d-c419-473e-a22c-ed40f4600bf9 None None] PATH_INFO: `/v3` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:06.567633 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1/1] 10.222.0.31 () {50 vars in 791 bytes} [Thu Feb 10 20:45:06 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:06.568367 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e7875009c0 pid: 79129 (default app) Feb 10 20:45:14.658156 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603a696-5c84-4d18-ae9e-48abdad9bb4b None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:14.659070 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603a696-5c84-4d18-ae9e-48abdad9bb4b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:14.659070 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603a696-5c84-4d18-ae9e-48abdad9bb4b None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:14.662491 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 2/2] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:14.670520 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d259d-c4c2-4bab-883f-aa6693b45547 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:14.671053 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d259d-c4c2-4bab-883f-aa6693b45547 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:14.671053 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d259d-c4c2-4bab-883f-aa6693b45547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:14.711898 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG oslo_db.sqlalchemy.engines [None req-743d259d-c4c2-4bab-883f-aa6693b45547 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 10 20:45:14.908563 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG passlib.handlers.bcrypt [None req-743d259d-c4c2-4bab-883f-aa6693b45547 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79129) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 10 20:45:14.908871 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG passlib.handlers.bcrypt [None req-743d259d-c4c2-4bab-883f-aa6693b45547 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79129) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 10 20:45:14.965034 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-743d259d-c4c2-4bab-883f-aa6693b45547 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:14.966661 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-743d259d-c4c2-4bab-883f-aa6693b45547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:15.091774 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1/3] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:15.248679 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603a696-5c84-4d18-ae9e-48abdad9bb4b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:15.287590 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG oslo_db.sqlalchemy.engines [None req-6603a696-5c84-4d18-ae9e-48abdad9bb4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 10 20:45:15.412056 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603a696-5c84-4d18-ae9e-48abdad9bb4b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:15.417613 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c97292-ae67-49d2-be7e-0e9a832c031f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:15.418251 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c97292-ae67-49d2-be7e-0e9a832c031f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:15.418533 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c97292-ae67-49d2-be7e-0e9a832c031f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:15.418799 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c97292-ae67-49d2-be7e-0e9a832c031f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:15.427780 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c97292-ae67-49d2-be7e-0e9a832c031f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:15.478557 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c6c97292-ae67-49d2-be7e-0e9a832c031f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 10 20:45:15.478894 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c97292-ae67-49d2-be7e-0e9a832c031f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:15.488746 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 3/4] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:45:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:45:15.495905 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d259d-c4c2-4bab-883f-aa6693b45547 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:15.516687 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d259d-c4c2-4bab-883f-aa6693b45547 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:15.523689 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9f293-3b59-4b87-adb4-2f62394688c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:15.524862 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9f293-3b59-4b87-adb4-2f62394688c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:15.525149 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9f293-3b59-4b87-adb4-2f62394688c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:15.525460 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9f293-3b59-4b87-adb4-2f62394688c0 admin admin] PATH_INFO: `/v3/projects/3c795df8915a438b8adfbed3181b36a2` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:15.527262 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9f293-3b59-4b87-adb4-2f62394688c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c795df8915a438b8adfbed3181b36a2)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:15.582208 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.common.rbac_enforcer.enforcer [None req-84a9f293-3b59-4b87-adb4-2f62394688c0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 10 20:45:15.582545 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9f293-3b59-4b87-adb4-2f62394688c0 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:15.587193 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 2/5] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:15 2022] GET /identity/v3/projects/3c795df8915a438b8adfbed3181b36a2 => generated 344 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:17.781961 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304021ad-347f-4893-842f-20d464c142b7 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:17.782823 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304021ad-347f-4893-842f-20d464c142b7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:17.782823 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304021ad-347f-4893-842f-20d464c142b7 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:17.790343 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 4/6] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:17 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:17.796377 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfcf9d-c52b-4501-9eec-58d08bc32ccb None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:17.796786 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfcf9d-c52b-4501-9eec-58d08bc32ccb None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:17.796870 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfcf9d-c52b-4501-9eec-58d08bc32ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:17.817283 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-83cfcf9d-c52b-4501-9eec-58d08bc32ccb None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:17.818843 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-83cfcf9d-c52b-4501-9eec-58d08bc32ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:17.828439 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 3/7] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:17.861673 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304021ad-347f-4893-842f-20d464c142b7 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:17.875503 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304021ad-347f-4893-842f-20d464c142b7 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:17.881037 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f83d7-cc6f-49a7-9bd1-59a18e1ce2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:17.881686 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f83d7-cc6f-49a7-9bd1-59a18e1ce2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:17.881964 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f83d7-cc6f-49a7-9bd1-59a18e1ce2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:17.882235 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f83d7-cc6f-49a7-9bd1-59a18e1ce2b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:17.890431 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f83d7-cc6f-49a7-9bd1-59a18e1ce2b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:17.892214 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f83d7-cc6f-49a7-9bd1-59a18e1ce2b0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:17.900872 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 5/8] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:45:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:45:17.906888 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfcf9d-c52b-4501-9eec-58d08bc32ccb None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:17.920995 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfcf9d-c52b-4501-9eec-58d08bc32ccb None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:17.929847 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dca6e-76f3-4d67-aa5b-5ca3db61aea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:17.931147 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dca6e-76f3-4d67-aa5b-5ca3db61aea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:17.931545 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dca6e-76f3-4d67-aa5b-5ca3db61aea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:17.931929 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dca6e-76f3-4d67-aa5b-5ca3db61aea3 admin admin] PATH_INFO: `/v3/users/ca0523bae3774fd3bb058d660150718b` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:17.934094 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5dca6e-76f3-4d67-aa5b-5ca3db61aea3 admin admin] RBAC: Authorizing `identity:get_user(user_id=ca0523bae3774fd3bb058d660150718b)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:17.935930 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5dca6e-76f3-4d67-aa5b-5ca3db61aea3 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:17.937477 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 4/9] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:17 2022] GET /identity/v3/users/ca0523bae3774fd3bb058d660150718b => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:20.201644 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825fc94-769d-4ae9-9308-a2391115ebd8 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:20.202188 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825fc94-769d-4ae9-9308-a2391115ebd8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:20.202188 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825fc94-769d-4ae9-9308-a2391115ebd8 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:20.203987 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 6/10] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:20.209515 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfdbcb-a1b5-44d3-b475-655e2084121d None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:20.209958 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfdbcb-a1b5-44d3-b475-655e2084121d None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:20.210114 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfdbcb-a1b5-44d3-b475-655e2084121d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:20.211896 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ba9d4-0c21-464b-bfa0-d231ff1265eb None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:20.212178 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ba9d4-0c21-464b-bfa0-d231ff1265eb None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:20.212452 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ba9d4-0c21-464b-bfa0-d231ff1265eb None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:20.214272 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 7/11] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:45:20.219799 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ebe14-b9e6-4e19-ab11-dad4c06e5762 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:20.220087 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ebe14-b9e6-4e19-ab11-dad4c06e5762 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:20.220370 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ebe14-b9e6-4e19-ab11-dad4c06e5762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:20.228154 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-e3dfdbcb-a1b5-44d3-b475-655e2084121d None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:20.229288 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-e3dfdbcb-a1b5-44d3-b475-655e2084121d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:20.237622 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 5/12] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:45:20.260332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfdbcb-a1b5-44d3-b475-655e2084121d None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:20.263050 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG passlib.handlers.bcrypt [None req-b77ebe14-b9e6-4e19-ab11-dad4c06e5762 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79128) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 10 20:45:20.263463 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG passlib.handlers.bcrypt [None req-b77ebe14-b9e6-4e19-ab11-dad4c06e5762 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79128) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 10 20:45:20.269469 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfdbcb-a1b5-44d3-b475-655e2084121d None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:20.275087 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598446f-49e6-4d57-945d-c63b71ccaf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:20.275721 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598446f-49e6-4d57-945d-c63b71ccaf5d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:20.275995 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598446f-49e6-4d57-945d-c63b71ccaf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:20.276309 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598446f-49e6-4d57-945d-c63b71ccaf5d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:20.284441 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598446f-49e6-4d57-945d-c63b71ccaf5d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:20.286273 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598446f-49e6-4d57-945d-c63b71ccaf5d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:20.296099 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 6/13] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:45:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:45:20.301177 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598446f-49e6-4d57-945d-c63b71ccaf5d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:20.309683 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598446f-49e6-4d57-945d-c63b71ccaf5d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:20.309839 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-b77ebe14-b9e6-4e19-ab11-dad4c06e5762 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:20.311428 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b77ebe14-b9e6-4e19-ab11-dad4c06e5762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:20.314679 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6ab0a-e102-4695-97ac-b52a0caf12e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:20.315417 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6ab0a-e102-4695-97ac-b52a0caf12e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:20.315645 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6ab0a-e102-4695-97ac-b52a0caf12e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:20.315950 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6ab0a-e102-4695-97ac-b52a0caf12e3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:20.317161 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6ab0a-e102-4695-97ac-b52a0caf12e3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:20.318850 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6ab0a-e102-4695-97ac-b52a0caf12e3 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:20.320386 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 7/14] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:45:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:20.334331 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 8/15] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:45:20.359664 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6ab0a-e102-4695-97ac-b52a0caf12e3 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:20.370478 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6ab0a-e102-4695-97ac-b52a0caf12e3 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:20.376564 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f1e6b-22c1-4aa8-beaf-a82c86348cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:20.377418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f1e6b-22c1-4aa8-beaf-a82c86348cfc admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:20.378057 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f1e6b-22c1-4aa8-beaf-a82c86348cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:20.378334 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f1e6b-22c1-4aa8-beaf-a82c86348cfc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:20.394545 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f1e6b-22c1-4aa8-beaf-a82c86348cfc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:20.401595 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-6a7f1e6b-22c1-4aa8-beaf-a82c86348cfc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:45:20.402969 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 8/16] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:45:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:20.409327 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ebe14-b9e6-4e19-ab11-dad4c06e5762 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:20.419000 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ebe14-b9e6-4e19-ab11-dad4c06e5762 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:20.423976 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799f555-4404-49d7-8855-e1f65d8b42bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:20.424993 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799f555-4404-49d7-8855-e1f65d8b42bb admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:20.425272 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799f555-4404-49d7-8855-e1f65d8b42bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:20.425580 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799f555-4404-49d7-8855-e1f65d8b42bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:20.426517 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799f555-4404-49d7-8855-e1f65d8b42bb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:20.426813 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799f555-4404-49d7-8855-e1f65d8b42bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:20.428653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-9799f555-4404-49d7-8855-e1f65d8b42bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:45:20.428653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Feb 10 20:45:20.428653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: Feb 10 20:45:20.430367 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799f555-4404-49d7-8855-e1f65d8b42bb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:20.448223 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 9/17] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:20.454438 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f1e6b-22c1-4aa8-beaf-a82c86348cfc admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:20.465338 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f1e6b-22c1-4aa8-beaf-a82c86348cfc admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:20.471115 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87287f-8f4a-4482-a4f3-0ce0d2f9c324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:20.471996 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87287f-8f4a-4482-a4f3-0ce0d2f9c324 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:20.472270 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87287f-8f4a-4482-a4f3-0ce0d2f9c324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:20.472536 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87287f-8f4a-4482-a4f3-0ce0d2f9c324 admin admin] PATH_INFO: `/v3/users/ca0523bae3774fd3bb058d660150718b` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:20.473944 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87287f-8f4a-4482-a4f3-0ce0d2f9c324 admin admin] RBAC: Authorizing `identity:get_user(user_id=ca0523bae3774fd3bb058d660150718b)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:20.475830 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87287f-8f4a-4482-a4f3-0ce0d2f9c324 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:20.477460 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 9/18] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:20 2022] GET /identity/v3/users/ca0523bae3774fd3bb058d660150718b => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:20.483211 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799f555-4404-49d7-8855-e1f65d8b42bb admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:20.493618 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799f555-4404-49d7-8855-e1f65d8b42bb admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:20.499098 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8dde4-3462-4fa6-97f4-82f69212a7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:20.499893 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8dde4-3462-4fa6-97f4-82f69212a7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:20.500170 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8dde4-3462-4fa6-97f4-82f69212a7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:20.500436 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8dde4-3462-4fa6-97f4-82f69212a7c4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:20.501965 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8dde4-3462-4fa6-97f4-82f69212a7c4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:20.504115 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8dde4-3462-4fa6-97f4-82f69212a7c4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:20.505957 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 10/19] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:45:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:20.511916 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87287f-8f4a-4482-a4f3-0ce0d2f9c324 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:20.522024 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87287f-8f4a-4482-a4f3-0ce0d2f9c324 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:20.527011 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db447b-bfc8-433c-9f00-2f112538bc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:20.527665 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db447b-bfc8-433c-9f00-2f112538bc61 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:20.527943 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db447b-bfc8-433c-9f00-2f112538bc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:20.528210 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db447b-bfc8-433c-9f00-2f112538bc61 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:20.529049 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db447b-bfc8-433c-9f00-2f112538bc61 admin admin] RBAC: Adding query filter params (role.id=e06447c1c62d465c9f9c58168be71ed8, scope.domain.id=default, user.id=ca0523bae3774fd3bb058d660150718b) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:20.529503 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db447b-bfc8-433c-9f00-2f112538bc61 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:20.531347 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING py.warnings [None req-27db447b-bfc8-433c-9f00-2f112538bc61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:45:20.531347 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: warnings.warn(msg) Feb 10 20:45:20.531347 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: Feb 10 20:45:20.532558 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db447b-bfc8-433c-9f00-2f112538bc61 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:20.540119 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 10/20] 10.222.0.31 () {56 vars in 1343 bytes} [Thu Feb 10 20:45:20 2022] GET /identity/v3/role_assignments?user.id=ca0523bae3774fd3bb058d660150718b&scope.domain.id=default&role.id=e06447c1c62d465c9f9c58168be71ed8 => generated 233 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:22.773729 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822b393-e7b1-4de0-92aa-0fb5b05e09cd None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:22.774763 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822b393-e7b1-4de0-92aa-0fb5b05e09cd None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:22.775264 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822b393-e7b1-4de0-92aa-0fb5b05e09cd None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:22.777937 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 11/21] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:22.783163 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a19864-638d-4d9d-bdc9-1b796569a6ae None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:22.784015 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a19864-638d-4d9d-bdc9-1b796569a6ae None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:22.784474 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a19864-638d-4d9d-bdc9-1b796569a6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:22.807007 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-42a19864-638d-4d9d-bdc9-1b796569a6ae None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:22.808522 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-42a19864-638d-4d9d-bdc9-1b796569a6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:22.816648 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 11/22] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:22.851891 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822b393-e7b1-4de0-92aa-0fb5b05e09cd None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:22.864606 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822b393-e7b1-4de0-92aa-0fb5b05e09cd None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:22.869336 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d5806-8093-4bbb-8d0f-49cb663574ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:22.874495 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d5806-8093-4bbb-8d0f-49cb663574ec admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:22.875087 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d5806-8093-4bbb-8d0f-49cb663574ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:22.875606 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d5806-8093-4bbb-8d0f-49cb663574ec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:22.900231 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d5806-8093-4bbb-8d0f-49cb663574ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:22.902490 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d5806-8093-4bbb-8d0f-49cb663574ec admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:22.923482 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-b14d5806-8093-4bbb-8d0f-49cb663574ec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:45:22.925049 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 12/23] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:22.931134 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a19864-638d-4d9d-bdc9-1b796569a6ae None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:22.940720 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a19864-638d-4d9d-bdc9-1b796569a6ae None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:22.948901 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec143a-cddd-48b7-9057-08bf0ca49a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:22.949947 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec143a-cddd-48b7-9057-08bf0ca49a4a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:22.950416 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec143a-cddd-48b7-9057-08bf0ca49a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:22.950931 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec143a-cddd-48b7-9057-08bf0ca49a4a admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:22.951851 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec143a-cddd-48b7-9057-08bf0ca49a4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:22.952359 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec143a-cddd-48b7-9057-08bf0ca49a4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:22.953603 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING py.warnings [None req-39ec143a-cddd-48b7-9057-08bf0ca49a4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:45:22.953603 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: warnings.warn(msg) Feb 10 20:45:22.953603 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: Feb 10 20:45:22.954841 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec143a-cddd-48b7-9057-08bf0ca49a4a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:22.977621 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 12/24] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:22.982995 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d5806-8093-4bbb-8d0f-49cb663574ec admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:22.993076 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d5806-8093-4bbb-8d0f-49cb663574ec admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:23.001806 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744e940-488f-4ee7-bc01-405d8295f302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:23.002723 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744e940-488f-4ee7-bc01-405d8295f302 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:23.003573 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744e940-488f-4ee7-bc01-405d8295f302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:23.004064 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744e940-488f-4ee7-bc01-405d8295f302 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:23.004995 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744e940-488f-4ee7-bc01-405d8295f302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:23.006228 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-a744e940-488f-4ee7-bc01-405d8295f302 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:45:23.006228 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Feb 10 20:45:23.006228 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: Feb 10 20:45:23.007779 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744e940-488f-4ee7-bc01-405d8295f302 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:23.171839 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 13/25] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 10 20:45:22 2022] POST /identity/v3/projects => generated 301 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:45:23.473672 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf4d2a-2802-4904-b72f-9262a05ecd85 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:23.474365 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf4d2a-2802-4904-b72f-9262a05ecd85 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:23.474868 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf4d2a-2802-4904-b72f-9262a05ecd85 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:23.477544 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 13/26] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:23.483388 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffa266-2875-490f-a447-0a89e94c1534 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:23.483952 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffa266-2875-490f-a447-0a89e94c1534 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:23.484417 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffa266-2875-490f-a447-0a89e94c1534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:23.510928 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-52ffa266-2875-490f-a447-0a89e94c1534 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:23.512973 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-52ffa266-2875-490f-a447-0a89e94c1534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:23.558248 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419ec83-7c45-4b8f-8569-6b16f12c8d6e None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:23.558570 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419ec83-7c45-4b8f-8569-6b16f12c8d6e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:23.558850 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419ec83-7c45-4b8f-8569-6b16f12c8d6e None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:23.560625 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 14/27] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:45:23.567500 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9952b-5c1a-440f-bc27-5cd907a6a534 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:23.567879 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9952b-5c1a-440f-bc27-5cd907a6a534 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:23.568253 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9952b-5c1a-440f-bc27-5cd907a6a534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:23.588916 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-62a9952b-5c1a-440f-bc27-5cd907a6a534 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:23.590332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-62a9952b-5c1a-440f-bc27-5cd907a6a534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:23.617303 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 14/28] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:23.649026 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 15/29] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:45:23.649459 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffa266-2875-490f-a447-0a89e94c1534 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:23.662287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffa266-2875-490f-a447-0a89e94c1534 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:23.670975 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8f0ad-5e86-42c5-a85a-a6e9ca5de6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:23.671835 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8f0ad-5e86-42c5-a85a-a6e9ca5de6cd admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:23.672251 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8f0ad-5e86-42c5-a85a-a6e9ca5de6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:23.672558 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9952b-5c1a-440f-bc27-5cd907a6a534 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:23.672828 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8f0ad-5e86-42c5-a85a-a6e9ca5de6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:23.673764 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8f0ad-5e86-42c5-a85a-a6e9ca5de6cd admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:23.675125 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-cfa8f0ad-5e86-42c5-a85a-a6e9ca5de6cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:45:23.675125 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Feb 10 20:45:23.675125 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: Feb 10 20:45:23.676283 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8f0ad-5e86-42c5-a85a-a6e9ca5de6cd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:23.682145 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9952b-5c1a-440f-bc27-5cd907a6a534 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:23.687337 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9b4d7-c05d-46da-8a57-a79a63718b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:23.688451 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9b4d7-c05d-46da-8a57-a79a63718b71 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:23.688779 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9b4d7-c05d-46da-8a57-a79a63718b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:23.689060 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9b4d7-c05d-46da-8a57-a79a63718b71 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:23.701219 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9b4d7-c05d-46da-8a57-a79a63718b71 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:23.708379 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-08c9b4d7-c05d-46da-8a57-a79a63718b71 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:45:23.709047 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 15/30] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:45:23 2022] POST /identity/v3/roles => generated 225 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:45:23.709689 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 16/31] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:45:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:45:23.715579 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8f0ad-5e86-42c5-a85a-a6e9ca5de6cd admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:23.722623 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b5c9e-0c2d-40f1-a1f4-80cb7d17be89 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:23.723264 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b5c9e-0c2d-40f1-a1f4-80cb7d17be89 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:23.725067 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b5c9e-0c2d-40f1-a1f4-80cb7d17be89 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:23.726362 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 17/32] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:23.731591 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8f0ad-5e86-42c5-a85a-a6e9ca5de6cd admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:23.733675 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048427fc-6bc7-4a89-ba82-a9e1e49c145d None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:23.734182 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048427fc-6bc7-4a89-ba82-a9e1e49c145d None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:23.734647 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048427fc-6bc7-4a89-ba82-a9e1e49c145d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:23.742367 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df32783-938d-4e47-bbec-a481c9d8941d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:23.742866 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df32783-938d-4e47-bbec-a481c9d8941d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:23.743148 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df32783-938d-4e47-bbec-a481c9d8941d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:23.743422 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df32783-938d-4e47-bbec-a481c9d8941d admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:23.744250 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df32783-938d-4e47-bbec-a481c9d8941d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:23.744563 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df32783-938d-4e47-bbec-a481c9d8941d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:23.746377 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df32783-938d-4e47-bbec-a481c9d8941d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:23.760867 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-048427fc-6bc7-4a89-ba82-a9e1e49c145d None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:23.762578 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-048427fc-6bc7-4a89-ba82-a9e1e49c145d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:23.766166 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 16/33] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:23.774107 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df32783-938d-4e47-bbec-a481c9d8941d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:23.777689 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 18/34] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:23.793552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df32783-938d-4e47-bbec-a481c9d8941d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:23.807091 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a4148-4bd1-4b72-a3c0-4c291a2928d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:23.807965 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a4148-4bd1-4b72-a3c0-4c291a2928d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:23.808257 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a4148-4bd1-4b72-a3c0-4c291a2928d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:23.808567 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a4148-4bd1-4b72-a3c0-4c291a2928d7 admin admin] PATH_INFO: `/v3/users/ca0523bae3774fd3bb058d660150718b` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:23.814707 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048427fc-6bc7-4a89-ba82-a9e1e49c145d None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:23.815251 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a4148-4bd1-4b72-a3c0-4c291a2928d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=ca0523bae3774fd3bb058d660150718b)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:23.816790 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a4148-4bd1-4b72-a3c0-4c291a2928d7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:23.818898 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 17/35] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:23 2022] GET /identity/v3/users/ca0523bae3774fd3bb058d660150718b => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:23.824625 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a4148-4bd1-4b72-a3c0-4c291a2928d7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:23.829867 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048427fc-6bc7-4a89-ba82-a9e1e49c145d None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:23.835169 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c05dea-0480-47c3-93d7-9b09c2e5b99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:23.836284 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c05dea-0480-47c3-93d7-9b09c2e5b99f admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:23.836758 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c05dea-0480-47c3-93d7-9b09c2e5b99f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:23.837238 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c05dea-0480-47c3-93d7-9b09c2e5b99f admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:23.838332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c05dea-0480-47c3-93d7-9b09c2e5b99f admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:23.839371 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a4148-4bd1-4b72-a3c0-4c291a2928d7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:23.839928 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING py.warnings [None req-15c05dea-0480-47c3-93d7-9b09c2e5b99f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:45:23.839928 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: warnings.warn(msg) Feb 10 20:45:23.839928 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: Feb 10 20:45:23.841289 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c05dea-0480-47c3-93d7-9b09c2e5b99f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:23.852024 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c44c3-78fd-4d6f-aed7-6a18603e7128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:23.853337 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c44c3-78fd-4d6f-aed7-6a18603e7128 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:23.853337 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c44c3-78fd-4d6f-aed7-6a18603e7128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:23.853337 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c44c3-78fd-4d6f-aed7-6a18603e7128 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:23.855046 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c44c3-78fd-4d6f-aed7-6a18603e7128 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:23.857120 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c44c3-78fd-4d6f-aed7-6a18603e7128 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:23.859314 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 18/36] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:45:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:23.864981 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c44c3-78fd-4d6f-aed7-6a18603e7128 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:23.875524 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c44c3-78fd-4d6f-aed7-6a18603e7128 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:23.894857 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973810a-fba2-42f6-b058-34c762285c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:23.895765 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973810a-fba2-42f6-b058-34c762285c6e admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:23.896043 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973810a-fba2-42f6-b058-34c762285c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:23.896317 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973810a-fba2-42f6-b058-34c762285c6e admin admin] PATH_INFO: `/v3/domains/default/users/ca0523bae3774fd3bb058d660150718b/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:23.903380 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973810a-fba2-42f6-b058-34c762285c6e admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ca0523bae3774fd3bb058d660150718b, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:23.904429 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-f973810a-fba2-42f6-b058-34c762285c6e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:45:23.904429 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Feb 10 20:45:23.904429 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: Feb 10 20:45:23.906452 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973810a-fba2-42f6-b058-34c762285c6e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:23.931590 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 19/37] 10.222.0.31 () {58 vars in 1382 bytes} [Thu Feb 10 20:45:23 2022] PUT /identity/v3/domains/default/users/ca0523bae3774fd3bb058d660150718b/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:45:23.979572 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 19/38] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:45:23 2022] POST /identity/v3/roles => generated 219 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:45:24.320107 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7b349-fa69-45ce-b877-c51de63cda84 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:24.320280 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7b349-fa69-45ce-b877-c51de63cda84 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:24.320560 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7b349-fa69-45ce-b877-c51de63cda84 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:24.322567 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 20/39] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:24.328421 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922b558-5c78-437c-add7-d49e8c4cb7e6 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:24.328775 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922b558-5c78-437c-add7-d49e8c4cb7e6 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:24.328965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922b558-5c78-437c-add7-d49e8c4cb7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:24.349578 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-8922b558-5c78-437c-add7-d49e8c4cb7e6 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:24.351156 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-8922b558-5c78-437c-add7-d49e8c4cb7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:24.410007 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 20/40] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:24.432218 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7b349-fa69-45ce-b877-c51de63cda84 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:24.444753 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7b349-fa69-45ce-b877-c51de63cda84 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:24.449169 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c0754-ddec-40c3-be7c-4b76881c47d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:24.449884 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c0754-ddec-40c3-be7c-4b76881c47d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:24.450166 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c0754-ddec-40c3-be7c-4b76881c47d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:24.450439 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c0754-ddec-40c3-be7c-4b76881c47d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:24.451208 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c0754-ddec-40c3-be7c-4b76881c47d9 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:24.452847 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c0754-ddec-40c3-be7c-4b76881c47d9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:24.469217 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 21/41] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:45:24 2022] POST /identity/v3/roles => generated 223 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:45:24.620613 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec1c3f-cbb9-4f2a-8301-ffaf78aba829 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:24.620818 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec1c3f-cbb9-4f2a-8301-ffaf78aba829 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:24.621108 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec1c3f-cbb9-4f2a-8301-ffaf78aba829 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:24.623181 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 21/42] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:24.629263 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e94c81-1613-4e8e-ac99-227a84e78ff7 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:24.629572 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e94c81-1613-4e8e-ac99-227a84e78ff7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:24.629854 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e94c81-1613-4e8e-ac99-227a84e78ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:24.648455 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-d2e94c81-1613-4e8e-ac99-227a84e78ff7 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:24.649658 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d2e94c81-1613-4e8e-ac99-227a84e78ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:24.658459 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 22/43] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:24.682154 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec1c3f-cbb9-4f2a-8301-ffaf78aba829 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:24.694822 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec1c3f-cbb9-4f2a-8301-ffaf78aba829 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:24.698933 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ddd50-0328-4a17-a7f8-15cc55ec747d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:24.699755 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ddd50-0328-4a17-a7f8-15cc55ec747d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:24.700081 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ddd50-0328-4a17-a7f8-15cc55ec747d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:24.700347 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ddd50-0328-4a17-a7f8-15cc55ec747d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:24.701555 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ddd50-0328-4a17-a7f8-15cc55ec747d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:24.703381 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ddd50-0328-4a17-a7f8-15cc55ec747d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:24.704953 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 22/44] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:45:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:24.710788 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e94c81-1613-4e8e-ac99-227a84e78ff7 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:24.720173 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e94c81-1613-4e8e-ac99-227a84e78ff7 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:24.725029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd9a22-7e30-4f7c-bf34-81b7c76decd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:24.725712 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd9a22-7e30-4f7c-bf34-81b7c76decd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:24.725999 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd9a22-7e30-4f7c-bf34-81b7c76decd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:24.726275 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd9a22-7e30-4f7c-bf34-81b7c76decd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:24.727003 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd9a22-7e30-4f7c-bf34-81b7c76decd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:24.728929 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd9a22-7e30-4f7c-bf34-81b7c76decd0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:24.754163 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 23/45] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 10 20:45:24 2022] POST /identity/v3/projects => generated 312 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:45:26.185913 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab499246-5328-4ddc-811b-0f7afdabbfa5 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:26.186471 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab499246-5328-4ddc-811b-0f7afdabbfa5 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:26.186471 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab499246-5328-4ddc-811b-0f7afdabbfa5 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:26.188333 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 23/46] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:26.193899 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fc295-cd99-4d64-976d-ac09344b7034 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:26.194343 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fc295-cd99-4d64-976d-ac09344b7034 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:26.194415 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fc295-cd99-4d64-976d-ac09344b7034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:26.213551 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-bd0fc295-cd99-4d64-976d-ac09344b7034 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:26.214759 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-bd0fc295-cd99-4d64-976d-ac09344b7034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:26.275039 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 24/47] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:26.298416 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab499246-5328-4ddc-811b-0f7afdabbfa5 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:26.312568 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab499246-5328-4ddc-811b-0f7afdabbfa5 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:26.317524 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615abb99-09af-4614-8ba2-663b16f0a2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:26.318312 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615abb99-09af-4614-8ba2-663b16f0a2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:26.318587 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615abb99-09af-4614-8ba2-663b16f0a2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:26.318858 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615abb99-09af-4614-8ba2-663b16f0a2c0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:26.329485 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615abb99-09af-4614-8ba2-663b16f0a2c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:26.336191 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-615abb99-09af-4614-8ba2-663b16f0a2c0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:45:26.337419 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 24/48] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:45:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:26.343650 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fc295-cd99-4d64-976d-ac09344b7034 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:26.354821 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fc295-cd99-4d64-976d-ac09344b7034 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:26.360587 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae386a-37e0-40f7-85d7-0003fdaf7176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:26.361250 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae386a-37e0-40f7-85d7-0003fdaf7176 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:26.361631 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae386a-37e0-40f7-85d7-0003fdaf7176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:26.361900 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae386a-37e0-40f7-85d7-0003fdaf7176 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:26.362657 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae386a-37e0-40f7-85d7-0003fdaf7176 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:26.362955 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae386a-37e0-40f7-85d7-0003fdaf7176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:26.364592 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae386a-37e0-40f7-85d7-0003fdaf7176 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:26.373703 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 25/49] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:26.379886 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615abb99-09af-4614-8ba2-663b16f0a2c0 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:26.390683 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615abb99-09af-4614-8ba2-663b16f0a2c0 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:26.396248 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2b770-9def-407f-8860-64edfbe480ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:26.397113 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2b770-9def-407f-8860-64edfbe480ca admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:26.397399 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2b770-9def-407f-8860-64edfbe480ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:26.397684 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2b770-9def-407f-8860-64edfbe480ca admin admin] PATH_INFO: `/v3/users/ca0523bae3774fd3bb058d660150718b` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:26.399029 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2b770-9def-407f-8860-64edfbe480ca admin admin] RBAC: Authorizing `identity:get_user(user_id=ca0523bae3774fd3bb058d660150718b)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:26.400867 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2b770-9def-407f-8860-64edfbe480ca admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:26.402461 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 25/50] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:26 2022] GET /identity/v3/users/ca0523bae3774fd3bb058d660150718b => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:26.408000 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae386a-37e0-40f7-85d7-0003fdaf7176 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:26.418125 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae386a-37e0-40f7-85d7-0003fdaf7176 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:26.422892 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e6fb0-23f6-49a3-811f-d811ec8d0223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:26.423665 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e6fb0-23f6-49a3-811f-d811ec8d0223 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:26.423944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e6fb0-23f6-49a3-811f-d811ec8d0223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:26.424210 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e6fb0-23f6-49a3-811f-d811ec8d0223 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:26.425463 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e6fb0-23f6-49a3-811f-d811ec8d0223 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:26.427151 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e6fb0-23f6-49a3-811f-d811ec8d0223 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:26.428699 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 26/51] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:45:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:26.434525 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2b770-9def-407f-8860-64edfbe480ca admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:26.444869 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2b770-9def-407f-8860-64edfbe480ca admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:26.450429 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49300705-5db0-47ab-b683-74542def76b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:26.451095 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49300705-5db0-47ab-b683-74542def76b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:26.451374 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49300705-5db0-47ab-b683-74542def76b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:26.451649 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49300705-5db0-47ab-b683-74542def76b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:26.452489 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49300705-5db0-47ab-b683-74542def76b1 admin admin] RBAC: Adding query filter params (role.id=e06447c1c62d465c9f9c58168be71ed8, scope.domain.id=default, user.id=ca0523bae3774fd3bb058d660150718b) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:26.452797 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49300705-5db0-47ab-b683-74542def76b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:26.454796 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49300705-5db0-47ab-b683-74542def76b1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:26.460964 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 26/52] 10.222.0.31 () {56 vars in 1343 bytes} [Thu Feb 10 20:45:26 2022] GET /identity/v3/role_assignments?user.id=ca0523bae3774fd3bb058d660150718b&scope.domain.id=default&role.id=e06447c1c62d465c9f9c58168be71ed8 => generated 530 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:26.922320 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20625867-4288-4981-b25e-e95af6c40053 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:26.922566 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20625867-4288-4981-b25e-e95af6c40053 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:26.922873 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20625867-4288-4981-b25e-e95af6c40053 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:26.924705 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 27/53] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:26.931126 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d81c5-61ef-4061-90a2-53e5b16d0189 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:26.931605 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d81c5-61ef-4061-90a2-53e5b16d0189 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:26.932097 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d81c5-61ef-4061-90a2-53e5b16d0189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:26.953264 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-fd8d81c5-61ef-4061-90a2-53e5b16d0189 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:26.954499 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-fd8d81c5-61ef-4061-90a2-53e5b16d0189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:26.964499 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 27/54] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:26.987834 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20625867-4288-4981-b25e-e95af6c40053 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:27.001472 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20625867-4288-4981-b25e-e95af6c40053 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:27.007092 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8698e-1589-4aa2-8535-689f21e0827e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:27.007858 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8698e-1589-4aa2-8535-689f21e0827e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:27.008148 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8698e-1589-4aa2-8535-689f21e0827e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:27.008407 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8698e-1589-4aa2-8535-689f21e0827e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:27.009690 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8698e-1589-4aa2-8535-689f21e0827e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:27.011393 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8698e-1589-4aa2-8535-689f21e0827e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:27.012934 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 28/55] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:45:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:27.018888 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d81c5-61ef-4061-90a2-53e5b16d0189 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:27.031791 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d81c5-61ef-4061-90a2-53e5b16d0189 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:27.038166 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbe0be-3dfd-44c5-a2a7-e6ec9a6a995e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:27.038802 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbe0be-3dfd-44c5-a2a7-e6ec9a6a995e admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:27.039087 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbe0be-3dfd-44c5-a2a7-e6ec9a6a995e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:27.039356 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbe0be-3dfd-44c5-a2a7-e6ec9a6a995e admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:27.040064 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbe0be-3dfd-44c5-a2a7-e6ec9a6a995e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:27.041088 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING py.warnings [None req-c3bbe0be-3dfd-44c5-a2a7-e6ec9a6a995e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:45:27.041088 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: warnings.warn(msg) Feb 10 20:45:27.041088 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: Feb 10 20:45:27.042357 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbe0be-3dfd-44c5-a2a7-e6ec9a6a995e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:27.073969 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 28/56] 10.222.0.31 () {60 vars in 1161 bytes} [Thu Feb 10 20:45:27 2022] POST /identity/v3/projects => generated 298 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:45:29.277543 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c090a-c727-44d6-969b-86b5a22a0976 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:29.278108 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c090a-c727-44d6-969b-86b5a22a0976 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:29.278108 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c090a-c727-44d6-969b-86b5a22a0976 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:29.279950 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 29/57] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:29.286455 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ba787-0b5e-4275-9a68-da5a1705533c None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:29.287098 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ba787-0b5e-4275-9a68-da5a1705533c None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:29.287347 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ba787-0b5e-4275-9a68-da5a1705533c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:29.314461 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-e42ba787-0b5e-4275-9a68-da5a1705533c None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:29.315650 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-e42ba787-0b5e-4275-9a68-da5a1705533c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:29.376176 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 29/58] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:29.411613 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c090a-c727-44d6-969b-86b5a22a0976 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:29.427010 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c090a-c727-44d6-969b-86b5a22a0976 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:29.432894 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4fe12-05ba-48cb-acde-fad470cc78a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:29.433705 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4fe12-05ba-48cb-acde-fad470cc78a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:29.433995 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4fe12-05ba-48cb-acde-fad470cc78a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:29.434347 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4fe12-05ba-48cb-acde-fad470cc78a2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:29.435593 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4fe12-05ba-48cb-acde-fad470cc78a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:29.437288 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4fe12-05ba-48cb-acde-fad470cc78a2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:29.438894 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 30/59] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:45:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:29.444293 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ba787-0b5e-4275-9a68-da5a1705533c None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:29.454233 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ba787-0b5e-4275-9a68-da5a1705533c None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:29.460197 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88d255-3e25-4437-aa6c-e7a4582018f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:29.460847 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88d255-3e25-4437-aa6c-e7a4582018f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:29.461119 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88d255-3e25-4437-aa6c-e7a4582018f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:29.461378 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88d255-3e25-4437-aa6c-e7a4582018f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:29.462136 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88d255-3e25-4437-aa6c-e7a4582018f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:29.463150 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING py.warnings [None req-9e88d255-3e25-4437-aa6c-e7a4582018f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:45:29.463150 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: warnings.warn(msg) Feb 10 20:45:29.463150 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: Feb 10 20:45:29.464355 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88d255-3e25-4437-aa6c-e7a4582018f3 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:29.496412 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 30/60] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 10 20:45:29 2022] POST /identity/v3/users => generated 275 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:45:32.856049 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483d131-eab4-407c-98a9-6d5991a72b53 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:32.857158 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483d131-eab4-407c-98a9-6d5991a72b53 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:32.857659 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483d131-eab4-407c-98a9-6d5991a72b53 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:32.860092 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 31/61] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:32.860756 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaacc7-7f44-4717-bef6-8fcd6b3c243b None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:32.861135 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaacc7-7f44-4717-bef6-8fcd6b3c243b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:32.861389 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaacc7-7f44-4717-bef6-8fcd6b3c243b None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:32.863900 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 31/62] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:32.865166 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e0264-cead-493f-a907-3fef6a8c20dc None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:32.865461 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e0264-cead-493f-a907-3fef6a8c20dc None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:32.865739 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e0264-cead-493f-a907-3fef6a8c20dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:32.870302 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f7c13-9feb-48cd-b91f-1d9ac4f879e4 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:32.870814 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f7c13-9feb-48cd-b91f-1d9ac4f879e4 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:32.871283 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f7c13-9feb-48cd-b91f-1d9ac4f879e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:32.897378 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-443e0264-cead-493f-a907-3fef6a8c20dc None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:32.897378 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-443e0264-cead-493f-a907-3fef6a8c20dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:32.903435 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-f09f7c13-9feb-48cd-b91f-1d9ac4f879e4 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:32.904606 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-f09f7c13-9feb-48cd-b91f-1d9ac4f879e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:32.912305 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 32/63] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:45:32.922724 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 32/64] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:45:32.941675 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e0264-cead-493f-a907-3fef6a8c20dc None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:32.952791 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f7c13-9feb-48cd-b91f-1d9ac4f879e4 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:32.954089 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e0264-cead-493f-a907-3fef6a8c20dc None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:32.963974 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f7c13-9feb-48cd-b91f-1d9ac4f879e4 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:32.965183 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d36437-1f98-4233-98e6-838f6a0ec562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:32.966114 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d36437-1f98-4233-98e6-838f6a0ec562 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:32.966394 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d36437-1f98-4233-98e6-838f6a0ec562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:32.966672 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d36437-1f98-4233-98e6-838f6a0ec562 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:32.976546 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e97e52-34ff-4e75-bf00-0e1f2250656d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:32.977381 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e97e52-34ff-4e75-bf00-0e1f2250656d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:32.977652 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e97e52-34ff-4e75-bf00-0e1f2250656d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:32.977924 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e97e52-34ff-4e75-bf00-0e1f2250656d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:32.988774 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d36437-1f98-4233-98e6-838f6a0ec562 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:32.995986 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-38d36437-1f98-4233-98e6-838f6a0ec562 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 20:45:33.004352 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 33/65] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 10 20:45:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:33.007834 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e97e52-34ff-4e75-bf00-0e1f2250656d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:33.014900 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-f2e97e52-34ff-4e75-bf00-0e1f2250656d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 20:45:33.016305 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 33/66] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:45:33.017166 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d36437-1f98-4233-98e6-838f6a0ec562 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.019476 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06954a8a-ce45-499c-8ef6-778ef221b140 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.019967 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06954a8a-ce45-499c-8ef6-778ef221b140 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.020448 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06954a8a-ce45-499c-8ef6-778ef221b140 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.022655 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 34/67] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:33.023534 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06954a8a-ce45-499c-8ef6-778ef221b140 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.030155 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d36437-1f98-4233-98e6-838f6a0ec562 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.034888 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea219c58-2478-41d0-82b1-d959c3edca35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.035787 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea219c58-2478-41d0-82b1-d959c3edca35 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.036264 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea219c58-2478-41d0-82b1-d959c3edca35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.036726 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea219c58-2478-41d0-82b1-d959c3edca35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.037938 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea219c58-2478-41d0-82b1-d959c3edca35 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:33.038435 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea219c58-2478-41d0-82b1-d959c3edca35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:33.038732 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06954a8a-ce45-499c-8ef6-778ef221b140 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.040663 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea219c58-2478-41d0-82b1-d959c3edca35 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:33.043062 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e83b07-9e82-4623-8408-f3848433e722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.043754 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e83b07-9e82-4623-8408-f3848433e722 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.044095 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e83b07-9e82-4623-8408-f3848433e722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.044368 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e83b07-9e82-4623-8408-f3848433e722 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.045120 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e83b07-9e82-4623-8408-f3848433e722 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:33.045456 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e83b07-9e82-4623-8408-f3848433e722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:33.046481 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING py.warnings [None req-c2e83b07-9e82-4623-8408-f3848433e722 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:45:33.046481 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: warnings.warn(msg) Feb 10 20:45:33.046481 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: Feb 10 20:45:33.047380 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e83b07-9e82-4623-8408-f3848433e722 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:33.051731 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 34/68] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:33.053183 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fff49-f2d3-4166-80e7-6310c76100ec None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.053715 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fff49-f2d3-4166-80e7-6310c76100ec None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.054181 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fff49-f2d3-4166-80e7-6310c76100ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.069664 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 35/69] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:33.070876 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e83b07-9e82-4623-8408-f3848433e722 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.072212 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-c62fff49-f2d3-4166-80e7-6310c76100ec None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:33.073433 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c62fff49-f2d3-4166-80e7-6310c76100ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:33.081587 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 35/70] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:33.082407 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fff49-f2d3-4166-80e7-6310c76100ec None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.082663 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e83b07-9e82-4623-8408-f3848433e722 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.095633 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61519496-3bc7-4eca-82b2-c99fdfb0457d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.096788 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61519496-3bc7-4eca-82b2-c99fdfb0457d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.097262 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61519496-3bc7-4eca-82b2-c99fdfb0457d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.098764 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61519496-3bc7-4eca-82b2-c99fdfb0457d admin admin] PATH_INFO: `/v3/users/8b22c33745c54882af2b0d91049e3e1d` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.105888 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fff49-f2d3-4166-80e7-6310c76100ec None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.111245 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f5be2-bd79-4947-95ef-40bc34d53cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.112393 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f5be2-bd79-4947-95ef-40bc34d53cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.113014 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f5be2-bd79-4947-95ef-40bc34d53cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.113672 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f5be2-bd79-4947-95ef-40bc34d53cd6 admin admin] PATH_INFO: `/v3/users/8b22c33745c54882af2b0d91049e3e1d` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.117774 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61519496-3bc7-4eca-82b2-c99fdfb0457d admin admin] RBAC: Authorizing `identity:get_user(user_id=8b22c33745c54882af2b0d91049e3e1d)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:33.120057 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61519496-3bc7-4eca-82b2-c99fdfb0457d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:33.122781 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 36/71] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/users/8b22c33745c54882af2b0d91049e3e1d => generated 275 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:33.123777 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61519496-3bc7-4eca-82b2-c99fdfb0457d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.136323 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f5be2-bd79-4947-95ef-40bc34d53cd6 admin admin] RBAC: Authorizing `identity:get_user(user_id=8b22c33745c54882af2b0d91049e3e1d)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:33.138933 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61519496-3bc7-4eca-82b2-c99fdfb0457d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.139271 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f5be2-bd79-4947-95ef-40bc34d53cd6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:33.142118 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 36/72] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/users/8b22c33745c54882af2b0d91049e3e1d => generated 275 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:33.143046 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f5be2-bd79-4947-95ef-40bc34d53cd6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.148034 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff85478-83eb-4d97-934c-41a165c4ece7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.149120 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff85478-83eb-4d97-934c-41a165c4ece7 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.149496 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff85478-83eb-4d97-934c-41a165c4ece7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.149837 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff85478-83eb-4d97-934c-41a165c4ece7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.154879 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f5be2-bd79-4947-95ef-40bc34d53cd6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.160514 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a9b44-9d9a-4fdd-a727-f4d5350a1df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.161656 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a9b44-9d9a-4fdd-a727-f4d5350a1df8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.162080 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff85478-83eb-4d97-934c-41a165c4ece7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:33.162322 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a9b44-9d9a-4fdd-a727-f4d5350a1df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.162757 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a9b44-9d9a-4fdd-a727-f4d5350a1df8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.169912 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-eff85478-83eb-4d97-934c-41a165c4ece7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:45:33.171414 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a9b44-9d9a-4fdd-a727-f4d5350a1df8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:33.173422 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a9b44-9d9a-4fdd-a727-f4d5350a1df8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:33.176319 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 37/73] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:33.177243 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff85478-83eb-4d97-934c-41a165c4ece7 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.183712 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 37/74] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:45:33.184797 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a9b44-9d9a-4fdd-a727-f4d5350a1df8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.194388 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff85478-83eb-4d97-934c-41a165c4ece7 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.196104 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a9b44-9d9a-4fdd-a727-f4d5350a1df8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.199143 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df649c6d-7386-4b04-afc3-8c2a94eb34af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.199890 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df649c6d-7386-4b04-afc3-8c2a94eb34af admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.200235 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df649c6d-7386-4b04-afc3-8c2a94eb34af admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.200575 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df649c6d-7386-4b04-afc3-8c2a94eb34af admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.202159 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a4cea-c9e4-436d-961f-096ef6ad73c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.202996 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a4cea-c9e4-436d-961f-096ef6ad73c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.203447 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a4cea-c9e4-436d-961f-096ef6ad73c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.203906 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a4cea-c9e4-436d-961f-096ef6ad73c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.204869 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a4cea-c9e4-436d-961f-096ef6ad73c2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:33.205662 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a4cea-c9e4-436d-961f-096ef6ad73c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:33.210312 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a4cea-c9e4-436d-961f-096ef6ad73c2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:33.210489 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df649c6d-7386-4b04-afc3-8c2a94eb34af admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:33.212239 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df649c6d-7386-4b04-afc3-8c2a94eb34af admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:33.221272 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 38/75] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:33.222373 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a4cea-c9e4-436d-961f-096ef6ad73c2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.232762 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a4cea-c9e4-436d-961f-096ef6ad73c2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.233374 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 38/76] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:45:33.234173 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df649c6d-7386-4b04-afc3-8c2a94eb34af admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.244676 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1f930-0b19-454d-9a3b-89ff0b5c86bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.245674 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1f930-0b19-454d-9a3b-89ff0b5c86bd admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.246019 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1f930-0b19-454d-9a3b-89ff0b5c86bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.246394 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1f930-0b19-454d-9a3b-89ff0b5c86bd admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.248051 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1f930-0b19-454d-9a3b-89ff0b5c86bd admin admin] RBAC: Authorizing `identity:get_project(project_id=882013caabf941cd8a950baeb731deb7)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:33.249849 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df649c6d-7386-4b04-afc3-8c2a94eb34af admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.250546 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1f930-0b19-454d-9a3b-89ff0b5c86bd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:33.252723 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 39/77] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/projects/882013caabf941cd8a950baeb731deb7 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:33.254322 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1f930-0b19-454d-9a3b-89ff0b5c86bd admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.262806 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7748535-31c5-450e-bd1d-bdd839a853de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.263791 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7748535-31c5-450e-bd1d-bdd839a853de admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.264138 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7748535-31c5-450e-bd1d-bdd839a853de admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.264678 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7748535-31c5-450e-bd1d-bdd839a853de admin admin] PATH_INFO: `/v3/users/ca0523bae3774fd3bb058d660150718b` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.265928 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7748535-31c5-450e-bd1d-bdd839a853de admin admin] RBAC: Authorizing `identity:get_user(user_id=ca0523bae3774fd3bb058d660150718b)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:33.267916 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7748535-31c5-450e-bd1d-bdd839a853de admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:33.269979 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 39/78] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/users/ca0523bae3774fd3bb058d660150718b => generated 247 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:33.271414 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1f930-0b19-454d-9a3b-89ff0b5c86bd admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.272956 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7748535-31c5-450e-bd1d-bdd839a853de admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.280895 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd6a33-0c68-4c27-97df-63045b7da9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.281847 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd6a33-0c68-4c27-97df-63045b7da9ae admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.282133 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd6a33-0c68-4c27-97df-63045b7da9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.282409 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd6a33-0c68-4c27-97df-63045b7da9ae admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.283809 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd6a33-0c68-4c27-97df-63045b7da9ae admin admin] RBAC: Authorizing `identity:get_project(project_id=882013caabf941cd8a950baeb731deb7)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:33.286001 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd6a33-0c68-4c27-97df-63045b7da9ae admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:33.287766 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7748535-31c5-450e-bd1d-bdd839a853de admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.288817 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 40/79] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/projects/882013caabf941cd8a950baeb731deb7 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:33.289951 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd6a33-0c68-4c27-97df-63045b7da9ae admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.300886 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fc4aa-cd64-4e3f-828f-788db6cde254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.301636 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fc4aa-cd64-4e3f-828f-788db6cde254 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.301984 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fc4aa-cd64-4e3f-828f-788db6cde254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.302182 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fc4aa-cd64-4e3f-828f-788db6cde254 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.303046 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fc4aa-cd64-4e3f-828f-788db6cde254 admin admin] RBAC: Adding query filter params (role.id=fbf072f915fc46ee9a80c656e2bb2b30, scope.project.id=882013caabf941cd8a950baeb731deb7, user.id=8b22c33745c54882af2b0d91049e3e1d) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:33.303357 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fc4aa-cd64-4e3f-828f-788db6cde254 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:33.305173 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd6a33-0c68-4c27-97df-63045b7da9ae admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.305314 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fc4aa-cd64-4e3f-828f-788db6cde254 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:33.313250 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 40/80] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/role_assignments?user.id=8b22c33745c54882af2b0d91049e3e1d&scope.project.id=882013caabf941cd8a950baeb731deb7&role.id=fbf072f915fc46ee9a80c656e2bb2b30 => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:33.313957 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fc4aa-cd64-4e3f-828f-788db6cde254 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.318097 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7736c7-4830-4618-9224-def735c2e65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.319036 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7736c7-4830-4618-9224-def735c2e65e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.319544 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7736c7-4830-4618-9224-def735c2e65e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.320009 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7736c7-4830-4618-9224-def735c2e65e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.329789 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7736c7-4830-4618-9224-def735c2e65e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:33.332655 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7736c7-4830-4618-9224-def735c2e65e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:33.339989 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fc4aa-cd64-4e3f-828f-788db6cde254 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.344471 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 41/81] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:45:33.351306 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7736c7-4830-4618-9224-def735c2e65e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.359568 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f4905-2b2d-41ea-a32c-992464b17d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.360244 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f4905-2b2d-41ea-a32c-992464b17d97 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.360525 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f4905-2b2d-41ea-a32c-992464b17d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.360850 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f4905-2b2d-41ea-a32c-992464b17d97 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.361814 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f4905-2b2d-41ea-a32c-992464b17d97 admin admin] RBAC: Adding query filter params (role.id=80e0463ac1aa4ef2b3739b580669f095, scope.project.id=882013caabf941cd8a950baeb731deb7, user.id=8b22c33745c54882af2b0d91049e3e1d) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:33.362070 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f4905-2b2d-41ea-a32c-992464b17d97 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:33.363259 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7736c7-4830-4618-9224-def735c2e65e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.363951 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f4905-2b2d-41ea-a32c-992464b17d97 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:33.375355 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 41/82] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/role_assignments?user.id=8b22c33745c54882af2b0d91049e3e1d&scope.project.id=882013caabf941cd8a950baeb731deb7&role.id=80e0463ac1aa4ef2b3739b580669f095 => generated 259 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:33.376921 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffe798-10a3-4e87-9326-5143c31f592f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.378052 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffe798-10a3-4e87-9326-5143c31f592f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.378531 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffe798-10a3-4e87-9326-5143c31f592f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.379372 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffe798-10a3-4e87-9326-5143c31f592f admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.380932 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffe798-10a3-4e87-9326-5143c31f592f admin admin] RBAC: Authorizing `identity:get_project(project_id=882013caabf941cd8a950baeb731deb7)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:33.383346 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffe798-10a3-4e87-9326-5143c31f592f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:33.385466 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 42/83] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/projects/882013caabf941cd8a950baeb731deb7 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:33.394597 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f4905-2b2d-41ea-a32c-992464b17d97 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.411221 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f4905-2b2d-41ea-a32c-992464b17d97 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.426315 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48896ae9-709e-4b9b-8762-82ad97271b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.426997 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48896ae9-709e-4b9b-8762-82ad97271b66 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.427277 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48896ae9-709e-4b9b-8762-82ad97271b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.427550 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48896ae9-709e-4b9b-8762-82ad97271b66 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.428412 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48896ae9-709e-4b9b-8762-82ad97271b66 admin admin] RBAC: Adding query filter params (role.id=e06447c1c62d465c9f9c58168be71ed8, scope.project.id=882013caabf941cd8a950baeb731deb7, user.id=ca0523bae3774fd3bb058d660150718b) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:33.428719 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48896ae9-709e-4b9b-8762-82ad97271b66 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:33.430714 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48896ae9-709e-4b9b-8762-82ad97271b66 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:33.437234 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 42/84] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/role_assignments?user.id=ca0523bae3774fd3bb058d660150718b&scope.project.id=882013caabf941cd8a950baeb731deb7&role.id=e06447c1c62d465c9f9c58168be71ed8 => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:33.576043 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8c0e9-b1d1-45f3-b0b6-a2f48322d370 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.576661 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8c0e9-b1d1-45f3-b0b6-a2f48322d370 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.577128 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8c0e9-b1d1-45f3-b0b6-a2f48322d370 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.579200 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 43/85] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:33.585855 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d10d7-a52c-45b1-a414-a8d4493707ce None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.586140 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d10d7-a52c-45b1-a414-a8d4493707ce None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.586585 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d10d7-a52c-45b1-a414-a8d4493707ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.589749 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c162c7-af79-4383-9d47-9b33e4f93ef5 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.590038 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c162c7-af79-4383-9d47-9b33e4f93ef5 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.590320 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c162c7-af79-4383-9d47-9b33e4f93ef5 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.592307 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 44/86] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:45:33.599441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee20c43-1734-4d2f-a551-ddd3841b6603 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.600344 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee20c43-1734-4d2f-a551-ddd3841b6603 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.602008 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee20c43-1734-4d2f-a551-ddd3841b6603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.610306 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-909d10d7-a52c-45b1-a414-a8d4493707ce None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:33.611993 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-909d10d7-a52c-45b1-a414-a8d4493707ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:33.627913 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 43/87] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:45:33.637964 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-9ee20c43-1734-4d2f-a551-ddd3841b6603 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:33.639213 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9ee20c43-1734-4d2f-a551-ddd3841b6603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:33.653432 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d10d7-a52c-45b1-a414-a8d4493707ce None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.661858 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 45/88] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:33.668155 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d10d7-a52c-45b1-a414-a8d4493707ce None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.673080 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0567a5-ec6d-420a-bfb4-7b7f54cef1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.674181 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0567a5-ec6d-420a-bfb4-7b7f54cef1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.674656 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0567a5-ec6d-420a-bfb4-7b7f54cef1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.675058 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0567a5-ec6d-420a-bfb4-7b7f54cef1b1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.686936 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0567a5-ec6d-420a-bfb4-7b7f54cef1b1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:33.689517 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee20c43-1734-4d2f-a551-ddd3841b6603 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.694377 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-8a0567a5-ec6d-420a-bfb4-7b7f54cef1b1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 20:45:33.696231 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 44/89] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:45:33.699613 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee20c43-1734-4d2f-a551-ddd3841b6603 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.701970 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0567a5-ec6d-420a-bfb4-7b7f54cef1b1 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.704857 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6de2b7-798a-4f00-bd05-6bfd119023a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.705927 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6de2b7-798a-4f00-bd05-6bfd119023a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.706404 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6de2b7-798a-4f00-bd05-6bfd119023a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.706861 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6de2b7-798a-4f00-bd05-6bfd119023a2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.708292 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6de2b7-798a-4f00-bd05-6bfd119023a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:33.710249 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6de2b7-798a-4f00-bd05-6bfd119023a2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:33.711822 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0567a5-ec6d-420a-bfb4-7b7f54cef1b1 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.712630 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 46/90] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:33.718273 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6de2b7-798a-4f00-bd05-6bfd119023a2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.720633 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7d2ad-04b2-4ba7-83e3-5ab3b01b934b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.721314 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7d2ad-04b2-4ba7-83e3-5ab3b01b934b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.721623 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7d2ad-04b2-4ba7-83e3-5ab3b01b934b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.721897 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7d2ad-04b2-4ba7-83e3-5ab3b01b934b admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.722673 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7d2ad-04b2-4ba7-83e3-5ab3b01b934b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:33.722976 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7d2ad-04b2-4ba7-83e3-5ab3b01b934b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:33.724870 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7d2ad-04b2-4ba7-83e3-5ab3b01b934b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:33.730352 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6de2b7-798a-4f00-bd05-6bfd119023a2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.735812 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d48ad-c084-4e16-9d5f-8d6a3c6b6832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.735970 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 45/91] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:33.736829 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d48ad-c084-4e16-9d5f-8d6a3c6b6832 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.737330 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d48ad-c084-4e16-9d5f-8d6a3c6b6832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.737827 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d48ad-c084-4e16-9d5f-8d6a3c6b6832 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.738735 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d48ad-c084-4e16-9d5f-8d6a3c6b6832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:33.739946 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-8a0d48ad-c084-4e16-9d5f-8d6a3c6b6832 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:45:33.739946 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Feb 10 20:45:33.739946 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: Feb 10 20:45:33.741420 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7d2ad-04b2-4ba7-83e3-5ab3b01b934b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.741757 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d48ad-c084-4e16-9d5f-8d6a3c6b6832 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:33.752313 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7d2ad-04b2-4ba7-83e3-5ab3b01b934b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.758039 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639f1cf-f0c6-4ff0-ac76-f71762718a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.758972 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639f1cf-f0c6-4ff0-ac76-f71762718a37 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.759265 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639f1cf-f0c6-4ff0-ac76-f71762718a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.760574 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639f1cf-f0c6-4ff0-ac76-f71762718a37 admin admin] PATH_INFO: `/v3/users/8b22c33745c54882af2b0d91049e3e1d` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.762111 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639f1cf-f0c6-4ff0-ac76-f71762718a37 admin admin] RBAC: Authorizing `identity:get_user(user_id=8b22c33745c54882af2b0d91049e3e1d)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:33.764441 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639f1cf-f0c6-4ff0-ac76-f71762718a37 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:33.766420 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 46/92] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/users/8b22c33745c54882af2b0d91049e3e1d => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:33.771757 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639f1cf-f0c6-4ff0-ac76-f71762718a37 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.775366 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 47/93] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 10 20:45:33 2022] POST /identity/v3/users => generated 289 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:45:33.787335 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639f1cf-f0c6-4ff0-ac76-f71762718a37 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.792551 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b104252-d15f-48c6-9819-f9cf386bacf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.793744 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b104252-d15f-48c6-9819-f9cf386bacf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.794279 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b104252-d15f-48c6-9819-f9cf386bacf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.794756 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b104252-d15f-48c6-9819-f9cf386bacf1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.804494 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b104252-d15f-48c6-9819-f9cf386bacf1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:33.806766 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b104252-d15f-48c6-9819-f9cf386bacf1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:33.817368 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 47/94] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:45:33.826654 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d48ad-c084-4e16-9d5f-8d6a3c6b6832 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.837448 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d48ad-c084-4e16-9d5f-8d6a3c6b6832 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.845699 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692a00e-5ec2-47ac-a21b-8e432baab220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.846872 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692a00e-5ec2-47ac-a21b-8e432baab220 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.847315 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692a00e-5ec2-47ac-a21b-8e432baab220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.847811 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692a00e-5ec2-47ac-a21b-8e432baab220 admin admin] PATH_INFO: `/v3/projects/4adc69fb80c54d1f9d6521c58e787beb` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.850028 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692a00e-5ec2-47ac-a21b-8e432baab220 admin admin] RBAC: Authorizing `identity:get_project(project_id=4adc69fb80c54d1f9d6521c58e787beb)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:33.852333 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692a00e-5ec2-47ac-a21b-8e432baab220 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:33.854438 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 48/95] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/projects/4adc69fb80c54d1f9d6521c58e787beb => generated 312 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:33.860693 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b104252-d15f-48c6-9819-f9cf386bacf1 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:33.870452 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b104252-d15f-48c6-9819-f9cf386bacf1 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:33.878762 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46330769-04fd-4014-9932-5f3440327dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:33.880069 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46330769-04fd-4014-9932-5f3440327dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:33.880510 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46330769-04fd-4014-9932-5f3440327dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:33.880935 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46330769-04fd-4014-9932-5f3440327dc8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:33.882011 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46330769-04fd-4014-9932-5f3440327dc8 admin admin] RBAC: Adding query filter params (role.id=80e0463ac1aa4ef2b3739b580669f095, scope.project.id=4adc69fb80c54d1f9d6521c58e787beb, user.id=8b22c33745c54882af2b0d91049e3e1d) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:33.882484 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46330769-04fd-4014-9932-5f3440327dc8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:33.884594 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46330769-04fd-4014-9932-5f3440327dc8 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:33.891046 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 48/96] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:45:33 2022] GET /identity/v3/role_assignments?user.id=8b22c33745c54882af2b0d91049e3e1d&scope.project.id=4adc69fb80c54d1f9d6521c58e787beb&role.id=80e0463ac1aa4ef2b3739b580669f095 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:36.014343 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a941a-e8f3-4e1c-aca6-7a2406ff3711 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:36.015354 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a941a-e8f3-4e1c-aca6-7a2406ff3711 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:36.015925 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a941a-e8f3-4e1c-aca6-7a2406ff3711 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:36.017951 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 49/97] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:36.023446 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1e2d0-4bd8-4b87-be8a-895b88f2b3d5 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:36.024234 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1e2d0-4bd8-4b87-be8a-895b88f2b3d5 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:36.024703 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1e2d0-4bd8-4b87-be8a-895b88f2b3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:36.046891 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-62d1e2d0-4bd8-4b87-be8a-895b88f2b3d5 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:36.048392 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-62d1e2d0-4bd8-4b87-be8a-895b88f2b3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:36.059621 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 49/98] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:36.093984 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a941a-e8f3-4e1c-aca6-7a2406ff3711 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:36.110859 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a941a-e8f3-4e1c-aca6-7a2406ff3711 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:36.115670 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafbeef-463f-4fde-b307-856106bf5333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:36.116711 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafbeef-463f-4fde-b307-856106bf5333 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:36.117177 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafbeef-463f-4fde-b307-856106bf5333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:36.117650 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafbeef-463f-4fde-b307-856106bf5333 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:36.133031 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae6259-7cb4-4882-bce0-a986c1ffc894 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:36.133699 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae6259-7cb4-4882-bce0-a986c1ffc894 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:36.134159 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae6259-7cb4-4882-bce0-a986c1ffc894 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:36.136139 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 50/99] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:45:36.136773 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aafbeef-463f-4fde-b307-856106bf5333 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:36.144123 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-0aafbeef-463f-4fde-b307-856106bf5333 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 20:45:36.145524 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 50/100] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 10 20:45:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:36.151098 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae6259-7cb4-4882-bce0-a986c1ffc894 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:36.155595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bc3a7-4da0-4011-9313-a06797ecd8c4 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:36.155897 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bc3a7-4da0-4011-9313-a06797ecd8c4 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:36.156175 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bc3a7-4da0-4011-9313-a06797ecd8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:36.174851 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-1a6bc3a7-4da0-4011-9313-a06797ecd8c4 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:36.175311 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae6259-7cb4-4882-bce0-a986c1ffc894 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:36.176034 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1a6bc3a7-4da0-4011-9313-a06797ecd8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:36.191511 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 51/101] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:45:36.193799 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9296a-b68c-4c10-92ef-35e4bbe0bd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:36.194716 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9296a-b68c-4c10-92ef-35e4bbe0bd77 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:36.195191 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9296a-b68c-4c10-92ef-35e4bbe0bd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:36.195647 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9296a-b68c-4c10-92ef-35e4bbe0bd77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:36.196593 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9296a-b68c-4c10-92ef-35e4bbe0bd77 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:36.197105 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9296a-b68c-4c10-92ef-35e4bbe0bd77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:36.198944 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9296a-b68c-4c10-92ef-35e4bbe0bd77 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:36.212940 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 51/102] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:45:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:36.218798 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bc3a7-4da0-4011-9313-a06797ecd8c4 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:36.235498 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bc3a7-4da0-4011-9313-a06797ecd8c4 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:36.244337 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecda767-c33b-4f0e-af7d-1ecb696d9c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:36.245231 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecda767-c33b-4f0e-af7d-1ecb696d9c91 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:36.245537 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecda767-c33b-4f0e-af7d-1ecb696d9c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:36.245812 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecda767-c33b-4f0e-af7d-1ecb696d9c91 admin admin] PATH_INFO: `/v3/users/8b22c33745c54882af2b0d91049e3e1d` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:36.247154 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecda767-c33b-4f0e-af7d-1ecb696d9c91 admin admin] RBAC: Authorizing `identity:get_user(user_id=8b22c33745c54882af2b0d91049e3e1d)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:36.249456 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecda767-c33b-4f0e-af7d-1ecb696d9c91 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:36.251292 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 52/103] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:36 2022] GET /identity/v3/users/8b22c33745c54882af2b0d91049e3e1d => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:36.257008 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecda767-c33b-4f0e-af7d-1ecb696d9c91 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:36.257847 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7e2a1-f3bf-4acc-abe9-fd0ff1a2ea5b None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:36.258328 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7e2a1-f3bf-4acc-abe9-fd0ff1a2ea5b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:36.258784 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7e2a1-f3bf-4acc-abe9-fd0ff1a2ea5b None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:36.261033 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 52/104] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:36.266335 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7e2a1-f3bf-4acc-abe9-fd0ff1a2ea5b None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:36.268155 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecda767-c33b-4f0e-af7d-1ecb696d9c91 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:36.272780 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ab676-6049-4c8f-8240-d38ffb3fc700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:36.273895 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ab676-6049-4c8f-8240-d38ffb3fc700 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:36.274208 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ab676-6049-4c8f-8240-d38ffb3fc700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:36.274485 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ab676-6049-4c8f-8240-d38ffb3fc700 admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:36.275884 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ab676-6049-4c8f-8240-d38ffb3fc700 admin admin] RBAC: Authorizing `identity:get_project(project_id=882013caabf941cd8a950baeb731deb7)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:36.277974 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ab676-6049-4c8f-8240-d38ffb3fc700 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:36.279973 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 53/105] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:36 2022] GET /identity/v3/projects/882013caabf941cd8a950baeb731deb7 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:36.281182 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d740bf-f53e-4770-b2d3-383370f2063f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:36.281286 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d740bf-f53e-4770-b2d3-383370f2063f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:36.281570 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d740bf-f53e-4770-b2d3-383370f2063f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:36.298037 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7e2a1-f3bf-4acc-abe9-fd0ff1a2ea5b None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:36.304681 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-b2d740bf-f53e-4770-b2d3-383370f2063f None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:36.305888 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b2d740bf-f53e-4770-b2d3-383370f2063f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:36.309903 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd589f07-2406-44ba-b1be-081a86a66050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:36.310756 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd589f07-2406-44ba-b1be-081a86a66050 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:36.311041 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd589f07-2406-44ba-b1be-081a86a66050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:36.311311 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd589f07-2406-44ba-b1be-081a86a66050 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:36.322260 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 54/106] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:36.323063 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d740bf-f53e-4770-b2d3-383370f2063f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:36.335472 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd589f07-2406-44ba-b1be-081a86a66050 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:36.341310 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d740bf-f53e-4770-b2d3-383370f2063f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:36.345740 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-cd589f07-2406-44ba-b1be-081a86a66050 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:45:36.346982 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 53/107] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:45:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:36.353210 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd589f07-2406-44ba-b1be-081a86a66050 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:36.360507 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3923086-cd07-4ae2-89a4-a4b5efba9290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:36.361439 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3923086-cd07-4ae2-89a4-a4b5efba9290 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:36.361724 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3923086-cd07-4ae2-89a4-a4b5efba9290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:36.361991 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3923086-cd07-4ae2-89a4-a4b5efba9290 admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7/users/8b22c33745c54882af2b0d91049e3e1d/roles/fbf072f915fc46ee9a80c656e2bb2b30` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:36.364490 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3923086-cd07-4ae2-89a4-a4b5efba9290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=882013caabf941cd8a950baeb731deb7, user_id=8b22c33745c54882af2b0d91049e3e1d, role_id=fbf072f915fc46ee9a80c656e2bb2b30)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:36.367252 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3923086-cd07-4ae2-89a4-a4b5efba9290 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:36.376703 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd589f07-2406-44ba-b1be-081a86a66050 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:36.382729 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ef27f-bd4f-4646-8863-bfe0bf4627e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:36.383430 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ef27f-bd4f-4646-8863-bfe0bf4627e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:36.383722 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ef27f-bd4f-4646-8863-bfe0bf4627e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:36.384025 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ef27f-bd4f-4646-8863-bfe0bf4627e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:36.384791 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ef27f-bd4f-4646-8863-bfe0bf4627e6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:36.385102 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ef27f-bd4f-4646-8863-bfe0bf4627e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:36.386840 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ef27f-bd4f-4646-8863-bfe0bf4627e6 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:36.395027 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 55/108] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:45:36 2022] PUT /identity/v3/projects/882013caabf941cd8a950baeb731deb7/users/8b22c33745c54882af2b0d91049e3e1d/roles/fbf072f915fc46ee9a80c656e2bb2b30 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:45:36.395889 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3923086-cd07-4ae2-89a4-a4b5efba9290 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:36.418044 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 54/109] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:36.423826 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ef27f-bd4f-4646-8863-bfe0bf4627e6 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:36.449343 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ef27f-bd4f-4646-8863-bfe0bf4627e6 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:36.503502 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3923086-cd07-4ae2-89a4-a4b5efba9290 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:36.514576 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b542e18-7cc8-498a-b986-84ae2a4155f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:36.515422 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b542e18-7cc8-498a-b986-84ae2a4155f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:36.515704 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b542e18-7cc8-498a-b986-84ae2a4155f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:36.515973 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b542e18-7cc8-498a-b986-84ae2a4155f6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:36.533457 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b542e18-7cc8-498a-b986-84ae2a4155f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:36.546040 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-2b542e18-7cc8-498a-b986-84ae2a4155f6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 20:45:36.547536 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 56/110] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:36.554434 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b542e18-7cc8-498a-b986-84ae2a4155f6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:36.568258 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94be56-87a4-4d5f-8316-2b172047e940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:36.569462 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94be56-87a4-4d5f-8316-2b172047e940 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:36.569895 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94be56-87a4-4d5f-8316-2b172047e940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:36.570354 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94be56-87a4-4d5f-8316-2b172047e940 admin admin] PATH_INFO: `/v3/users/ca0523bae3774fd3bb058d660150718b` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:36.570994 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b542e18-7cc8-498a-b986-84ae2a4155f6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:36.571970 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94be56-87a4-4d5f-8316-2b172047e940 admin admin] RBAC: Authorizing `identity:get_user(user_id=ca0523bae3774fd3bb058d660150718b)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:36.573960 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94be56-87a4-4d5f-8316-2b172047e940 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:36.576139 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 55/111] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:36 2022] GET /identity/v3/users/ca0523bae3774fd3bb058d660150718b => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:36.582489 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94be56-87a4-4d5f-8316-2b172047e940 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:36.586691 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5569e3a-1b4a-4924-84e9-2675785ba322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:36.587381 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5569e3a-1b4a-4924-84e9-2675785ba322 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:36.587652 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5569e3a-1b4a-4924-84e9-2675785ba322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:36.587919 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5569e3a-1b4a-4924-84e9-2675785ba322 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:36.588690 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5569e3a-1b4a-4924-84e9-2675785ba322 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:36.588990 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5569e3a-1b4a-4924-84e9-2675785ba322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:36.590644 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5569e3a-1b4a-4924-84e9-2675785ba322 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:36.600193 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94be56-87a4-4d5f-8316-2b172047e940 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:36.605278 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 57/112] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:45:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:36.609978 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6061c-6393-4949-a374-7a3e2f2068e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:36.611081 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6061c-6393-4949-a374-7a3e2f2068e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:36.611557 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6061c-6393-4949-a374-7a3e2f2068e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:36.611968 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6061c-6393-4949-a374-7a3e2f2068e5 admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:36.613388 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6061c-6393-4949-a374-7a3e2f2068e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=882013caabf941cd8a950baeb731deb7)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:36.615693 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6061c-6393-4949-a374-7a3e2f2068e5 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:36.620759 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5569e3a-1b4a-4924-84e9-2675785ba322 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:36.623146 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 56/113] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:36 2022] GET /identity/v3/projects/882013caabf941cd8a950baeb731deb7 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:36.628541 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6061c-6393-4949-a374-7a3e2f2068e5 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:36.638589 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5569e3a-1b4a-4924-84e9-2675785ba322 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:36.642945 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6061c-6393-4949-a374-7a3e2f2068e5 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:36.647321 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee976c-9ab3-454a-8a35-188d2710fcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:36.648162 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fb1e8-2b1d-41f0-9401-ba94718e9fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:36.648276 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee976c-9ab3-454a-8a35-188d2710fcc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:36.648478 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee976c-9ab3-454a-8a35-188d2710fcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:36.648722 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee976c-9ab3-454a-8a35-188d2710fcc2 admin admin] PATH_INFO: `/v3/users/8b22c33745c54882af2b0d91049e3e1d` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:36.649904 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fb1e8-2b1d-41f0-9401-ba94718e9fba admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:36.650069 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee976c-9ab3-454a-8a35-188d2710fcc2 admin admin] RBAC: Authorizing `identity:get_user(user_id=8b22c33745c54882af2b0d91049e3e1d)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:36.650555 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fb1e8-2b1d-41f0-9401-ba94718e9fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:36.651074 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fb1e8-2b1d-41f0-9401-ba94718e9fba admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7/users/ca0523bae3774fd3bb058d660150718b/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:36.652177 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee976c-9ab3-454a-8a35-188d2710fcc2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:36.653703 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fb1e8-2b1d-41f0-9401-ba94718e9fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=882013caabf941cd8a950baeb731deb7, user_id=ca0523bae3774fd3bb058d660150718b, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:36.653894 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 58/114] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:36 2022] GET /identity/v3/users/8b22c33745c54882af2b0d91049e3e1d => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:36.655212 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING py.warnings [None req-514fb1e8-2b1d-41f0-9401-ba94718e9fba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:45:36.655212 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: warnings.warn(msg) Feb 10 20:45:36.655212 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: Feb 10 20:45:36.661967 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fb1e8-2b1d-41f0-9401-ba94718e9fba admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:36.666843 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee976c-9ab3-454a-8a35-188d2710fcc2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:36.682938 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 57/115] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:45:36 2022] PUT /identity/v3/projects/882013caabf941cd8a950baeb731deb7/users/ca0523bae3774fd3bb058d660150718b/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:45:36.684984 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee976c-9ab3-454a-8a35-188d2710fcc2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:36.776130 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17534a92-c2b1-4b1d-94ce-3adf2276dc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:36.777017 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17534a92-c2b1-4b1d-94ce-3adf2276dc00 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:36.777301 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17534a92-c2b1-4b1d-94ce-3adf2276dc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:36.777604 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17534a92-c2b1-4b1d-94ce-3adf2276dc00 admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:36.782341 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17534a92-c2b1-4b1d-94ce-3adf2276dc00 admin admin] RBAC: Authorizing `identity:get_project(project_id=882013caabf941cd8a950baeb731deb7)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:36.784549 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17534a92-c2b1-4b1d-94ce-3adf2276dc00 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:36.786591 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 59/116] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:36 2022] GET /identity/v3/projects/882013caabf941cd8a950baeb731deb7 => generated 298 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:36.793240 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fb1e8-2b1d-41f0-9401-ba94718e9fba admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:36.807230 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fb1e8-2b1d-41f0-9401-ba94718e9fba admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:36.818376 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21370647-0b58-493d-88ee-32e4115806e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:36.819974 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21370647-0b58-493d-88ee-32e4115806e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:36.820503 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21370647-0b58-493d-88ee-32e4115806e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:36.820973 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21370647-0b58-493d-88ee-32e4115806e0 admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7/users/8b22c33745c54882af2b0d91049e3e1d/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:36.823549 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21370647-0b58-493d-88ee-32e4115806e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=882013caabf941cd8a950baeb731deb7, user_id=8b22c33745c54882af2b0d91049e3e1d, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:36.827015 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21370647-0b58-493d-88ee-32e4115806e0 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:36.862718 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 58/117] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:45:36 2022] PUT /identity/v3/projects/882013caabf941cd8a950baeb731deb7/users/8b22c33745c54882af2b0d91049e3e1d/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:45:37.149948 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee344d1-6596-4c41-8504-2d5d10968872 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:37.150434 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee344d1-6596-4c41-8504-2d5d10968872 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:37.150434 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee344d1-6596-4c41-8504-2d5d10968872 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:37.152359 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 60/118] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:37.163761 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6560af-dfe1-48fe-8b05-f76c0bcb2a56 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:37.163761 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6560af-dfe1-48fe-8b05-f76c0bcb2a56 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:37.163761 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6560af-dfe1-48fe-8b05-f76c0bcb2a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:37.185565 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-ac6560af-dfe1-48fe-8b05-f76c0bcb2a56 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:37.186755 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ac6560af-dfe1-48fe-8b05-f76c0bcb2a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:37.255372 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 59/119] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:37.289950 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee344d1-6596-4c41-8504-2d5d10968872 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:37.307405 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee344d1-6596-4c41-8504-2d5d10968872 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:37.314020 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0b2b6-eaf6-4da5-afe0-8630d8f3a569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:37.314891 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0b2b6-eaf6-4da5-afe0-8630d8f3a569 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:37.315173 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0b2b6-eaf6-4da5-afe0-8630d8f3a569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:37.315442 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0b2b6-eaf6-4da5-afe0-8630d8f3a569 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:37.331786 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0b2b6-eaf6-4da5-afe0-8630d8f3a569 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:37.349680 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-24b0b2b6-eaf6-4da5-afe0-8630d8f3a569 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 20:45:37.349680 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 61/120] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:37.355509 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6560af-dfe1-48fe-8b05-f76c0bcb2a56 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:37.370501 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6560af-dfe1-48fe-8b05-f76c0bcb2a56 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:37.382532 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f8fde-fc0c-482e-99ae-1248b2165381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:37.383174 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f8fde-fc0c-482e-99ae-1248b2165381 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:37.383453 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f8fde-fc0c-482e-99ae-1248b2165381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:37.383722 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f8fde-fc0c-482e-99ae-1248b2165381 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:37.384488 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f8fde-fc0c-482e-99ae-1248b2165381 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:37.384786 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f8fde-fc0c-482e-99ae-1248b2165381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:37.386422 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f8fde-fc0c-482e-99ae-1248b2165381 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:37.405147 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 60/121] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:45:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:37.410750 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0b2b6-eaf6-4da5-afe0-8630d8f3a569 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:37.420900 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0b2b6-eaf6-4da5-afe0-8630d8f3a569 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:37.435038 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d2a18-56d7-4d85-887d-c136c78ea63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:37.435971 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d2a18-56d7-4d85-887d-c136c78ea63c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:37.436259 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d2a18-56d7-4d85-887d-c136c78ea63c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:37.436529 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d2a18-56d7-4d85-887d-c136c78ea63c admin admin] PATH_INFO: `/v3/users/8b22c33745c54882af2b0d91049e3e1d` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:37.437868 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d2a18-56d7-4d85-887d-c136c78ea63c admin admin] RBAC: Authorizing `identity:get_user(user_id=8b22c33745c54882af2b0d91049e3e1d)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:37.440231 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d2a18-56d7-4d85-887d-c136c78ea63c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:37.441952 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 62/122] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:37 2022] GET /identity/v3/users/8b22c33745c54882af2b0d91049e3e1d => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:37.447381 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f8fde-fc0c-482e-99ae-1248b2165381 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:37.462333 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f8fde-fc0c-482e-99ae-1248b2165381 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:37.473953 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb334f-7354-4276-9592-572c6411a147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:37.474826 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb334f-7354-4276-9592-572c6411a147 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:37.475105 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb334f-7354-4276-9592-572c6411a147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:37.475383 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb334f-7354-4276-9592-572c6411a147 admin admin] PATH_INFO: `/v3/projects/4adc69fb80c54d1f9d6521c58e787beb` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:37.476592 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb334f-7354-4276-9592-572c6411a147 admin admin] RBAC: Authorizing `identity:get_project(project_id=4adc69fb80c54d1f9d6521c58e787beb)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:37.478689 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb334f-7354-4276-9592-572c6411a147 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:37.480363 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 61/123] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:37 2022] GET /identity/v3/projects/4adc69fb80c54d1f9d6521c58e787beb => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:37.486043 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d2a18-56d7-4d85-887d-c136c78ea63c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:37.497007 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d2a18-56d7-4d85-887d-c136c78ea63c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:37.506119 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5301f-aa26-4113-aab3-28a672bf7ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:37.507224 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5301f-aa26-4113-aab3-28a672bf7ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:37.507679 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5301f-aa26-4113-aab3-28a672bf7ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:37.508091 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5301f-aa26-4113-aab3-28a672bf7ab2 admin admin] PATH_INFO: `/v3/projects/4adc69fb80c54d1f9d6521c58e787beb/users/8b22c33745c54882af2b0d91049e3e1d/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:37.510327 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5301f-aa26-4113-aab3-28a672bf7ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4adc69fb80c54d1f9d6521c58e787beb, user_id=8b22c33745c54882af2b0d91049e3e1d, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:37.513322 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5301f-aa26-4113-aab3-28a672bf7ab2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:37.545661 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 63/124] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:45:37 2022] PUT /identity/v3/projects/4adc69fb80c54d1f9d6521c58e787beb/users/8b22c33745c54882af2b0d91049e3e1d/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:45:37.731603 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101176b-3698-4db4-84a5-054c4fdadf66 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:37.731961 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101176b-3698-4db4-84a5-054c4fdadf66 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:37.732153 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101176b-3698-4db4-84a5-054c4fdadf66 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:37.733977 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 62/125] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:37.739937 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf196a-ca99-4534-9036-de235480b17f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:37.740568 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf196a-ca99-4534-9036-de235480b17f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:37.741057 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf196a-ca99-4534-9036-de235480b17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:37.766519 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-1dbf196a-ca99-4534-9036-de235480b17f None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:37.768085 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1dbf196a-ca99-4534-9036-de235480b17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:37.836355 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 64/126] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:37.876664 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101176b-3698-4db4-84a5-054c4fdadf66 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:37.895492 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101176b-3698-4db4-84a5-054c4fdadf66 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:37.905469 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233f1d7-65f6-4394-9625-23e904913e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:37.906271 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233f1d7-65f6-4394-9625-23e904913e1b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:37.906552 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233f1d7-65f6-4394-9625-23e904913e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:37.906819 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233f1d7-65f6-4394-9625-23e904913e1b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:37.910048 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233f1d7-65f6-4394-9625-23e904913e1b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:37.911757 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233f1d7-65f6-4394-9625-23e904913e1b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:37.913376 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 63/127] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:45:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:37.919870 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf196a-ca99-4534-9036-de235480b17f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:37.930559 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf196a-ca99-4534-9036-de235480b17f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:37.936041 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc6bb3-47ff-4149-999b-2cddf1857789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:37.936929 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc6bb3-47ff-4149-999b-2cddf1857789 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:37.937445 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc6bb3-47ff-4149-999b-2cddf1857789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:37.937917 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc6bb3-47ff-4149-999b-2cddf1857789 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:37.938954 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc6bb3-47ff-4149-999b-2cddf1857789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:37.941225 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc6bb3-47ff-4149-999b-2cddf1857789 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:37.970261 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 65/128] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 10 20:45:37 2022] POST /identity/v3/projects => generated 302 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:45:38.073771 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cc9b2-7a04-4504-a4f7-b305ca93ff31 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:38.074380 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cc9b2-7a04-4504-a4f7-b305ca93ff31 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:38.074859 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cc9b2-7a04-4504-a4f7-b305ca93ff31 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:38.077103 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 64/129] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:38.083560 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8531ba3-8bee-4a5a-8760-6b60c5ad5563 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:38.084172 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8531ba3-8bee-4a5a-8760-6b60c5ad5563 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:38.084686 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8531ba3-8bee-4a5a-8760-6b60c5ad5563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:38.104216 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-f8531ba3-8bee-4a5a-8760-6b60c5ad5563 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:38.105885 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f8531ba3-8bee-4a5a-8760-6b60c5ad5563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:38.168415 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 66/130] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:38.193075 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cc9b2-7a04-4504-a4f7-b305ca93ff31 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:38.206470 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cc9b2-7a04-4504-a4f7-b305ca93ff31 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:38.211533 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395b218-620d-46fd-a9ce-cdf00d1e2494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:38.212648 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395b218-620d-46fd-a9ce-cdf00d1e2494 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:38.213123 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395b218-620d-46fd-a9ce-cdf00d1e2494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:38.213654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395b218-620d-46fd-a9ce-cdf00d1e2494 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:38.224706 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395b218-620d-46fd-a9ce-cdf00d1e2494 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:38.232071 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-d395b218-620d-46fd-a9ce-cdf00d1e2494 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 20:45:38.234169 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 65/131] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:38.240653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8531ba3-8bee-4a5a-8760-6b60c5ad5563 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:38.250970 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8531ba3-8bee-4a5a-8760-6b60c5ad5563 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:38.256709 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbe9ac-9a59-481a-80d7-50cdf7bf706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:38.257769 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbe9ac-9a59-481a-80d7-50cdf7bf706b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:38.258268 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbe9ac-9a59-481a-80d7-50cdf7bf706b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:38.258742 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbe9ac-9a59-481a-80d7-50cdf7bf706b admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:38.259752 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bbe9ac-9a59-481a-80d7-50cdf7bf706b admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:38.260240 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bbe9ac-9a59-481a-80d7-50cdf7bf706b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:38.262271 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bbe9ac-9a59-481a-80d7-50cdf7bf706b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:38.271883 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 67/132] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:45:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:38.278004 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395b218-620d-46fd-a9ce-cdf00d1e2494 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:38.292864 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395b218-620d-46fd-a9ce-cdf00d1e2494 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:38.297929 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8018cd-d068-409a-9e65-c0a7091ffc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:38.298903 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8018cd-d068-409a-9e65-c0a7091ffc1a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:38.299302 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8018cd-d068-409a-9e65-c0a7091ffc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:38.299666 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8018cd-d068-409a-9e65-c0a7091ffc1a admin admin] PATH_INFO: `/v3/users/78404b21ac914bc7b501bb52ea3602ba` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:38.314619 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8018cd-d068-409a-9e65-c0a7091ffc1a admin admin] RBAC: Authorizing `identity:get_user(user_id=78404b21ac914bc7b501bb52ea3602ba)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:38.316926 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8018cd-d068-409a-9e65-c0a7091ffc1a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:38.318798 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 66/133] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:38 2022] GET /identity/v3/users/78404b21ac914bc7b501bb52ea3602ba => generated 289 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:38.324658 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbe9ac-9a59-481a-80d7-50cdf7bf706b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:38.335458 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbe9ac-9a59-481a-80d7-50cdf7bf706b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:38.340595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec65530-a5c2-4600-9601-1eafff5ce87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:38.341588 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec65530-a5c2-4600-9601-1eafff5ce87c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:38.341967 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec65530-a5c2-4600-9601-1eafff5ce87c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:38.342363 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec65530-a5c2-4600-9601-1eafff5ce87c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:38.351615 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec65530-a5c2-4600-9601-1eafff5ce87c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:38.353511 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec65530-a5c2-4600-9601-1eafff5ce87c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:38.365569 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 68/134] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:45:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:45:38.369208 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8018cd-d068-409a-9e65-c0a7091ffc1a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:38.379234 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8018cd-d068-409a-9e65-c0a7091ffc1a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:38.384020 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26caf086-459c-410d-ac43-9e3b57a1b85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:38.384909 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caf086-459c-410d-ac43-9e3b57a1b85b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:38.385188 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caf086-459c-410d-ac43-9e3b57a1b85b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:38.385492 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caf086-459c-410d-ac43-9e3b57a1b85b admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:38.386729 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26caf086-459c-410d-ac43-9e3b57a1b85b admin admin] RBAC: Authorizing `identity:get_project(project_id=882013caabf941cd8a950baeb731deb7)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:38.388876 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26caf086-459c-410d-ac43-9e3b57a1b85b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:38.390631 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 67/135] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:38 2022] GET /identity/v3/projects/882013caabf941cd8a950baeb731deb7 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:38.396646 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec65530-a5c2-4600-9601-1eafff5ce87c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:38.405997 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec65530-a5c2-4600-9601-1eafff5ce87c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:38.411883 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997d21f-1ab4-4ff8-bac2-9bdba8427f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:38.412589 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997d21f-1ab4-4ff8-bac2-9bdba8427f62 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:38.412868 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997d21f-1ab4-4ff8-bac2-9bdba8427f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:38.413191 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997d21f-1ab4-4ff8-bac2-9bdba8427f62 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:38.414148 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997d21f-1ab4-4ff8-bac2-9bdba8427f62 admin admin] RBAC: Adding query filter params (role.id=b235f70dfa2a42308edd90003e99cd24, scope.project.id=882013caabf941cd8a950baeb731deb7, user.id=78404b21ac914bc7b501bb52ea3602ba) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:38.414451 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997d21f-1ab4-4ff8-bac2-9bdba8427f62 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:38.415514 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-b997d21f-1ab4-4ff8-bac2-9bdba8427f62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:45:38.415514 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Feb 10 20:45:38.415514 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: Feb 10 20:45:38.416706 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997d21f-1ab4-4ff8-bac2-9bdba8427f62 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:38.424325 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 69/136] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:45:38 2022] GET /identity/v3/role_assignments?user.id=78404b21ac914bc7b501bb52ea3602ba&scope.project.id=882013caabf941cd8a950baeb731deb7&role.id=b235f70dfa2a42308edd90003e99cd24 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:39.865593 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b49313-2218-4136-883b-758d031e5121 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:39.866277 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b49313-2218-4136-883b-758d031e5121 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:39.866277 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b49313-2218-4136-883b-758d031e5121 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:39.867838 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 68/137] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:39.875759 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751217b2-ea9b-4d65-8d8b-fd58b3d22975 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:39.876380 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751217b2-ea9b-4d65-8d8b-fd58b3d22975 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:39.876380 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751217b2-ea9b-4d65-8d8b-fd58b3d22975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:39.902584 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-751217b2-ea9b-4d65-8d8b-fd58b3d22975 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:39.903888 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-751217b2-ea9b-4d65-8d8b-fd58b3d22975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:39.911742 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 70/138] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:39.951540 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b49313-2218-4136-883b-758d031e5121 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:39.965613 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b49313-2218-4136-883b-758d031e5121 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:39.970149 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca2fb1-704d-41c5-a426-fb0110f9137c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:39.970940 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca2fb1-704d-41c5-a426-fb0110f9137c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:39.971219 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca2fb1-704d-41c5-a426-fb0110f9137c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:39.971489 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca2fb1-704d-41c5-a426-fb0110f9137c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:39.987076 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca2fb1-704d-41c5-a426-fb0110f9137c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:39.994007 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-c9ca2fb1-704d-41c5-a426-fb0110f9137c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:45:39.995273 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 69/139] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:45:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:40.001316 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751217b2-ea9b-4d65-8d8b-fd58b3d22975 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:40.010785 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751217b2-ea9b-4d65-8d8b-fd58b3d22975 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:40.021424 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65b9ff-fe20-482d-bd47-5f91d0fb6674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:40.022102 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65b9ff-fe20-482d-bd47-5f91d0fb6674 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:40.022379 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65b9ff-fe20-482d-bd47-5f91d0fb6674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:40.022648 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65b9ff-fe20-482d-bd47-5f91d0fb6674 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:40.023408 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65b9ff-fe20-482d-bd47-5f91d0fb6674 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:40.023709 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65b9ff-fe20-482d-bd47-5f91d0fb6674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:40.025303 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65b9ff-fe20-482d-bd47-5f91d0fb6674 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:40.027359 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f37e3f-ca2e-4617-af89-00912bfa69e3 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:40.027635 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f37e3f-ca2e-4617-af89-00912bfa69e3 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:40.027901 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f37e3f-ca2e-4617-af89-00912bfa69e3 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:40.029756 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 70/140] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:45:40.034965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab87de-a5ca-40aa-b065-6633ecefbdc5 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:40.035242 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab87de-a5ca-40aa-b065-6633ecefbdc5 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:40.035514 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab87de-a5ca-40aa-b065-6633ecefbdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:40.047708 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 71/141] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:40.053331 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65b9ff-fe20-482d-bd47-5f91d0fb6674 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:40.064579 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-67ab87de-a5ca-40aa-b065-6633ecefbdc5 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:40.065779 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-67ab87de-a5ca-40aa-b065-6633ecefbdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:40.070820 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65b9ff-fe20-482d-bd47-5f91d0fb6674 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:40.079913 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 71/142] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:45:40.080575 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b27a0d-e0f7-4a27-bca8-c2b8b5dab87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:40.082216 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da33fe-a2b6-4e70-b207-9775f77232a1 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:40.082496 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da33fe-a2b6-4e70-b207-9775f77232a1 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:40.082767 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da33fe-a2b6-4e70-b207-9775f77232a1 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:40.084426 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 72/143] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:40.085050 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b27a0d-e0f7-4a27-bca8-c2b8b5dab87e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:40.085323 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b27a0d-e0f7-4a27-bca8-c2b8b5dab87e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:40.085615 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b27a0d-e0f7-4a27-bca8-c2b8b5dab87e admin admin] PATH_INFO: `/v3/users/ca0523bae3774fd3bb058d660150718b` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:40.086895 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b27a0d-e0f7-4a27-bca8-c2b8b5dab87e admin admin] RBAC: Authorizing `identity:get_user(user_id=ca0523bae3774fd3bb058d660150718b)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:40.088691 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b27a0d-e0f7-4a27-bca8-c2b8b5dab87e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:40.090316 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 72/144] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:40 2022] GET /identity/v3/users/ca0523bae3774fd3bb058d660150718b => generated 247 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:40.098203 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da33fe-a2b6-4e70-b207-9775f77232a1 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:40.099804 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aecb54-be5e-43ac-a238-3a067e1f1ef7 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:40.100078 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aecb54-be5e-43ac-a238-3a067e1f1ef7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:40.100345 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aecb54-be5e-43ac-a238-3a067e1f1ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:40.116736 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da33fe-a2b6-4e70-b207-9775f77232a1 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:40.121492 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005796f6-ec33-4ddf-b263-4478247a0974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:40.122126 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005796f6-ec33-4ddf-b263-4478247a0974 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:40.122442 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005796f6-ec33-4ddf-b263-4478247a0974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:40.122714 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005796f6-ec33-4ddf-b263-4478247a0974 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:40.123417 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-c7aecb54-be5e-43ac-a238-3a067e1f1ef7 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:40.124715 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c7aecb54-be5e-43ac-a238-3a067e1f1ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:40.131594 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005796f6-ec33-4ddf-b263-4478247a0974 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:40.132924 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 73/145] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:40.133469 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005796f6-ec33-4ddf-b263-4478247a0974 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:40.133734 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aecb54-be5e-43ac-a238-3a067e1f1ef7 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:40.142547 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aecb54-be5e-43ac-a238-3a067e1f1ef7 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:40.143284 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 73/146] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:45:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:45:40.150290 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005796f6-ec33-4ddf-b263-4478247a0974 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:40.158276 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad18e6-0b4c-4bc0-921d-db81be22f324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:40.159090 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad18e6-0b4c-4bc0-921d-db81be22f324 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:40.159367 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad18e6-0b4c-4bc0-921d-db81be22f324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:40.159633 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad18e6-0b4c-4bc0-921d-db81be22f324 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:40.165759 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005796f6-ec33-4ddf-b263-4478247a0974 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:40.170965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1d432-82d5-43d4-9b14-587be532347a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:40.172095 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1d432-82d5-43d4-9b14-587be532347a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:40.172318 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad18e6-0b4c-4bc0-921d-db81be22f324 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:40.172417 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1d432-82d5-43d4-9b14-587be532347a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:40.172635 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1d432-82d5-43d4-9b14-587be532347a admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:40.173875 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1d432-82d5-43d4-9b14-587be532347a admin admin] RBAC: Authorizing `identity:get_project(project_id=882013caabf941cd8a950baeb731deb7)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:40.175952 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1d432-82d5-43d4-9b14-587be532347a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:40.177937 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 74/147] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:40 2022] GET /identity/v3/projects/882013caabf941cd8a950baeb731deb7 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:40.178700 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1d432-82d5-43d4-9b14-587be532347a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:40.180945 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-ebad18e6-0b4c-4bc0-921d-db81be22f324 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 20:45:40.182393 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 74/148] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 10 20:45:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:40.184413 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad18e6-0b4c-4bc0-921d-db81be22f324 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:40.194221 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1d432-82d5-43d4-9b14-587be532347a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:40.198179 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad18e6-0b4c-4bc0-921d-db81be22f324 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:40.199040 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66358479-d148-4bc1-8452-9ea4e49d272a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:40.200161 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66358479-d148-4bc1-8452-9ea4e49d272a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:40.200803 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66358479-d148-4bc1-8452-9ea4e49d272a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:40.201320 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66358479-d148-4bc1-8452-9ea4e49d272a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:40.202843 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637af567-e2e7-41ef-b8fa-a0988bfce774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:40.203619 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637af567-e2e7-41ef-b8fa-a0988bfce774 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:40.203856 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637af567-e2e7-41ef-b8fa-a0988bfce774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:40.204199 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637af567-e2e7-41ef-b8fa-a0988bfce774 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:40.205126 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637af567-e2e7-41ef-b8fa-a0988bfce774 admin admin] RBAC: Adding query filter params (role.id=e06447c1c62d465c9f9c58168be71ed8, scope.project.id=882013caabf941cd8a950baeb731deb7, user.id=ca0523bae3774fd3bb058d660150718b) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:40.205528 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637af567-e2e7-41ef-b8fa-a0988bfce774 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:40.207474 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637af567-e2e7-41ef-b8fa-a0988bfce774 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:40.213317 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66358479-d148-4bc1-8452-9ea4e49d272a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:40.214349 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 75/149] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:45:40 2022] GET /identity/v3/role_assignments?user.id=ca0523bae3774fd3bb058d660150718b&scope.project.id=882013caabf941cd8a950baeb731deb7&role.id=e06447c1c62d465c9f9c58168be71ed8 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:40.215047 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637af567-e2e7-41ef-b8fa-a0988bfce774 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:40.221061 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-66358479-d148-4bc1-8452-9ea4e49d272a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 20:45:40.222597 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 75/150] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:40.228251 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66358479-d148-4bc1-8452-9ea4e49d272a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:40.235975 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637af567-e2e7-41ef-b8fa-a0988bfce774 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:40.239529 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66358479-d148-4bc1-8452-9ea4e49d272a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:40.244703 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bc850-fa2d-41fe-af54-474d5d1957d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:40.245749 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bc850-fa2d-41fe-af54-474d5d1957d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:40.246219 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bc850-fa2d-41fe-af54-474d5d1957d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:40.246687 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bc850-fa2d-41fe-af54-474d5d1957d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:40.247520 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339376a-feae-4bfc-a0de-f9216540c45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:40.248008 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94bc850-fa2d-41fe-af54-474d5d1957d6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:40.248200 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339376a-feae-4bfc-a0de-f9216540c45b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:40.248478 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339376a-feae-4bfc-a0de-f9216540c45b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:40.248750 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339376a-feae-4bfc-a0de-f9216540c45b admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:40.249046 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94bc850-fa2d-41fe-af54-474d5d1957d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:40.249621 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339376a-feae-4bfc-a0de-f9216540c45b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:40.249933 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339376a-feae-4bfc-a0de-f9216540c45b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:40.251283 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94bc850-fa2d-41fe-af54-474d5d1957d6 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:40.251536 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339376a-feae-4bfc-a0de-f9216540c45b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:40.261422 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 76/151] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:45:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:40.265397 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 76/152] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:45:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:40.267580 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bc850-fa2d-41fe-af54-474d5d1957d6 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:40.277828 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bc850-fa2d-41fe-af54-474d5d1957d6 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:40.278768 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339376a-feae-4bfc-a0de-f9216540c45b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:40.283009 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7ca1b-d634-4541-8f24-cb06c064d7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:40.284228 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7ca1b-d634-4541-8f24-cb06c064d7df admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:40.284739 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7ca1b-d634-4541-8f24-cb06c064d7df admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:40.285194 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7ca1b-d634-4541-8f24-cb06c064d7df admin admin] PATH_INFO: `/v3/users/8b22c33745c54882af2b0d91049e3e1d` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:40.286702 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7ca1b-d634-4541-8f24-cb06c064d7df admin admin] RBAC: Authorizing `identity:get_user(user_id=8b22c33745c54882af2b0d91049e3e1d)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:40.289069 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7ca1b-d634-4541-8f24-cb06c064d7df admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:40.290943 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 77/153] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:40 2022] GET /identity/v3/users/8b22c33745c54882af2b0d91049e3e1d => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:40.295145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339376a-feae-4bfc-a0de-f9216540c45b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:40.296768 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7ca1b-d634-4541-8f24-cb06c064d7df admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:40.307334 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7ca1b-d634-4541-8f24-cb06c064d7df admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:40.312287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8d351-fda8-4b92-b2ab-0f3e2bc3d286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:40.314303 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8d351-fda8-4b92-b2ab-0f3e2bc3d286 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:40.315102 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24770cc-924a-43b3-81a6-930afc6381f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:40.315969 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24770cc-924a-43b3-81a6-930afc6381f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:40.316442 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8d351-fda8-4b92-b2ab-0f3e2bc3d286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:40.316892 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8d351-fda8-4b92-b2ab-0f3e2bc3d286 admin admin] PATH_INFO: `/v3/users/8b22c33745c54882af2b0d91049e3e1d` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:40.317389 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24770cc-924a-43b3-81a6-930afc6381f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:40.318527 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24770cc-924a-43b3-81a6-930afc6381f6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:40.320096 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8d351-fda8-4b92-b2ab-0f3e2bc3d286 admin admin] RBAC: Authorizing `identity:get_user(user_id=8b22c33745c54882af2b0d91049e3e1d)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:40.322921 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8d351-fda8-4b92-b2ab-0f3e2bc3d286 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:40.324955 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 77/154] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:40 2022] GET /identity/v3/users/8b22c33745c54882af2b0d91049e3e1d => generated 275 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:40.331748 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8d351-fda8-4b92-b2ab-0f3e2bc3d286 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:40.339060 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24770cc-924a-43b3-81a6-930afc6381f6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:40.341247 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24770cc-924a-43b3-81a6-930afc6381f6 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:40.342915 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8d351-fda8-4b92-b2ab-0f3e2bc3d286 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:40.347902 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabe6d8-becc-481c-a28e-31baa6e1fc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:40.348872 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabe6d8-becc-481c-a28e-31baa6e1fc39 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:40.349413 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabe6d8-becc-481c-a28e-31baa6e1fc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:40.349868 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabe6d8-becc-481c-a28e-31baa6e1fc39 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:40.355308 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 78/155] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:45:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:45:40.362417 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24770cc-924a-43b3-81a6-930afc6381f6 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:40.365607 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabe6d8-becc-481c-a28e-31baa6e1fc39 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:40.367943 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabe6d8-becc-481c-a28e-31baa6e1fc39 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:40.378973 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 78/156] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:45:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 20:45:40.384557 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24770cc-924a-43b3-81a6-930afc6381f6 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:40.385823 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabe6d8-becc-481c-a28e-31baa6e1fc39 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:40.395778 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabe6d8-becc-481c-a28e-31baa6e1fc39 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:40.398992 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da7674-bfeb-42b0-ae81-8ab2eccc92a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:40.399864 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da7674-bfeb-42b0-ae81-8ab2eccc92a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:40.400150 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da7674-bfeb-42b0-ae81-8ab2eccc92a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:40.400419 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da7674-bfeb-42b0-ae81-8ab2eccc92a6 admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:40.401908 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ce84f-a617-45a8-9243-8003926aea5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:40.403030 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ce84f-a617-45a8-9243-8003926aea5b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:40.403548 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ce84f-a617-45a8-9243-8003926aea5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:40.404131 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ce84f-a617-45a8-9243-8003926aea5b admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:40.405765 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ce84f-a617-45a8-9243-8003926aea5b admin admin] RBAC: Authorizing `identity:get_project(project_id=882013caabf941cd8a950baeb731deb7)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:40.406261 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da7674-bfeb-42b0-ae81-8ab2eccc92a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=882013caabf941cd8a950baeb731deb7)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:40.408343 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da7674-bfeb-42b0-ae81-8ab2eccc92a6 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:40.408589 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ce84f-a617-45a8-9243-8003926aea5b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:40.410166 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 79/157] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:40 2022] GET /identity/v3/projects/882013caabf941cd8a950baeb731deb7 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:40.415791 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 79/158] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:40 2022] GET /identity/v3/projects/882013caabf941cd8a950baeb731deb7 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:40.416578 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da7674-bfeb-42b0-ae81-8ab2eccc92a6 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:40.424622 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ce84f-a617-45a8-9243-8003926aea5b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:40.442302 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ce84f-a617-45a8-9243-8003926aea5b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:40.442982 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da7674-bfeb-42b0-ae81-8ab2eccc92a6 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:40.451152 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9e5f8-0840-47c2-9834-ef810e5ce8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:40.452905 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3016ce-f66e-471d-8076-a951b684156e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:40.454502 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9e5f8-0840-47c2-9834-ef810e5ce8ea admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:40.455812 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3016ce-f66e-471d-8076-a951b684156e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:40.456576 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9e5f8-0840-47c2-9834-ef810e5ce8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:40.457337 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3016ce-f66e-471d-8076-a951b684156e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:40.458120 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9e5f8-0840-47c2-9834-ef810e5ce8ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:40.458632 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3016ce-f66e-471d-8076-a951b684156e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:40.460621 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3016ce-f66e-471d-8076-a951b684156e admin admin] RBAC: Adding query filter params (role.id=80e0463ac1aa4ef2b3739b580669f095, scope.project.id=882013caabf941cd8a950baeb731deb7, user.id=8b22c33745c54882af2b0d91049e3e1d) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:40.461812 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9e5f8-0840-47c2-9834-ef810e5ce8ea admin admin] RBAC: Adding query filter params (role.id=fbf072f915fc46ee9a80c656e2bb2b30, scope.project.id=882013caabf941cd8a950baeb731deb7, user.id=8b22c33745c54882af2b0d91049e3e1d) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:40.462345 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9e5f8-0840-47c2-9834-ef810e5ce8ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:40.464512 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9e5f8-0840-47c2-9834-ef810e5ce8ea admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:40.465181 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3016ce-f66e-471d-8076-a951b684156e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:40.467426 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3016ce-f66e-471d-8076-a951b684156e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:40.479074 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 80/159] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:45:40 2022] GET /identity/v3/role_assignments?user.id=8b22c33745c54882af2b0d91049e3e1d&scope.project.id=882013caabf941cd8a950baeb731deb7&role.id=fbf072f915fc46ee9a80c656e2bb2b30 => generated 608 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:40.481555 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 80/160] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:45:40 2022] GET /identity/v3/role_assignments?user.id=8b22c33745c54882af2b0d91049e3e1d&scope.project.id=882013caabf941cd8a950baeb731deb7&role.id=80e0463ac1aa4ef2b3739b580669f095 => generated 608 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:41.181698 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff32186-fc59-48d9-886e-d095d98e1ff2 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:41.182309 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff32186-fc59-48d9-886e-d095d98e1ff2 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:41.182309 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff32186-fc59-48d9-886e-d095d98e1ff2 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:41.183982 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 81/161] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:41.189744 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855bf21-c967-4207-b597-55dc122b8bca None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:41.190156 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855bf21-c967-4207-b597-55dc122b8bca None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:41.190321 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855bf21-c967-4207-b597-55dc122b8bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:41.208060 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-5855bf21-c967-4207-b597-55dc122b8bca None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:41.209222 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5855bf21-c967-4207-b597-55dc122b8bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:41.217260 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 81/162] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:45:41.240332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff32186-fc59-48d9-886e-d095d98e1ff2 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:41.253962 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff32186-fc59-48d9-886e-d095d98e1ff2 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:41.258841 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcc993-0832-4712-94bc-700bc5f85077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:41.259626 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcc993-0832-4712-94bc-700bc5f85077 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:41.259857 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcc993-0832-4712-94bc-700bc5f85077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:41.260152 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcc993-0832-4712-94bc-700bc5f85077 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:41.271123 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fcc993-0832-4712-94bc-700bc5f85077 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:41.277834 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-82fcc993-0832-4712-94bc-700bc5f85077 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 20:45:41.279051 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 82/163] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:41.285299 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855bf21-c967-4207-b597-55dc122b8bca None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:41.294620 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855bf21-c967-4207-b597-55dc122b8bca None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:41.299127 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9946d-c6fa-43c9-95c9-ecd398043630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:41.299853 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9946d-c6fa-43c9-95c9-ecd398043630 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:41.300196 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9946d-c6fa-43c9-95c9-ecd398043630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:41.300529 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9946d-c6fa-43c9-95c9-ecd398043630 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:41.301388 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9946d-c6fa-43c9-95c9-ecd398043630 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:41.301751 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9946d-c6fa-43c9-95c9-ecd398043630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:41.303594 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9946d-c6fa-43c9-95c9-ecd398043630 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:41.313652 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 82/164] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:45:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:41.318530 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcc993-0832-4712-94bc-700bc5f85077 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:41.329781 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcc993-0832-4712-94bc-700bc5f85077 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:41.334707 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449318c0-6900-4fc4-8f73-5a465ecbbe5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:41.335563 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449318c0-6900-4fc4-8f73-5a465ecbbe5d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:41.335840 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449318c0-6900-4fc4-8f73-5a465ecbbe5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:41.336107 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449318c0-6900-4fc4-8f73-5a465ecbbe5d admin admin] PATH_INFO: `/v3/users/78404b21ac914bc7b501bb52ea3602ba` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:41.337451 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449318c0-6900-4fc4-8f73-5a465ecbbe5d admin admin] RBAC: Authorizing `identity:get_user(user_id=78404b21ac914bc7b501bb52ea3602ba)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:41.339639 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449318c0-6900-4fc4-8f73-5a465ecbbe5d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:41.341463 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 83/165] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:41 2022] GET /identity/v3/users/78404b21ac914bc7b501bb52ea3602ba => generated 289 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:41.347100 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9946d-c6fa-43c9-95c9-ecd398043630 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:41.357204 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9946d-c6fa-43c9-95c9-ecd398043630 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:41.361904 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3134a45-133b-45e0-bbc3-aec3ecd631e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:41.362859 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3134a45-133b-45e0-bbc3-aec3ecd631e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:41.363140 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3134a45-133b-45e0-bbc3-aec3ecd631e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:41.363405 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3134a45-133b-45e0-bbc3-aec3ecd631e1 admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:41.364973 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3134a45-133b-45e0-bbc3-aec3ecd631e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=882013caabf941cd8a950baeb731deb7)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:41.367065 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3134a45-133b-45e0-bbc3-aec3ecd631e1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:41.368884 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 83/166] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:41 2022] GET /identity/v3/projects/882013caabf941cd8a950baeb731deb7 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:41.374513 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449318c0-6900-4fc4-8f73-5a465ecbbe5d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:41.384880 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449318c0-6900-4fc4-8f73-5a465ecbbe5d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:41.389815 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea50615-d337-41f0-8765-5cf5bb032d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:41.390717 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea50615-d337-41f0-8765-5cf5bb032d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:41.390986 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea50615-d337-41f0-8765-5cf5bb032d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:41.391246 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea50615-d337-41f0-8765-5cf5bb032d1a admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7/users/78404b21ac914bc7b501bb52ea3602ba/roles/b235f70dfa2a42308edd90003e99cd24` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:41.393463 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea50615-d337-41f0-8765-5cf5bb032d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=882013caabf941cd8a950baeb731deb7, user_id=78404b21ac914bc7b501bb52ea3602ba, role_id=b235f70dfa2a42308edd90003e99cd24)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:41.396140 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea50615-d337-41f0-8765-5cf5bb032d1a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:41.411135 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 84/167] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:45:41 2022] PUT /identity/v3/projects/882013caabf941cd8a950baeb731deb7/users/78404b21ac914bc7b501bb52ea3602ba/roles/b235f70dfa2a42308edd90003e99cd24 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:45:41.417618 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3295267-04bd-45fa-8edf-c13c2ae4642e None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:41.418268 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3295267-04bd-45fa-8edf-c13c2ae4642e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:41.418775 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3295267-04bd-45fa-8edf-c13c2ae4642e None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:41.421540 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 84/168] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:41.427650 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa27ea1-102c-4faa-9745-aa506391a9c8 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:41.427978 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa27ea1-102c-4faa-9745-aa506391a9c8 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:41.428248 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa27ea1-102c-4faa-9745-aa506391a9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:41.457768 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-2fa27ea1-102c-4faa-9745-aa506391a9c8 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:41.463280 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-2fa27ea1-102c-4faa-9745-aa506391a9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:41.533375 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 85/169] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:41.555929 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3295267-04bd-45fa-8edf-c13c2ae4642e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:41.568610 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3295267-04bd-45fa-8edf-c13c2ae4642e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:41.572969 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa9a97-2f51-44ec-9cf9-0cdb409882a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:41.573896 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa9a97-2f51-44ec-9cf9-0cdb409882a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:41.574238 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa9a97-2f51-44ec-9cf9-0cdb409882a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:41.574591 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa9a97-2f51-44ec-9cf9-0cdb409882a6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:41.586555 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa9a97-2f51-44ec-9cf9-0cdb409882a6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:41.594271 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-39aa9a97-2f51-44ec-9cf9-0cdb409882a6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 20:45:41.595501 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 85/170] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:41.601734 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa27ea1-102c-4faa-9745-aa506391a9c8 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:41.611233 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa27ea1-102c-4faa-9745-aa506391a9c8 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:41.616830 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec80bde-3f26-4522-b5e2-a518cb302123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:41.617641 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec80bde-3f26-4522-b5e2-a518cb302123 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:41.617999 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec80bde-3f26-4522-b5e2-a518cb302123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:41.618356 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec80bde-3f26-4522-b5e2-a518cb302123 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:41.619490 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec80bde-3f26-4522-b5e2-a518cb302123 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:41.619793 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec80bde-3f26-4522-b5e2-a518cb302123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:41.621454 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec80bde-3f26-4522-b5e2-a518cb302123 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:41.630330 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 86/171] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:45:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:41.635878 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa9a97-2f51-44ec-9cf9-0cdb409882a6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:41.646041 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa9a97-2f51-44ec-9cf9-0cdb409882a6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:41.650187 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76882353-1c9d-4538-9d7b-b1cf6cee95b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:41.651050 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76882353-1c9d-4538-9d7b-b1cf6cee95b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:41.651327 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76882353-1c9d-4538-9d7b-b1cf6cee95b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:41.651589 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76882353-1c9d-4538-9d7b-b1cf6cee95b4 admin admin] PATH_INFO: `/v3/users/8b22c33745c54882af2b0d91049e3e1d` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:41.652781 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76882353-1c9d-4538-9d7b-b1cf6cee95b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=8b22c33745c54882af2b0d91049e3e1d)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:41.654973 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76882353-1c9d-4538-9d7b-b1cf6cee95b4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:41.656708 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 86/172] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:41 2022] GET /identity/v3/users/8b22c33745c54882af2b0d91049e3e1d => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:41.662053 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec80bde-3f26-4522-b5e2-a518cb302123 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:41.671945 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec80bde-3f26-4522-b5e2-a518cb302123 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:41.676140 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7ec1e-687a-40bc-8acd-8bfd7cba7db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:41.676769 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7ec1e-687a-40bc-8acd-8bfd7cba7db8 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:41.677044 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7ec1e-687a-40bc-8acd-8bfd7cba7db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:41.677312 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7ec1e-687a-40bc-8acd-8bfd7cba7db8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:41.685032 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7ec1e-687a-40bc-8acd-8bfd7cba7db8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:41.686830 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7ec1e-687a-40bc-8acd-8bfd7cba7db8 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:41.695519 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 87/173] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:45:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:45:41.701167 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76882353-1c9d-4538-9d7b-b1cf6cee95b4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:41.707028 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dac19-20c7-42eb-a17c-f89d43522015 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:41.707328 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dac19-20c7-42eb-a17c-f89d43522015 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:41.707599 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dac19-20c7-42eb-a17c-f89d43522015 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:41.709567 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 88/174] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:45:41.711308 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76882353-1c9d-4538-9d7b-b1cf6cee95b4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:41.714659 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45598579-359f-451f-85af-2c2da2c417e4 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:41.714895 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45598579-359f-451f-85af-2c2da2c417e4 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:41.715160 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45598579-359f-451f-85af-2c2da2c417e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:41.715611 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cbfc6-0cc7-40c4-8ca3-004fb0a5c4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:41.716494 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cbfc6-0cc7-40c4-8ca3-004fb0a5c4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:41.716767 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cbfc6-0cc7-40c4-8ca3-004fb0a5c4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:41.717032 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cbfc6-0cc7-40c4-8ca3-004fb0a5c4f5 admin admin] PATH_INFO: `/v3/projects/4adc69fb80c54d1f9d6521c58e787beb` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:41.718240 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cbfc6-0cc7-40c4-8ca3-004fb0a5c4f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=4adc69fb80c54d1f9d6521c58e787beb)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:41.720261 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cbfc6-0cc7-40c4-8ca3-004fb0a5c4f5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:41.722078 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 87/175] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:41 2022] GET /identity/v3/projects/4adc69fb80c54d1f9d6521c58e787beb => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:41.729274 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cbfc6-0cc7-40c4-8ca3-004fb0a5c4f5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:41.736223 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-45598579-359f-451f-85af-2c2da2c417e4 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:41.736648 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-45598579-359f-451f-85af-2c2da2c417e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:41.740781 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cbfc6-0cc7-40c4-8ca3-004fb0a5c4f5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:41.745104 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0942b37-5dc0-4f8d-a439-4f1cdc82c63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:41.745220 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 89/176] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:45:41.745849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0942b37-5dc0-4f8d-a439-4f1cdc82c63a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:41.746127 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0942b37-5dc0-4f8d-a439-4f1cdc82c63a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:41.746395 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0942b37-5dc0-4f8d-a439-4f1cdc82c63a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:41.747279 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0942b37-5dc0-4f8d-a439-4f1cdc82c63a admin admin] RBAC: Adding query filter params (role.id=80e0463ac1aa4ef2b3739b580669f095, scope.project.id=4adc69fb80c54d1f9d6521c58e787beb, user.id=8b22c33745c54882af2b0d91049e3e1d) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:41.747614 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0942b37-5dc0-4f8d-a439-4f1cdc82c63a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:41.749495 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0942b37-5dc0-4f8d-a439-4f1cdc82c63a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:41.755818 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 88/177] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:45:41 2022] GET /identity/v3/role_assignments?user.id=8b22c33745c54882af2b0d91049e3e1d&scope.project.id=4adc69fb80c54d1f9d6521c58e787beb&role.id=80e0463ac1aa4ef2b3739b580669f095 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:41.771010 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45598579-359f-451f-85af-2c2da2c417e4 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:41.780697 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45598579-359f-451f-85af-2c2da2c417e4 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:41.786345 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f346c5-6845-4bab-9603-510d682acb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:41.787240 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f346c5-6845-4bab-9603-510d682acb81 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:41.787477 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f346c5-6845-4bab-9603-510d682acb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:41.787777 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f346c5-6845-4bab-9603-510d682acb81 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:41.789131 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f346c5-6845-4bab-9603-510d682acb81 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:41.791616 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f346c5-6845-4bab-9603-510d682acb81 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:41.794346 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 90/178] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:45:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:41.799993 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0942b37-5dc0-4f8d-a439-4f1cdc82c63a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:41.810422 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0942b37-5dc0-4f8d-a439-4f1cdc82c63a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:41.815197 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e467798-cb74-48ec-82c1-1460dbaa4f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:41.815890 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e467798-cb74-48ec-82c1-1460dbaa4f07 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:41.816169 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e467798-cb74-48ec-82c1-1460dbaa4f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:41.816396 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e467798-cb74-48ec-82c1-1460dbaa4f07 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:41.817179 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e467798-cb74-48ec-82c1-1460dbaa4f07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:41.819179 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e467798-cb74-48ec-82c1-1460dbaa4f07 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:41.853388 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 89/179] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 10 20:45:41 2022] POST /identity/v3/users => generated 283 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:45:43.653269 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0241c5-1298-4e92-a063-d0157b2148fb None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:43.653795 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0241c5-1298-4e92-a063-d0157b2148fb None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:43.653939 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0241c5-1298-4e92-a063-d0157b2148fb None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:43.655945 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 91/180] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:43.661546 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53208387-8ac7-4202-8961-f7c08528d4cc None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:43.662005 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53208387-8ac7-4202-8961-f7c08528d4cc None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:43.662080 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53208387-8ac7-4202-8961-f7c08528d4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:43.679923 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-53208387-8ac7-4202-8961-f7c08528d4cc None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:43.681098 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-53208387-8ac7-4202-8961-f7c08528d4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:43.689046 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 90/181] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:43.712876 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0241c5-1298-4e92-a063-d0157b2148fb None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:43.725231 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0241c5-1298-4e92-a063-d0157b2148fb None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:43.729526 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9169810-4622-4c91-91f8-5c3fa6aaaf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:43.730320 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9169810-4622-4c91-91f8-5c3fa6aaaf3a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:43.730595 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9169810-4622-4c91-91f8-5c3fa6aaaf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:43.731031 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9169810-4622-4c91-91f8-5c3fa6aaaf3a admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:43.741955 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9169810-4622-4c91-91f8-5c3fa6aaaf3a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:43.748895 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-e9169810-4622-4c91-91f8-5c3fa6aaaf3a admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 20:45:43.750336 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 92/182] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:43.756376 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53208387-8ac7-4202-8961-f7c08528d4cc None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:43.765622 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53208387-8ac7-4202-8961-f7c08528d4cc None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:43.770082 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519b265-e009-4898-9e18-dca6cf16e0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:43.770747 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519b265-e009-4898-9e18-dca6cf16e0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:43.771024 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519b265-e009-4898-9e18-dca6cf16e0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:43.771299 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519b265-e009-4898-9e18-dca6cf16e0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:43.772059 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519b265-e009-4898-9e18-dca6cf16e0d3 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:43.772361 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519b265-e009-4898-9e18-dca6cf16e0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:43.774011 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519b265-e009-4898-9e18-dca6cf16e0d3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:43.783032 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 91/183] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:45:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:43.788428 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9169810-4622-4c91-91f8-5c3fa6aaaf3a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:43.798907 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9169810-4622-4c91-91f8-5c3fa6aaaf3a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:43.803320 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c0bda-487f-4b9b-86c7-5937cf4b8781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:43.804191 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c0bda-487f-4b9b-86c7-5937cf4b8781 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:43.804467 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c0bda-487f-4b9b-86c7-5937cf4b8781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:43.804731 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c0bda-487f-4b9b-86c7-5937cf4b8781 admin admin] PATH_INFO: `/v3/users/78404b21ac914bc7b501bb52ea3602ba` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:43.806016 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c0bda-487f-4b9b-86c7-5937cf4b8781 admin admin] RBAC: Authorizing `identity:get_user(user_id=78404b21ac914bc7b501bb52ea3602ba)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:43.808360 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c0bda-487f-4b9b-86c7-5937cf4b8781 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:43.810317 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 93/184] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:43 2022] GET /identity/v3/users/78404b21ac914bc7b501bb52ea3602ba => generated 289 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:43.816704 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519b265-e009-4898-9e18-dca6cf16e0d3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:43.827617 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519b265-e009-4898-9e18-dca6cf16e0d3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:43.832190 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050b04e-4e0a-42e1-a1fb-a66c2554d7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:43.832833 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050b04e-4e0a-42e1-a1fb-a66c2554d7ac admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:43.833111 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050b04e-4e0a-42e1-a1fb-a66c2554d7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:43.833407 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050b04e-4e0a-42e1-a1fb-a66c2554d7ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:43.841698 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050b04e-4e0a-42e1-a1fb-a66c2554d7ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:43.843459 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050b04e-4e0a-42e1-a1fb-a66c2554d7ac admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:43.852441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 92/185] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:45:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:45:43.858118 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c0bda-487f-4b9b-86c7-5937cf4b8781 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:43.868030 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c0bda-487f-4b9b-86c7-5937cf4b8781 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:43.872658 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2a176-aafa-4213-a55b-08167b0ee8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:43.873594 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2a176-aafa-4213-a55b-08167b0ee8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:43.873872 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2a176-aafa-4213-a55b-08167b0ee8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:43.874141 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2a176-aafa-4213-a55b-08167b0ee8c7 admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:43.875452 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2a176-aafa-4213-a55b-08167b0ee8c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=882013caabf941cd8a950baeb731deb7)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:43.877620 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2a176-aafa-4213-a55b-08167b0ee8c7 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:43.879667 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 94/186] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:43 2022] GET /identity/v3/projects/882013caabf941cd8a950baeb731deb7 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:43.886057 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050b04e-4e0a-42e1-a1fb-a66c2554d7ac admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:43.895663 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050b04e-4e0a-42e1-a1fb-a66c2554d7ac admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:43.900377 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92dd6f3-b583-46d8-b0ad-9c5a9ccf830e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:43.901047 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dd6f3-b583-46d8-b0ad-9c5a9ccf830e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:43.901319 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dd6f3-b583-46d8-b0ad-9c5a9ccf830e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:43.901629 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dd6f3-b583-46d8-b0ad-9c5a9ccf830e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:43.902488 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92dd6f3-b583-46d8-b0ad-9c5a9ccf830e admin admin] RBAC: Adding query filter params (role.id=b235f70dfa2a42308edd90003e99cd24, scope.project.id=882013caabf941cd8a950baeb731deb7, user.id=78404b21ac914bc7b501bb52ea3602ba) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:43.902798 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92dd6f3-b583-46d8-b0ad-9c5a9ccf830e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:43.904701 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92dd6f3-b583-46d8-b0ad-9c5a9ccf830e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:43.911702 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 93/187] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:45:43 2022] GET /identity/v3/role_assignments?user.id=78404b21ac914bc7b501bb52ea3602ba&scope.project.id=882013caabf941cd8a950baeb731deb7&role.id=b235f70dfa2a42308edd90003e99cd24 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:44.166399 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe8136-d1c8-41dc-93bf-49ce2abb8f3b None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:44.166774 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe8136-d1c8-41dc-93bf-49ce2abb8f3b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:44.166942 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe8136-d1c8-41dc-93bf-49ce2abb8f3b None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:44.168683 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 95/188] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:44.174496 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41701556-cb5a-4197-b5c6-b48902ef0577 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:44.174775 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41701556-cb5a-4197-b5c6-b48902ef0577 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:44.175042 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41701556-cb5a-4197-b5c6-b48902ef0577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:44.192592 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-41701556-cb5a-4197-b5c6-b48902ef0577 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:44.193769 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-41701556-cb5a-4197-b5c6-b48902ef0577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:44.201172 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 94/189] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:44.224234 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe8136-d1c8-41dc-93bf-49ce2abb8f3b None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:44.236691 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe8136-d1c8-41dc-93bf-49ce2abb8f3b None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:44.241309 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd319bd9-3a5b-431d-83ca-440eb0ab8dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:44.242171 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd319bd9-3a5b-431d-83ca-440eb0ab8dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:44.242502 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd319bd9-3a5b-431d-83ca-440eb0ab8dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:44.242788 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd319bd9-3a5b-431d-83ca-440eb0ab8dc2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:44.253644 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd319bd9-3a5b-431d-83ca-440eb0ab8dc2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:44.260777 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-bd319bd9-3a5b-431d-83ca-440eb0ab8dc2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:45:44.262139 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 96/190] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:45:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:44.268074 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41701556-cb5a-4197-b5c6-b48902ef0577 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:44.277383 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41701556-cb5a-4197-b5c6-b48902ef0577 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:44.282296 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a9d8d-7f04-4b78-bd10-838ce2857f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:44.283060 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a9d8d-7f04-4b78-bd10-838ce2857f12 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:44.283407 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a9d8d-7f04-4b78-bd10-838ce2857f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:44.283743 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a9d8d-7f04-4b78-bd10-838ce2857f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:44.284573 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a9d8d-7f04-4b78-bd10-838ce2857f12 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:44.284878 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a9d8d-7f04-4b78-bd10-838ce2857f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:44.286514 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a9d8d-7f04-4b78-bd10-838ce2857f12 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:44.295513 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 95/191] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:44.301160 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd319bd9-3a5b-431d-83ca-440eb0ab8dc2 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:44.311143 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd319bd9-3a5b-431d-83ca-440eb0ab8dc2 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:44.315923 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb05a03-eac4-41e1-8844-3dcff8b6c037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:44.316825 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb05a03-eac4-41e1-8844-3dcff8b6c037 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:44.317103 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb05a03-eac4-41e1-8844-3dcff8b6c037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:44.317365 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb05a03-eac4-41e1-8844-3dcff8b6c037 admin admin] PATH_INFO: `/v3/users/dd7301ac43c340878098879ee250c39a` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:44.324002 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67f9f4-f1ea-42f7-8b66-6a345eca90d0 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:44.324286 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67f9f4-f1ea-42f7-8b66-6a345eca90d0 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:44.324549 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67f9f4-f1ea-42f7-8b66-6a345eca90d0 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:44.326533 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 96/192] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:45:44.331131 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb05a03-eac4-41e1-8844-3dcff8b6c037 admin admin] RBAC: Authorizing `identity:get_user(user_id=dd7301ac43c340878098879ee250c39a)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:44.331477 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49021d32-1340-436d-95bd-6f3feec2a091 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:44.331754 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49021d32-1340-436d-95bd-6f3feec2a091 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:44.332019 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49021d32-1340-436d-95bd-6f3feec2a091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:44.333326 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb05a03-eac4-41e1-8844-3dcff8b6c037 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:44.339306 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 97/193] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:44 2022] GET /identity/v3/users/dd7301ac43c340878098879ee250c39a => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:44.339306 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2365d-64c3-4c6a-bf7d-505f7a0c4178 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:44.339306 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2365d-64c3-4c6a-bf7d-505f7a0c4178 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:44.339306 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2365d-64c3-4c6a-bf7d-505f7a0c4178 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:44.339619 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 98/194] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:45:44.340083 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2365d-64c3-4c6a-bf7d-505f7a0c4178 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:44.352846 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2365d-64c3-4c6a-bf7d-505f7a0c4178 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:44.354071 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-49021d32-1340-436d-95bd-6f3feec2a091 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:44.355241 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-49021d32-1340-436d-95bd-6f3feec2a091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:44.357060 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3bdd5-edf0-4eb2-85a9-c4c76caf8402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:44.357725 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3bdd5-edf0-4eb2-85a9-c4c76caf8402 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:44.357959 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3bdd5-edf0-4eb2-85a9-c4c76caf8402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:44.358228 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3bdd5-edf0-4eb2-85a9-c4c76caf8402 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:44.362743 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 97/195] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:45:44.363916 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370528f-094c-4718-9970-03d27c5ff16d None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:44.364192 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370528f-094c-4718-9970-03d27c5ff16d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:44.364460 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370528f-094c-4718-9970-03d27c5ff16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:44.366205 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3bdd5-edf0-4eb2-85a9-c4c76caf8402 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:44.367953 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3bdd5-edf0-4eb2-85a9-c4c76caf8402 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:44.376434 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 99/196] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:45:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:45:44.381793 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-0370528f-094c-4718-9970-03d27c5ff16d None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:44.382118 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3bdd5-edf0-4eb2-85a9-c4c76caf8402 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:44.382936 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0370528f-094c-4718-9970-03d27c5ff16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:44.390211 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3bdd5-edf0-4eb2-85a9-c4c76caf8402 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:44.390552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 98/197] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:44.391305 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370528f-094c-4718-9970-03d27c5ff16d None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:44.394371 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a36751-0ba6-42c9-8f95-bdaa9af3a5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:44.395188 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a36751-0ba6-42c9-8f95-bdaa9af3a5ad admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:44.395460 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a36751-0ba6-42c9-8f95-bdaa9af3a5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:44.395723 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a36751-0ba6-42c9-8f95-bdaa9af3a5ad admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:44.396974 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a36751-0ba6-42c9-8f95-bdaa9af3a5ad admin admin] RBAC: Authorizing `identity:get_project(project_id=cd4c62df74e348508599a155b573abec)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:44.398896 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a36751-0ba6-42c9-8f95-bdaa9af3a5ad admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:44.400050 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370528f-094c-4718-9970-03d27c5ff16d None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:44.405398 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 100/198] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:44 2022] GET /identity/v3/projects/cd4c62df74e348508599a155b573abec => generated 302 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:44.405524 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac2727-da6e-4dee-9e26-aa3012b16c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:44.405524 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac2727-da6e-4dee-9e26-aa3012b16c62 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:44.405524 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac2727-da6e-4dee-9e26-aa3012b16c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:44.405719 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac2727-da6e-4dee-9e26-aa3012b16c62 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:44.406107 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a36751-0ba6-42c9-8f95-bdaa9af3a5ad admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:44.406715 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac2727-da6e-4dee-9e26-aa3012b16c62 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:44.408510 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac2727-da6e-4dee-9e26-aa3012b16c62 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:44.410211 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 99/199] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:45:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:44.415177 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a36751-0ba6-42c9-8f95-bdaa9af3a5ad admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:44.415414 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac2727-da6e-4dee-9e26-aa3012b16c62 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:44.419498 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b100c44-47ee-49ef-8e4c-32893cbf3721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:44.420070 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b100c44-47ee-49ef-8e4c-32893cbf3721 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:44.420343 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b100c44-47ee-49ef-8e4c-32893cbf3721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:44.420608 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b100c44-47ee-49ef-8e4c-32893cbf3721 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:44.421449 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b100c44-47ee-49ef-8e4c-32893cbf3721 admin admin] RBAC: Adding query filter params (role.id=e06447c1c62d465c9f9c58168be71ed8, scope.project.id=cd4c62df74e348508599a155b573abec, user.id=dd7301ac43c340878098879ee250c39a) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:44.421754 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b100c44-47ee-49ef-8e4c-32893cbf3721 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:44.423537 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b100c44-47ee-49ef-8e4c-32893cbf3721 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:44.426271 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac2727-da6e-4dee-9e26-aa3012b16c62 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:44.428881 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 101/200] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:45:44 2022] GET /identity/v3/role_assignments?user.id=dd7301ac43c340878098879ee250c39a&scope.project.id=cd4c62df74e348508599a155b573abec&role.id=e06447c1c62d465c9f9c58168be71ed8 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:44.429640 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b100c44-47ee-49ef-8e4c-32893cbf3721 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:44.430575 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80c867-74e1-4012-b11b-1b9c92f67ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:44.431315 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80c867-74e1-4012-b11b-1b9c92f67ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:44.431594 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80c867-74e1-4012-b11b-1b9c92f67ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:44.431864 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80c867-74e1-4012-b11b-1b9c92f67ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:44.432677 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80c867-74e1-4012-b11b-1b9c92f67ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:44.435660 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80c867-74e1-4012-b11b-1b9c92f67ab4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:44.439077 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b100c44-47ee-49ef-8e4c-32893cbf3721 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:44.443410 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac586a-2d03-473d-8f46-00ecc0c4a955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:44.444237 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac586a-2d03-473d-8f46-00ecc0c4a955 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:44.444684 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac586a-2d03-473d-8f46-00ecc0c4a955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:44.444790 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac586a-2d03-473d-8f46-00ecc0c4a955 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:44.462307 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 100/201] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 10 20:45:44 2022] POST /identity/v3/users => generated 297 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:45:44.462509 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac586a-2d03-473d-8f46-00ecc0c4a955 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:44.472394 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-c5ac586a-2d03-473d-8f46-00ecc0c4a955 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 20:45:44.473690 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 102/202] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 10 20:45:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:44.480184 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80c867-74e1-4012-b11b-1b9c92f67ab4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:44.490727 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80c867-74e1-4012-b11b-1b9c92f67ab4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:44.495822 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1548b-9d57-453d-90d1-c049cf061793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:44.496537 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1548b-9d57-453d-90d1-c049cf061793 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:44.496782 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1548b-9d57-453d-90d1-c049cf061793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:44.497060 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1548b-9d57-453d-90d1-c049cf061793 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:44.497968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1548b-9d57-453d-90d1-c049cf061793 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:44.498261 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1548b-9d57-453d-90d1-c049cf061793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:44.500082 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1548b-9d57-453d-90d1-c049cf061793 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:44.512841 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 101/203] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:45:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:44.519015 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac586a-2d03-473d-8f46-00ecc0c4a955 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:44.530522 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac586a-2d03-473d-8f46-00ecc0c4a955 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:44.535967 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de114749-0a4f-4cff-9064-b44d54f08704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:44.536891 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de114749-0a4f-4cff-9064-b44d54f08704 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:44.537180 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de114749-0a4f-4cff-9064-b44d54f08704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:44.537474 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de114749-0a4f-4cff-9064-b44d54f08704 admin admin] PATH_INFO: `/v3/users/dd7301ac43c340878098879ee250c39a` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:44.540499 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de114749-0a4f-4cff-9064-b44d54f08704 admin admin] RBAC: Authorizing `identity:get_user(user_id=dd7301ac43c340878098879ee250c39a)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:44.541976 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de114749-0a4f-4cff-9064-b44d54f08704 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:44.544021 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 103/204] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:44 2022] GET /identity/v3/users/dd7301ac43c340878098879ee250c39a => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:44.550106 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1548b-9d57-453d-90d1-c049cf061793 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:44.560717 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1548b-9d57-453d-90d1-c049cf061793 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:44.565266 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9568d-1937-405d-8bbf-f4033cab6768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:44.566114 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9568d-1937-405d-8bbf-f4033cab6768 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:44.566397 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9568d-1937-405d-8bbf-f4033cab6768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:44.566667 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9568d-1937-405d-8bbf-f4033cab6768 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:44.575584 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9568d-1937-405d-8bbf-f4033cab6768 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:44.577530 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9568d-1937-405d-8bbf-f4033cab6768 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:44.587557 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 102/205] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:45:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:45:44.593990 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de114749-0a4f-4cff-9064-b44d54f08704 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:44.604356 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de114749-0a4f-4cff-9064-b44d54f08704 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:44.609376 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5a3fb-2c8b-4d9e-9715-cef4f0069d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:44.610324 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5a3fb-2c8b-4d9e-9715-cef4f0069d8a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:44.610602 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5a3fb-2c8b-4d9e-9715-cef4f0069d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:44.610867 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5a3fb-2c8b-4d9e-9715-cef4f0069d8a admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:44.612225 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5a3fb-2c8b-4d9e-9715-cef4f0069d8a admin admin] RBAC: Authorizing `identity:get_project(project_id=cd4c62df74e348508599a155b573abec)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:44.614378 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5a3fb-2c8b-4d9e-9715-cef4f0069d8a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:44.616398 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 104/206] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:44 2022] GET /identity/v3/projects/cd4c62df74e348508599a155b573abec => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:44.622408 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9568d-1937-405d-8bbf-f4033cab6768 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:44.632669 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9568d-1937-405d-8bbf-f4033cab6768 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:44.637777 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630d935-d6fc-4920-9c1d-be8e691de543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:44.638491 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630d935-d6fc-4920-9c1d-be8e691de543 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:44.638773 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630d935-d6fc-4920-9c1d-be8e691de543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:44.639039 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630d935-d6fc-4920-9c1d-be8e691de543 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:44.640049 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630d935-d6fc-4920-9c1d-be8e691de543 admin admin] RBAC: Adding query filter params (role.id=fbf072f915fc46ee9a80c656e2bb2b30, scope.project.id=cd4c62df74e348508599a155b573abec, user.id=dd7301ac43c340878098879ee250c39a) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:44.640360 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630d935-d6fc-4920-9c1d-be8e691de543 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:44.642403 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630d935-d6fc-4920-9c1d-be8e691de543 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:44.649106 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 103/207] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:45:44 2022] GET /identity/v3/role_assignments?user.id=dd7301ac43c340878098879ee250c39a&scope.project.id=cd4c62df74e348508599a155b573abec&role.id=fbf072f915fc46ee9a80c656e2bb2b30 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:46.653287 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a930058-ef96-44d7-9a2c-f92ea29bcac4 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:46.653828 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a930058-ef96-44d7-9a2c-f92ea29bcac4 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:46.653828 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a930058-ef96-44d7-9a2c-f92ea29bcac4 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:46.655788 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 105/208] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:46.661185 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba19cd-f2dd-42e7-bdca-2aa23104c195 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:46.661599 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba19cd-f2dd-42e7-bdca-2aa23104c195 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:46.661759 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba19cd-f2dd-42e7-bdca-2aa23104c195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:46.679829 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-f9ba19cd-f2dd-42e7-bdca-2aa23104c195 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:46.681008 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f9ba19cd-f2dd-42e7-bdca-2aa23104c195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:46.688626 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 104/209] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:45:46.711609 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a930058-ef96-44d7-9a2c-f92ea29bcac4 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:46.727318 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a930058-ef96-44d7-9a2c-f92ea29bcac4 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:46.731720 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35768fd-31a3-47aa-b344-4b43cb79bba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:46.732637 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35768fd-31a3-47aa-b344-4b43cb79bba2 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:46.732972 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35768fd-31a3-47aa-b344-4b43cb79bba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:46.733310 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35768fd-31a3-47aa-b344-4b43cb79bba2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:46.743969 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35768fd-31a3-47aa-b344-4b43cb79bba2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:46.750960 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-d35768fd-31a3-47aa-b344-4b43cb79bba2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:45:46.752427 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 106/210] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:45:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:46.758415 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba19cd-f2dd-42e7-bdca-2aa23104c195 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:46.767420 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba19cd-f2dd-42e7-bdca-2aa23104c195 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:46.771838 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf651939-af0a-43e8-9204-772edcc9d612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:46.772492 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf651939-af0a-43e8-9204-772edcc9d612 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:46.772766 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf651939-af0a-43e8-9204-772edcc9d612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:46.773032 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf651939-af0a-43e8-9204-772edcc9d612 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:46.773833 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf651939-af0a-43e8-9204-772edcc9d612 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:46.774133 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf651939-af0a-43e8-9204-772edcc9d612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:46.775720 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf651939-af0a-43e8-9204-772edcc9d612 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:46.784075 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 105/211] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:46.789523 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35768fd-31a3-47aa-b344-4b43cb79bba2 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:46.799486 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35768fd-31a3-47aa-b344-4b43cb79bba2 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:46.803789 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b772359-7d57-4d98-9172-e84eb28ff770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:46.804650 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b772359-7d57-4d98-9172-e84eb28ff770 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:46.804926 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b772359-7d57-4d98-9172-e84eb28ff770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:46.805194 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b772359-7d57-4d98-9172-e84eb28ff770 admin admin] PATH_INFO: `/v3/users/dd7301ac43c340878098879ee250c39a` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:46.806435 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b772359-7d57-4d98-9172-e84eb28ff770 admin admin] RBAC: Authorizing `identity:get_user(user_id=dd7301ac43c340878098879ee250c39a)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:46.808570 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b772359-7d57-4d98-9172-e84eb28ff770 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:46.810213 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 107/212] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:46 2022] GET /identity/v3/users/dd7301ac43c340878098879ee250c39a => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:46.815782 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf651939-af0a-43e8-9204-772edcc9d612 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:46.825501 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf651939-af0a-43e8-9204-772edcc9d612 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:46.829955 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b67c3-3ccd-4bc7-8910-e8a33bac26dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:46.830812 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b67c3-3ccd-4bc7-8910-e8a33bac26dc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:46.831088 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b67c3-3ccd-4bc7-8910-e8a33bac26dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:46.831352 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b67c3-3ccd-4bc7-8910-e8a33bac26dc admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:46.832549 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b67c3-3ccd-4bc7-8910-e8a33bac26dc admin admin] RBAC: Authorizing `identity:get_project(project_id=cd4c62df74e348508599a155b573abec)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:46.834643 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b67c3-3ccd-4bc7-8910-e8a33bac26dc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:46.836310 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 106/213] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:46 2022] GET /identity/v3/projects/cd4c62df74e348508599a155b573abec => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:46.842310 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b67c3-3ccd-4bc7-8910-e8a33bac26dc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:46.842507 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e48eb-97ef-42c7-9b29-1c0dc233301d None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:46.842676 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e48eb-97ef-42c7-9b29-1c0dc233301d None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:46.842879 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e48eb-97ef-42c7-9b29-1c0dc233301d None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:46.844651 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 108/214] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:46.849903 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7906f-f289-47b2-bc23-b1fb6d4e52c8 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:46.850196 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7906f-f289-47b2-bc23-b1fb6d4e52c8 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:46.850440 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7906f-f289-47b2-bc23-b1fb6d4e52c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:46.852041 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b67c3-3ccd-4bc7-8910-e8a33bac26dc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:46.856395 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589af70e-3a36-4651-9ad7-87a6fed03c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:46.857336 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589af70e-3a36-4651-9ad7-87a6fed03c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:46.858327 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589af70e-3a36-4651-9ad7-87a6fed03c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:46.858327 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589af70e-3a36-4651-9ad7-87a6fed03c10 admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec/users/dd7301ac43c340878098879ee250c39a/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:46.859841 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589af70e-3a36-4651-9ad7-87a6fed03c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4c62df74e348508599a155b573abec, user_id=dd7301ac43c340878098879ee250c39a, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:46.862525 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589af70e-3a36-4651-9ad7-87a6fed03c10 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:46.868369 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-64f7906f-f289-47b2-bc23-b1fb6d4e52c8 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:46.869576 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-64f7906f-f289-47b2-bc23-b1fb6d4e52c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:46.875759 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 107/215] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:45:46 2022] PUT /identity/v3/projects/cd4c62df74e348508599a155b573abec/users/dd7301ac43c340878098879ee250c39a/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:45:46.877149 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcc73d-2a35-45eb-84f0-76374d37f172 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:46.877504 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcc73d-2a35-45eb-84f0-76374d37f172 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:46.877776 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcc73d-2a35-45eb-84f0-76374d37f172 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:46.879596 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 108/216] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:46.881557 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11f158-ba81-41d9-8ea2-2d13ee552611 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:46.881557 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11f158-ba81-41d9-8ea2-2d13ee552611 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:46.881557 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11f158-ba81-41d9-8ea2-2d13ee552611 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:46.883341 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 109/217] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:46.886461 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77618660-b359-46a0-a933-91fe45d21641 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:46.886744 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77618660-b359-46a0-a933-91fe45d21641 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:46.887009 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77618660-b359-46a0-a933-91fe45d21641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:46.905604 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-77618660-b359-46a0-a933-91fe45d21641 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:46.906813 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-77618660-b359-46a0-a933-91fe45d21641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:46.932290 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 109/218] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:45:46.934073 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbec150-5e58-444f-b110-7cdf29fd9a67 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:46.934350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbec150-5e58-444f-b110-7cdf29fd9a67 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:46.934617 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbec150-5e58-444f-b110-7cdf29fd9a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:46.954418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-abbec150-5e58-444f-b110-7cdf29fd9a67 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:46.955695 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-abbec150-5e58-444f-b110-7cdf29fd9a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:46.963916 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 110/219] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:46.964634 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbec150-5e58-444f-b110-7cdf29fd9a67 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:46.974225 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbec150-5e58-444f-b110-7cdf29fd9a67 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:46.978864 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f807ce-04bf-4a51-a031-0452e8815585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:46.979732 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f807ce-04bf-4a51-a031-0452e8815585 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:46.980006 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f807ce-04bf-4a51-a031-0452e8815585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:46.980319 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f807ce-04bf-4a51-a031-0452e8815585 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:46.985328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 110/220] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:45:46.987236 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77618660-b359-46a0-a933-91fe45d21641 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:46.994910 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f807ce-04bf-4a51-a031-0452e8815585 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:46.997802 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77618660-b359-46a0-a933-91fe45d21641 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:47.002133 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-72f807ce-04bf-4a51-a031-0452e8815585 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 20:45:47.002308 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e27b0-89fd-4385-8a7f-9af2e19ae3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:47.003219 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e27b0-89fd-4385-8a7f-9af2e19ae3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:47.003689 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 111/221] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:47.003809 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e27b0-89fd-4385-8a7f-9af2e19ae3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:47.003809 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e27b0-89fd-4385-8a7f-9af2e19ae3f0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:47.009750 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f807ce-04bf-4a51-a031-0452e8815585 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:47.016258 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e27b0-89fd-4385-8a7f-9af2e19ae3f0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:47.019898 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f807ce-04bf-4a51-a031-0452e8815585 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:47.023753 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-238e27b0-89fd-4385-8a7f-9af2e19ae3f0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 20:45:47.024240 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feec06d-b03a-4e15-bd07-8e44c842eb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:47.024912 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feec06d-b03a-4e15-bd07-8e44c842eb63 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:47.025189 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feec06d-b03a-4e15-bd07-8e44c842eb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:47.025512 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feec06d-b03a-4e15-bd07-8e44c842eb63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:47.026285 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feec06d-b03a-4e15-bd07-8e44c842eb63 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:47.026597 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feec06d-b03a-4e15-bd07-8e44c842eb63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:47.028237 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feec06d-b03a-4e15-bd07-8e44c842eb63 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:47.029512 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 111/222] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 10 20:45:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:47.031094 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e27b0-89fd-4385-8a7f-9af2e19ae3f0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:47.038215 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 112/223] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:45:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:47.041304 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e27b0-89fd-4385-8a7f-9af2e19ae3f0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:47.043699 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feec06d-b03a-4e15-bd07-8e44c842eb63 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:47.045955 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c08af-5711-4713-923b-16c82bab9e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:47.046750 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c08af-5711-4713-923b-16c82bab9e70 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:47.047033 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c08af-5711-4713-923b-16c82bab9e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:47.047305 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c08af-5711-4713-923b-16c82bab9e70 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:47.048490 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c08af-5711-4713-923b-16c82bab9e70 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:47.050347 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c08af-5711-4713-923b-16c82bab9e70 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:47.051923 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 112/224] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:45:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:47.054159 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feec06d-b03a-4e15-bd07-8e44c842eb63 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:47.057099 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c08af-5711-4713-923b-16c82bab9e70 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:47.060323 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5841c-a267-4277-bf5a-67a0bfcdaace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:47.061047 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5841c-a267-4277-bf5a-67a0bfcdaace admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:47.061324 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5841c-a267-4277-bf5a-67a0bfcdaace admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:47.061628 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5841c-a267-4277-bf5a-67a0bfcdaace admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:47.062447 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5841c-a267-4277-bf5a-67a0bfcdaace admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:47.062693 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5841c-a267-4277-bf5a-67a0bfcdaace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:47.064306 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5841c-a267-4277-bf5a-67a0bfcdaace admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:47.070195 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c08af-5711-4713-923b-16c82bab9e70 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:47.073498 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 113/225] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:45:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:47.074338 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5841c-a267-4277-bf5a-67a0bfcdaace admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:47.075194 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c976c-5c3b-4781-aa08-1b8da9d23912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:47.076136 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c976c-5c3b-4781-aa08-1b8da9d23912 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:47.076417 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c976c-5c3b-4781-aa08-1b8da9d23912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:47.076686 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c976c-5c3b-4781-aa08-1b8da9d23912 admin admin] PATH_INFO: `/v3/users/c963069608484d6aa6a44039fd4369f4` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:47.084493 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5841c-a267-4277-bf5a-67a0bfcdaace admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:47.088947 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53155a-189e-46f2-84fa-6147ae40736c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:47.089634 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53155a-189e-46f2-84fa-6147ae40736c admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:47.089956 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53155a-189e-46f2-84fa-6147ae40736c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:47.090224 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53155a-189e-46f2-84fa-6147ae40736c admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:47.090555 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c976c-5c3b-4781-aa08-1b8da9d23912 admin admin] RBAC: Authorizing `identity:get_user(user_id=c963069608484d6aa6a44039fd4369f4)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:47.091033 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53155a-189e-46f2-84fa-6147ae40736c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:47.092747 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c976c-5c3b-4781-aa08-1b8da9d23912 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:47.093036 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53155a-189e-46f2-84fa-6147ae40736c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:47.094673 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 113/226] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:47 2022] GET /identity/v3/users/c963069608484d6aa6a44039fd4369f4 => generated 297 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:47.097391 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c976c-5c3b-4781-aa08-1b8da9d23912 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:47.106857 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c976c-5c3b-4781-aa08-1b8da9d23912 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:47.111529 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d02bd7-a4c9-4181-968d-e158ad5a8ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:47.112385 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d02bd7-a4c9-4181-968d-e158ad5a8ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:47.112659 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d02bd7-a4c9-4181-968d-e158ad5a8ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:47.112923 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d02bd7-a4c9-4181-968d-e158ad5a8ee1 admin admin] PATH_INFO: `/v3/users/dd7301ac43c340878098879ee250c39a` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:47.114139 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d02bd7-a4c9-4181-968d-e158ad5a8ee1 admin admin] RBAC: Authorizing `identity:get_user(user_id=dd7301ac43c340878098879ee250c39a)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:47.114651 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 114/227] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 10 20:45:47 2022] POST /identity/v3/users => generated 297 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:45:47.117515 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53155a-189e-46f2-84fa-6147ae40736c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:47.117653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d02bd7-a4c9-4181-968d-e158ad5a8ee1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:47.118029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 114/228] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:47 2022] GET /identity/v3/users/dd7301ac43c340878098879ee250c39a => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:47.123725 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d02bd7-a4c9-4181-968d-e158ad5a8ee1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:47.129713 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53155a-189e-46f2-84fa-6147ae40736c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:47.134302 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d02bd7-a4c9-4181-968d-e158ad5a8ee1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:47.134986 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ed76a-ff5c-405b-ba58-5eff1eedaa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:47.135664 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ed76a-ff5c-405b-ba58-5eff1eedaa78 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:47.135963 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ed76a-ff5c-405b-ba58-5eff1eedaa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:47.136263 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ed76a-ff5c-405b-ba58-5eff1eedaa78 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:47.140076 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf39c4b-3958-4726-9dd4-e18f1dfe2af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:47.141210 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf39c4b-3958-4726-9dd4-e18f1dfe2af0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:47.141694 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf39c4b-3958-4726-9dd4-e18f1dfe2af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:47.142117 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf39c4b-3958-4726-9dd4-e18f1dfe2af0 admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:47.143608 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf39c4b-3958-4726-9dd4-e18f1dfe2af0 admin admin] RBAC: Authorizing `identity:get_project(project_id=cd4c62df74e348508599a155b573abec)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:47.145840 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ed76a-ff5c-405b-ba58-5eff1eedaa78 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:47.146519 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf39c4b-3958-4726-9dd4-e18f1dfe2af0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:47.147791 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ed76a-ff5c-405b-ba58-5eff1eedaa78 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:47.148860 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 115/229] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:47 2022] GET /identity/v3/projects/cd4c62df74e348508599a155b573abec => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:47.155849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf39c4b-3958-4726-9dd4-e18f1dfe2af0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:47.159126 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 115/230] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:45:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:45:47.165405 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ed76a-ff5c-405b-ba58-5eff1eedaa78 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:47.169075 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf39c4b-3958-4726-9dd4-e18f1dfe2af0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:47.173814 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0777d-adb5-4d0b-8ed2-2252db831496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:47.174437 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ed76a-ff5c-405b-ba58-5eff1eedaa78 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:47.175112 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0777d-adb5-4d0b-8ed2-2252db831496 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:47.175533 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0777d-adb5-4d0b-8ed2-2252db831496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:47.175810 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0777d-adb5-4d0b-8ed2-2252db831496 admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec/users/dd7301ac43c340878098879ee250c39a/roles/fbf072f915fc46ee9a80c656e2bb2b30` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:47.178468 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0777d-adb5-4d0b-8ed2-2252db831496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4c62df74e348508599a155b573abec, user_id=dd7301ac43c340878098879ee250c39a, role_id=fbf072f915fc46ee9a80c656e2bb2b30)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:47.179871 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fe85b-429d-47da-a293-7c84010546b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:47.181034 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fe85b-429d-47da-a293-7c84010546b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:47.181272 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0777d-adb5-4d0b-8ed2-2252db831496 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:47.181636 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fe85b-429d-47da-a293-7c84010546b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:47.182069 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fe85b-429d-47da-a293-7c84010546b1 admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:47.183623 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fe85b-429d-47da-a293-7c84010546b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=cd4c62df74e348508599a155b573abec)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:47.186570 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fe85b-429d-47da-a293-7c84010546b1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:47.188996 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 116/231] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:47 2022] GET /identity/v3/projects/cd4c62df74e348508599a155b573abec => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:47.195342 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fe85b-429d-47da-a293-7c84010546b1 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:47.206011 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 116/232] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:45:47 2022] PUT /identity/v3/projects/cd4c62df74e348508599a155b573abec/users/dd7301ac43c340878098879ee250c39a/roles/fbf072f915fc46ee9a80c656e2bb2b30 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:45:47.207432 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fe85b-429d-47da-a293-7c84010546b1 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:47.280369 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e7469-c81e-4c33-86a6-af00df5fada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:47.281456 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e7469-c81e-4c33-86a6-af00df5fada3 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:47.281978 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e7469-c81e-4c33-86a6-af00df5fada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:47.282434 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e7469-c81e-4c33-86a6-af00df5fada3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:47.283484 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e7469-c81e-4c33-86a6-af00df5fada3 admin admin] RBAC: Adding query filter params (role.id=80e0463ac1aa4ef2b3739b580669f095, scope.project.id=cd4c62df74e348508599a155b573abec, user.id=c963069608484d6aa6a44039fd4369f4) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:47.284022 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e7469-c81e-4c33-86a6-af00df5fada3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:47.286387 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e7469-c81e-4c33-86a6-af00df5fada3 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:47.294049 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 117/233] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:45:47 2022] GET /identity/v3/role_assignments?user.id=c963069608484d6aa6a44039fd4369f4&scope.project.id=cd4c62df74e348508599a155b573abec&role.id=80e0463ac1aa4ef2b3739b580669f095 => generated 259 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:49.595608 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c789c-5239-4784-961c-f33204166c9b None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:49.596261 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c789c-5239-4784-961c-f33204166c9b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:49.596261 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c789c-5239-4784-961c-f33204166c9b None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:49.598388 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 117/234] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:49.605574 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f640a22-e944-487d-a5bc-4308d86c7647 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:49.606153 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f640a22-e944-487d-a5bc-4308d86c7647 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:49.606153 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f640a22-e944-487d-a5bc-4308d86c7647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:49.626555 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-6f640a22-e944-487d-a5bc-4308d86c7647 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:49.627749 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-6f640a22-e944-487d-a5bc-4308d86c7647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:49.635809 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 118/235] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:49.659648 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c789c-5239-4784-961c-f33204166c9b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:49.671979 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c789c-5239-4784-961c-f33204166c9b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:49.676290 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f85c9-00de-4b3c-9b31-49845990f7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:49.677084 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f85c9-00de-4b3c-9b31-49845990f7bf admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:49.677378 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f85c9-00de-4b3c-9b31-49845990f7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:49.677738 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f85c9-00de-4b3c-9b31-49845990f7bf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:49.688632 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f85c9-00de-4b3c-9b31-49845990f7bf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:49.695813 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-bf4f85c9-00de-4b3c-9b31-49845990f7bf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:45:49.697427 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 118/236] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:45:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:49.704180 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f640a22-e944-487d-a5bc-4308d86c7647 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:49.715662 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f640a22-e944-487d-a5bc-4308d86c7647 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:49.720611 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8df2b-e7a6-4c14-be2e-9728447cbc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:49.721725 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8df2b-e7a6-4c14-be2e-9728447cbc04 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:49.722203 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8df2b-e7a6-4c14-be2e-9728447cbc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:49.722673 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8df2b-e7a6-4c14-be2e-9728447cbc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:49.723566 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8df2b-e7a6-4c14-be2e-9728447cbc04 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:49.724007 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8df2b-e7a6-4c14-be2e-9728447cbc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:49.726850 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8df2b-e7a6-4c14-be2e-9728447cbc04 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:49.741000 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 119/237] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:49.748143 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f85c9-00de-4b3c-9b31-49845990f7bf admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:49.764176 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f85c9-00de-4b3c-9b31-49845990f7bf admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:49.771544 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee22d7-b538-4a99-9cc8-d38ec7984230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:49.772461 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee22d7-b538-4a99-9cc8-d38ec7984230 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:49.772732 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee22d7-b538-4a99-9cc8-d38ec7984230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:49.772988 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee22d7-b538-4a99-9cc8-d38ec7984230 admin admin] PATH_INFO: `/v3/users/dd7301ac43c340878098879ee250c39a` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:49.774369 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee22d7-b538-4a99-9cc8-d38ec7984230 admin admin] RBAC: Authorizing `identity:get_user(user_id=dd7301ac43c340878098879ee250c39a)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:49.777510 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee22d7-b538-4a99-9cc8-d38ec7984230 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:49.779920 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 119/238] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:49 2022] GET /identity/v3/users/dd7301ac43c340878098879ee250c39a => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:49.787345 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8df2b-e7a6-4c14-be2e-9728447cbc04 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:49.803168 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8df2b-e7a6-4c14-be2e-9728447cbc04 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:49.811414 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72736b-c0e4-4bad-bb3c-29043a27bf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:49.812060 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72736b-c0e4-4bad-bb3c-29043a27bf8d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:49.812337 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72736b-c0e4-4bad-bb3c-29043a27bf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:49.812600 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72736b-c0e4-4bad-bb3c-29043a27bf8d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:49.825326 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72736b-c0e4-4bad-bb3c-29043a27bf8d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:49.827303 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72736b-c0e4-4bad-bb3c-29043a27bf8d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:49.836664 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 120/239] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:45:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:45:49.842934 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee22d7-b538-4a99-9cc8-d38ec7984230 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:49.857060 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee22d7-b538-4a99-9cc8-d38ec7984230 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:49.861891 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308fee9-1f11-44a9-9a46-468dbebfd82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:49.862736 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308fee9-1f11-44a9-9a46-468dbebfd82a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:49.863012 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308fee9-1f11-44a9-9a46-468dbebfd82a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:49.863278 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308fee9-1f11-44a9-9a46-468dbebfd82a admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:49.870135 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308fee9-1f11-44a9-9a46-468dbebfd82a admin admin] RBAC: Authorizing `identity:get_project(project_id=cd4c62df74e348508599a155b573abec)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:49.873007 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308fee9-1f11-44a9-9a46-468dbebfd82a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:49.874777 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 120/240] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:49 2022] GET /identity/v3/projects/cd4c62df74e348508599a155b573abec => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:49.880821 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72736b-c0e4-4bad-bb3c-29043a27bf8d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:49.894707 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72736b-c0e4-4bad-bb3c-29043a27bf8d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:49.903390 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6dad9-2f2f-4430-bc09-8eedc672d386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:49.904059 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6dad9-2f2f-4430-bc09-8eedc672d386 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:49.904333 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6dad9-2f2f-4430-bc09-8eedc672d386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:49.904597 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6dad9-2f2f-4430-bc09-8eedc672d386 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:49.905481 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6dad9-2f2f-4430-bc09-8eedc672d386 admin admin] RBAC: Adding query filter params (role.id=e06447c1c62d465c9f9c58168be71ed8, scope.project.id=cd4c62df74e348508599a155b573abec, user.id=dd7301ac43c340878098879ee250c39a) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:49.905783 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6dad9-2f2f-4430-bc09-8eedc672d386 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:49.907613 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6dad9-2f2f-4430-bc09-8eedc672d386 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:49.914737 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 121/241] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:45:49 2022] GET /identity/v3/role_assignments?user.id=dd7301ac43c340878098879ee250c39a&scope.project.id=cd4c62df74e348508599a155b573abec&role.id=e06447c1c62d465c9f9c58168be71ed8 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:49.995438 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112af2a4-c809-4c72-84ec-11238e9d8a41 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:49.995875 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112af2a4-c809-4c72-84ec-11238e9d8a41 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:49.996040 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112af2a4-c809-4c72-84ec-11238e9d8a41 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:49.997909 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 121/242] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:50.004785 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df89b7-0b37-45c3-9b94-e9b321f78956 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.005077 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df89b7-0b37-45c3-9b94-e9b321f78956 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.005311 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df89b7-0b37-45c3-9b94-e9b321f78956 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.007251 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 122/243] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:45:50.007787 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fd291-fc3c-4907-8a18-1254a27e7a8c None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.008064 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fd291-fc3c-4907-8a18-1254a27e7a8c None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.008328 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fd291-fc3c-4907-8a18-1254a27e7a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.015742 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83217-c065-41f1-9ab5-42387c844fcd None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.016145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83217-c065-41f1-9ab5-42387c844fcd None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.016375 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83217-c065-41f1-9ab5-42387c844fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.046970 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-f1b83217-c065-41f1-9ab5-42387c844fcd None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:50.048303 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f1b83217-c065-41f1-9ab5-42387c844fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:50.050418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-305fd291-fc3c-4907-8a18-1254a27e7a8c None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:50.051593 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-305fd291-fc3c-4907-8a18-1254a27e7a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:50.063954 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 123/244] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Feb 10 20:45:50.065803 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 122/245] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:50.101610 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b83217-c065-41f1-9ab5-42387c844fcd None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:50.103077 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fd291-fc3c-4907-8a18-1254a27e7a8c None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:50.115085 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b83217-c065-41f1-9ab5-42387c844fcd None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:50.115415 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fd291-fc3c-4907-8a18-1254a27e7a8c None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:50.119735 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1869365-7851-4bb7-aca2-7a60e5581a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:50.120011 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a8b36-4485-439c-926b-6f26182f0336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:50.120556 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1869365-7851-4bb7-aca2-7a60e5581a2c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.120738 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a8b36-4485-439c-926b-6f26182f0336 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.120881 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1869365-7851-4bb7-aca2-7a60e5581a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.121018 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a8b36-4485-439c-926b-6f26182f0336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.121153 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1869365-7851-4bb7-aca2-7a60e5581a2c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.121318 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a8b36-4485-439c-926b-6f26182f0336 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.135892 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1869365-7851-4bb7-aca2-7a60e5581a2c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:50.136273 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a8b36-4485-439c-926b-6f26182f0336 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:50.142101 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-d1869365-7851-4bb7-aca2-7a60e5581a2c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 20:45:50.143071 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-080a8b36-4485-439c-926b-6f26182f0336 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 20:45:50.143601 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 123/246] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 10 20:45:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:50.144350 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 124/247] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:50.144995 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15597cf4-2227-463f-9172-0638e0687a36 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.145270 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15597cf4-2227-463f-9172-0638e0687a36 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.145674 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15597cf4-2227-463f-9172-0638e0687a36 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.147474 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 124/248] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:50.150515 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a8b36-4485-439c-926b-6f26182f0336 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:50.153593 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcb756-1da3-4180-ab62-d6bd61ee79a2 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.153906 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcb756-1da3-4180-ab62-d6bd61ee79a2 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.154181 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcb756-1da3-4180-ab62-d6bd61ee79a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.165915 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a8b36-4485-439c-926b-6f26182f0336 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:50.173040 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aabe49-2ebe-4663-9e0a-0b6551b66271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:50.173821 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aabe49-2ebe-4663-9e0a-0b6551b66271 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.174140 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aabe49-2ebe-4663-9e0a-0b6551b66271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.174410 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aabe49-2ebe-4663-9e0a-0b6551b66271 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.175172 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aabe49-2ebe-4663-9e0a-0b6551b66271 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:50.175474 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aabe49-2ebe-4663-9e0a-0b6551b66271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:50.177237 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aabe49-2ebe-4663-9e0a-0b6551b66271 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:50.178323 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-a0fcb756-1da3-4180-ab62-d6bd61ee79a2 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:50.179505 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-a0fcb756-1da3-4180-ab62-d6bd61ee79a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:50.186750 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 125/249] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:45:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:50.187574 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aabe49-2ebe-4663-9e0a-0b6551b66271 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:50.188781 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 125/250] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:50.193518 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86e995-1760-4214-b9c3-61b5c4897f23 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.193803 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86e995-1760-4214-b9c3-61b5c4897f23 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.194074 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86e995-1760-4214-b9c3-61b5c4897f23 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.196055 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 126/251] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:50.196665 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86e995-1760-4214-b9c3-61b5c4897f23 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:50.198408 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aabe49-2ebe-4663-9e0a-0b6551b66271 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:50.202892 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e582b45-eb79-44f8-aafc-bfbd7c9b5d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:50.203544 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e582b45-eb79-44f8-aafc-bfbd7c9b5d43 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.203816 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e582b45-eb79-44f8-aafc-bfbd7c9b5d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.204079 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e582b45-eb79-44f8-aafc-bfbd7c9b5d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.204822 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e582b45-eb79-44f8-aafc-bfbd7c9b5d43 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:50.205137 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e582b45-eb79-44f8-aafc-bfbd7c9b5d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:50.206936 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e582b45-eb79-44f8-aafc-bfbd7c9b5d43 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:50.214639 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86e995-1760-4214-b9c3-61b5c4897f23 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:50.217711 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 126/252] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:45:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:50.219141 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf618fd4-a20b-4920-b35a-ffe1d0b50010 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.219248 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf618fd4-a20b-4920-b35a-ffe1d0b50010 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.219504 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf618fd4-a20b-4920-b35a-ffe1d0b50010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.222521 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df99800-d226-45b9-9c90-053cbfffc1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:50.223647 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df99800-d226-45b9-9c90-053cbfffc1ca admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.223925 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df99800-d226-45b9-9c90-053cbfffc1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.224185 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df99800-d226-45b9-9c90-053cbfffc1ca admin admin] PATH_INFO: `/v3/users/c9b1d8b3aed9445c8d017f3dcf9ca618` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.239892 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-cf618fd4-a20b-4920-b35a-ffe1d0b50010 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:50.241076 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-cf618fd4-a20b-4920-b35a-ffe1d0b50010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:50.242435 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df99800-d226-45b9-9c90-053cbfffc1ca admin admin] RBAC: Authorizing `identity:get_user(user_id=c9b1d8b3aed9445c8d017f3dcf9ca618)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:50.244748 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df99800-d226-45b9-9c90-053cbfffc1ca admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:50.246737 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 127/253] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:50 2022] GET /identity/v3/users/c9b1d8b3aed9445c8d017f3dcf9ca618 => generated 297 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:50.247688 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df99800-d226-45b9-9c90-053cbfffc1ca admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:50.251137 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 127/254] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:50.252139 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf618fd4-a20b-4920-b35a-ffe1d0b50010 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:50.260523 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df99800-d226-45b9-9c90-053cbfffc1ca admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:50.265669 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf618fd4-a20b-4920-b35a-ffe1d0b50010 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:50.267765 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7c694-e4cf-4bb4-a8e9-de06f8e7a6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:50.268625 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7c694-e4cf-4bb4-a8e9-de06f8e7a6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.268906 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7c694-e4cf-4bb4-a8e9-de06f8e7a6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.269178 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7c694-e4cf-4bb4-a8e9-de06f8e7a6a5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.271648 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3594f64-d7f3-4d2e-ae04-44fa4646cdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:50.273062 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3594f64-d7f3-4d2e-ae04-44fa4646cdd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.273574 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3594f64-d7f3-4d2e-ae04-44fa4646cdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.274037 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3594f64-d7f3-4d2e-ae04-44fa4646cdd0 admin admin] PATH_INFO: `/v3/users/dd7301ac43c340878098879ee250c39a` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.275828 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3594f64-d7f3-4d2e-ae04-44fa4646cdd0 admin admin] RBAC: Authorizing `identity:get_user(user_id=dd7301ac43c340878098879ee250c39a)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:50.278711 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3594f64-d7f3-4d2e-ae04-44fa4646cdd0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:50.280219 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7c694-e4cf-4bb4-a8e9-de06f8e7a6a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:50.280367 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 128/255] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:50 2022] GET /identity/v3/users/dd7301ac43c340878098879ee250c39a => generated 283 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:50.281092 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3594f64-d7f3-4d2e-ae04-44fa4646cdd0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:50.287417 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-add7c694-e4cf-4bb4-a8e9-de06f8e7a6a5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 20:45:50.288714 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 128/256] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:50.289390 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7c694-e4cf-4bb4-a8e9-de06f8e7a6a5 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:50.292103 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3594f64-d7f3-4d2e-ae04-44fa4646cdd0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:50.296380 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22697fac-b2ca-4023-953d-13b8baea0cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:50.297004 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22697fac-b2ca-4023-953d-13b8baea0cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.297276 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22697fac-b2ca-4023-953d-13b8baea0cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.297586 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22697fac-b2ca-4023-953d-13b8baea0cb9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.299381 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7c694-e4cf-4bb4-a8e9-de06f8e7a6a5 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:50.303603 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403af84-6311-4fe2-a259-066be1bef1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:50.304353 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403af84-6311-4fe2-a259-066be1bef1dd admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.304631 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403af84-6311-4fe2-a259-066be1bef1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.304901 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403af84-6311-4fe2-a259-066be1bef1dd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.305480 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22697fac-b2ca-4023-953d-13b8baea0cb9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:50.306072 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2403af84-6311-4fe2-a259-066be1bef1dd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:50.307200 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22697fac-b2ca-4023-953d-13b8baea0cb9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:50.307744 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2403af84-6311-4fe2-a259-066be1bef1dd admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:50.309312 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 129/257] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:45:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:50.310075 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403af84-6311-4fe2-a259-066be1bef1dd admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:50.316498 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 129/258] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:45:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:45:50.316787 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22697fac-b2ca-4023-953d-13b8baea0cb9 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:50.319890 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403af84-6311-4fe2-a259-066be1bef1dd admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:50.324586 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ade0d-d5f2-4dc0-84b8-4c6ad85bfd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:50.325218 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ade0d-d5f2-4dc0-84b8-4c6ad85bfd97 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.325524 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ade0d-d5f2-4dc0-84b8-4c6ad85bfd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.325754 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22697fac-b2ca-4023-953d-13b8baea0cb9 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:50.325857 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ade0d-d5f2-4dc0-84b8-4c6ad85bfd97 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.330014 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278de5f-7572-4580-aaeb-b32eb5911dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:50.330678 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278de5f-7572-4580-aaeb-b32eb5911dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.330952 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278de5f-7572-4580-aaeb-b32eb5911dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.331223 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278de5f-7572-4580-aaeb-b32eb5911dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.331972 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278de5f-7572-4580-aaeb-b32eb5911dc7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:50.332271 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278de5f-7572-4580-aaeb-b32eb5911dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:50.333897 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278de5f-7572-4580-aaeb-b32eb5911dc7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:50.334241 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ade0d-d5f2-4dc0-84b8-4c6ad85bfd97 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:50.335945 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ade0d-d5f2-4dc0-84b8-4c6ad85bfd97 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:50.342092 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 130/259] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:45:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:50.342855 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278de5f-7572-4580-aaeb-b32eb5911dc7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:50.346457 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 130/260] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:45:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:45:50.346457 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ade0d-d5f2-4dc0-84b8-4c6ad85bfd97 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:50.352198 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278de5f-7572-4580-aaeb-b32eb5911dc7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:50.356078 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ade0d-d5f2-4dc0-84b8-4c6ad85bfd97 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:50.356730 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9f38b-a91a-4630-b714-61753a588fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:50.357404 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9f38b-a91a-4630-b714-61753a588fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.357691 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9f38b-a91a-4630-b714-61753a588fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.357961 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9f38b-a91a-4630-b714-61753a588fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.358674 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9f38b-a91a-4630-b714-61753a588fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:50.360541 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da587b04-3ab2-47d5-af59-1c5b0a82d231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:50.360638 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9f38b-a91a-4630-b714-61753a588fe7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:50.361366 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da587b04-3ab2-47d5-af59-1c5b0a82d231 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.361657 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da587b04-3ab2-47d5-af59-1c5b0a82d231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.361946 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da587b04-3ab2-47d5-af59-1c5b0a82d231 admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.363082 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da587b04-3ab2-47d5-af59-1c5b0a82d231 admin admin] RBAC: Authorizing `identity:get_project(project_id=cd4c62df74e348508599a155b573abec)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:50.365072 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da587b04-3ab2-47d5-af59-1c5b0a82d231 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:50.366739 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 131/261] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:50 2022] GET /identity/v3/projects/cd4c62df74e348508599a155b573abec => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:50.367463 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da587b04-3ab2-47d5-af59-1c5b0a82d231 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:50.381199 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 131/262] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 10 20:45:50 2022] POST /identity/v3/users => generated 293 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:45:50.383464 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da587b04-3ab2-47d5-af59-1c5b0a82d231 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:50.386556 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9f38b-a91a-4630-b714-61753a588fe7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:50.388183 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8c9f8-7dbd-4639-8970-300976a4b3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:50.389073 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8c9f8-7dbd-4639-8970-300976a4b3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.389431 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8c9f8-7dbd-4639-8970-300976a4b3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.389699 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8c9f8-7dbd-4639-8970-300976a4b3f3 admin admin] PATH_INFO: `/v3/users/c963069608484d6aa6a44039fd4369f4` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.390943 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8c9f8-7dbd-4639-8970-300976a4b3f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=c963069608484d6aa6a44039fd4369f4)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:50.393088 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8c9f8-7dbd-4639-8970-300976a4b3f3 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:50.395157 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 132/263] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:50 2022] GET /identity/v3/users/c963069608484d6aa6a44039fd4369f4 => generated 297 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:50.396812 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9f38b-a91a-4630-b714-61753a588fe7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:50.400703 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8c9f8-7dbd-4639-8970-300976a4b3f3 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:50.402484 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff992127-06f5-4325-8c87-675a116b123a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:50.403517 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff992127-06f5-4325-8c87-675a116b123a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.403848 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff992127-06f5-4325-8c87-675a116b123a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.404168 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff992127-06f5-4325-8c87-675a116b123a admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.406133 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff992127-06f5-4325-8c87-675a116b123a admin admin] RBAC: Authorizing `identity:get_project(project_id=cd4c62df74e348508599a155b573abec)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:50.408557 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff992127-06f5-4325-8c87-675a116b123a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:50.410636 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 132/264] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:50 2022] GET /identity/v3/projects/cd4c62df74e348508599a155b573abec => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:50.410906 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8c9f8-7dbd-4639-8970-300976a4b3f3 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:50.411277 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff992127-06f5-4325-8c87-675a116b123a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:50.415439 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8469500-63fa-432e-aac4-eea1e389d3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:50.416100 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8469500-63fa-432e-aac4-eea1e389d3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.416379 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8469500-63fa-432e-aac4-eea1e389d3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.416646 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8469500-63fa-432e-aac4-eea1e389d3c7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.417536 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8469500-63fa-432e-aac4-eea1e389d3c7 admin admin] RBAC: Adding query filter params (role.id=b235f70dfa2a42308edd90003e99cd24, scope.project.id=cd4c62df74e348508599a155b573abec, user.id=c9b1d8b3aed9445c8d017f3dcf9ca618) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:50.417851 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8469500-63fa-432e-aac4-eea1e389d3c7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:50.419748 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8469500-63fa-432e-aac4-eea1e389d3c7 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:50.422143 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff992127-06f5-4325-8c87-675a116b123a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:50.426835 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 133/265] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:45:50 2022] GET /identity/v3/role_assignments?user.id=c9b1d8b3aed9445c8d017f3dcf9ca618&scope.project.id=cd4c62df74e348508599a155b573abec&role.id=b235f70dfa2a42308edd90003e99cd24 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:50.427437 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8469500-63fa-432e-aac4-eea1e389d3c7 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:50.434948 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce2aae-a4a4-4b9e-a2c2-413a079c6f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:50.436770 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce2aae-a4a4-4b9e-a2c2-413a079c6f42 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.437306 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce2aae-a4a4-4b9e-a2c2-413a079c6f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.437876 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce2aae-a4a4-4b9e-a2c2-413a079c6f42 admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.438565 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8469500-63fa-432e-aac4-eea1e389d3c7 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:50.439987 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce2aae-a4a4-4b9e-a2c2-413a079c6f42 admin admin] RBAC: Authorizing `identity:get_project(project_id=cd4c62df74e348508599a155b573abec)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:50.443395 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce2aae-a4a4-4b9e-a2c2-413a079c6f42 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:50.444471 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd130d8-497a-436f-8109-b45ea24163a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:50.445281 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd130d8-497a-436f-8109-b45ea24163a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.445713 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd130d8-497a-436f-8109-b45ea24163a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.446105 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd130d8-497a-436f-8109-b45ea24163a3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.446565 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 133/266] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:50 2022] GET /identity/v3/projects/cd4c62df74e348508599a155b573abec => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:50.447578 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd130d8-497a-436f-8109-b45ea24163a3 admin admin] RBAC: Adding query filter params (role.id=fbf072f915fc46ee9a80c656e2bb2b30, scope.project.id=cd4c62df74e348508599a155b573abec, user.id=dd7301ac43c340878098879ee250c39a) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:50.447953 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd130d8-497a-436f-8109-b45ea24163a3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:50.449991 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd130d8-497a-436f-8109-b45ea24163a3 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:50.453082 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce2aae-a4a4-4b9e-a2c2-413a079c6f42 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:50.458384 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 134/267] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:45:50 2022] GET /identity/v3/role_assignments?user.id=dd7301ac43c340878098879ee250c39a&scope.project.id=cd4c62df74e348508599a155b573abec&role.id=fbf072f915fc46ee9a80c656e2bb2b30 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:50.470566 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce2aae-a4a4-4b9e-a2c2-413a079c6f42 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:50.476413 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf19a0-8117-4ef6-a3a1-09f75f36c53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:50.477743 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf19a0-8117-4ef6-a3a1-09f75f36c53b admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:50.478306 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf19a0-8117-4ef6-a3a1-09f75f36c53b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:50.478731 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf19a0-8117-4ef6-a3a1-09f75f36c53b admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec/users/c963069608484d6aa6a44039fd4369f4/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:50.481607 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf19a0-8117-4ef6-a3a1-09f75f36c53b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4c62df74e348508599a155b573abec, user_id=c963069608484d6aa6a44039fd4369f4, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:50.484912 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf19a0-8117-4ef6-a3a1-09f75f36c53b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:50.503468 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 134/268] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:45:50 2022] PUT /identity/v3/projects/cd4c62df74e348508599a155b573abec/users/c963069608484d6aa6a44039fd4369f4/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:45:52.683112 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed7b60-8b54-4cdb-9d3c-d180e3740723 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:52.683635 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed7b60-8b54-4cdb-9d3c-d180e3740723 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:52.683635 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed7b60-8b54-4cdb-9d3c-d180e3740723 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:52.685699 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 135/269] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:52.691044 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c3aab-170b-47e8-8865-d5384af81302 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:52.691464 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c3aab-170b-47e8-8865-d5384af81302 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:52.691636 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c3aab-170b-47e8-8865-d5384af81302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:52.709986 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-8f6c3aab-170b-47e8-8865-d5384af81302 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:52.711179 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8f6c3aab-170b-47e8-8865-d5384af81302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:52.769401 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 135/270] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:52.774685 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128700f1-040a-4acd-96fc-acd6eb0d4f0c None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:52.774959 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128700f1-040a-4acd-96fc-acd6eb0d4f0c None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:52.775231 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128700f1-040a-4acd-96fc-acd6eb0d4f0c None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:52.777001 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 136/271] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:52.782231 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c05607-083a-408d-9aa4-d0d4effe808e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:52.782513 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c05607-083a-408d-9aa4-d0d4effe808e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:52.782784 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c05607-083a-408d-9aa4-d0d4effe808e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:52.793608 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128700f1-040a-4acd-96fc-acd6eb0d4f0c None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:52.801593 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-75c05607-083a-408d-9aa4-d0d4effe808e None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:52.802769 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-75c05607-083a-408d-9aa4-d0d4effe808e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:52.805691 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128700f1-040a-4acd-96fc-acd6eb0d4f0c None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:52.809797 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a445e1-9ecc-4c28-b79d-79aa087c22c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:52.810568 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 136/272] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:45:52.810683 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a445e1-9ecc-4c28-b79d-79aa087c22c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:52.813475 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a445e1-9ecc-4c28-b79d-79aa087c22c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:52.813475 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a445e1-9ecc-4c28-b79d-79aa087c22c6 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:52.813646 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8d501-478d-4434-82f0-e8a24d9f2796 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:52.813646 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8d501-478d-4434-82f0-e8a24d9f2796 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:52.813646 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8d501-478d-4434-82f0-e8a24d9f2796 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:52.813845 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 137/273] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:52.819268 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac8838-db18-4108-81ce-044bdf0a59f9 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:52.819618 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac8838-db18-4108-81ce-044bdf0a59f9 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:52.819893 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac8838-db18-4108-81ce-044bdf0a59f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:52.825195 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a445e1-9ecc-4c28-b79d-79aa087c22c6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:52.832212 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-a1a445e1-9ecc-4c28-b79d-79aa087c22c6 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 20:45:52.833599 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 137/274] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:45:52.838434 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a445e1-9ecc-4c28-b79d-79aa087c22c6 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:52.838691 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-35ac8838-db18-4108-81ce-044bdf0a59f9 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:52.839874 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-35ac8838-db18-4108-81ce-044bdf0a59f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:52.847660 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 138/275] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:45:52.848325 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a445e1-9ecc-4c28-b79d-79aa087c22c6 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:52.852696 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448e79f-c4a5-4690-97d1-c91627a3b2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:52.853663 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448e79f-c4a5-4690-97d1-c91627a3b2fb admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:52.853940 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448e79f-c4a5-4690-97d1-c91627a3b2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:52.854264 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448e79f-c4a5-4690-97d1-c91627a3b2fb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:52.854981 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac8838-db18-4108-81ce-044bdf0a59f9 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:52.864559 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448e79f-c4a5-4690-97d1-c91627a3b2fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:52.865895 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac8838-db18-4108-81ce-044bdf0a59f9 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:52.870553 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5439529-7dcb-41e6-b252-325fd3a910ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:52.871199 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5439529-7dcb-41e6-b252-325fd3a910ad admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:52.871472 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5439529-7dcb-41e6-b252-325fd3a910ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:52.871569 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-e448e79f-c4a5-4690-97d1-c91627a3b2fb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 20:45:52.871737 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5439529-7dcb-41e6-b252-325fd3a910ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:52.872483 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5439529-7dcb-41e6-b252-325fd3a910ad admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:52.872843 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 138/276] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:52.872943 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5439529-7dcb-41e6-b252-325fd3a910ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:52.874500 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5439529-7dcb-41e6-b252-325fd3a910ad admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:52.875593 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448e79f-c4a5-4690-97d1-c91627a3b2fb admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:52.887252 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 139/277] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:45:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:52.887252 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c481978-f4d9-440c-9121-d5b805bd9e80 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:52.887480 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448e79f-c4a5-4690-97d1-c91627a3b2fb admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:52.887566 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c481978-f4d9-440c-9121-d5b805bd9e80 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:52.887566 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c481978-f4d9-440c-9121-d5b805bd9e80 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:52.887566 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 140/278] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:52.887787 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c481978-f4d9-440c-9121-d5b805bd9e80 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:52.892304 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce7bdb-b822-4275-b547-6a3d328fb945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:52.893074 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce7bdb-b822-4275-b547-6a3d328fb945 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:52.893379 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce7bdb-b822-4275-b547-6a3d328fb945 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:52.893670 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce7bdb-b822-4275-b547-6a3d328fb945 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:52.899553 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c481978-f4d9-440c-9121-d5b805bd9e80 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:52.903647 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94490a6c-b3d9-4ca0-84eb-dbb8a0ff7b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:52.904241 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94490a6c-b3d9-4ca0-84eb-dbb8a0ff7b62 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:52.904505 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce7bdb-b822-4275-b547-6a3d328fb945 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:52.904612 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94490a6c-b3d9-4ca0-84eb-dbb8a0ff7b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:52.904770 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94490a6c-b3d9-4ca0-84eb-dbb8a0ff7b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:52.905543 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94490a6c-b3d9-4ca0-84eb-dbb8a0ff7b62 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:52.905837 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94490a6c-b3d9-4ca0-84eb-dbb8a0ff7b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:52.907416 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94490a6c-b3d9-4ca0-84eb-dbb8a0ff7b62 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:52.911300 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-6fce7bdb-b822-4275-b547-6a3d328fb945 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 20:45:52.912469 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 139/279] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:52.914175 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce7bdb-b822-4275-b547-6a3d328fb945 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:52.919840 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 141/280] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:45:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:52.919840 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0474313-1fd1-4823-9c4f-51f77cdb52c9 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:52.919840 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0474313-1fd1-4823-9c4f-51f77cdb52c9 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:52.919840 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0474313-1fd1-4823-9c4f-51f77cdb52c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:52.923599 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce7bdb-b822-4275-b547-6a3d328fb945 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:52.927787 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106d134-9601-46be-9985-74c91d39c24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:52.928704 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106d134-9601-46be-9985-74c91d39c24a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:52.929442 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106d134-9601-46be-9985-74c91d39c24a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:52.929442 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106d134-9601-46be-9985-74c91d39c24a admin admin] PATH_INFO: `/v3/users/c9b1d8b3aed9445c8d017f3dcf9ca618` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:52.930549 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106d134-9601-46be-9985-74c91d39c24a admin admin] RBAC: Authorizing `identity:get_user(user_id=c9b1d8b3aed9445c8d017f3dcf9ca618)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:52.932736 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106d134-9601-46be-9985-74c91d39c24a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:52.934211 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e0474313-1fd1-4823-9c4f-51f77cdb52c9 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:52.934398 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 140/281] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:52 2022] GET /identity/v3/users/c9b1d8b3aed9445c8d017f3dcf9ca618 => generated 297 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:52.935075 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106d134-9601-46be-9985-74c91d39c24a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:52.935707 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e0474313-1fd1-4823-9c4f-51f77cdb52c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:52.945290 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 142/282] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:52.946121 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0474313-1fd1-4823-9c4f-51f77cdb52c9 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:52.947872 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106d134-9601-46be-9985-74c91d39c24a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:52.951971 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6014256-a945-4772-bec9-e86f7039a22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:52.952580 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6014256-a945-4772-bec9-e86f7039a22f admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:52.952856 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6014256-a945-4772-bec9-e86f7039a22f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:52.953131 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6014256-a945-4772-bec9-e86f7039a22f admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:52.953897 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6014256-a945-4772-bec9-e86f7039a22f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:52.954192 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6014256-a945-4772-bec9-e86f7039a22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:52.955721 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6014256-a945-4772-bec9-e86f7039a22f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:52.958441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0474313-1fd1-4823-9c4f-51f77cdb52c9 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:52.963064 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f419123-b549-41f7-ae64-dd38ca6088b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:52.963895 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 141/283] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:45:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:52.964219 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f419123-b549-41f7-ae64-dd38ca6088b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:52.964620 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f419123-b549-41f7-ae64-dd38ca6088b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:52.964728 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6014256-a945-4772-bec9-e86f7039a22f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:52.965114 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f419123-b549-41f7-ae64-dd38ca6088b1 admin admin] PATH_INFO: `/v3/users/c963069608484d6aa6a44039fd4369f4` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:52.969332 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f419123-b549-41f7-ae64-dd38ca6088b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=c963069608484d6aa6a44039fd4369f4)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:52.971518 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f419123-b549-41f7-ae64-dd38ca6088b1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:52.973121 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 143/284] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:52 2022] GET /identity/v3/users/c963069608484d6aa6a44039fd4369f4 => generated 297 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:52.973884 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f419123-b549-41f7-ae64-dd38ca6088b1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:52.978647 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6014256-a945-4772-bec9-e86f7039a22f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:52.982874 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f419123-b549-41f7-ae64-dd38ca6088b1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:52.983069 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bf3c0-e522-4166-a382-a38141db8cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:52.983886 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bf3c0-e522-4166-a382-a38141db8cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:52.984163 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bf3c0-e522-4166-a382-a38141db8cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:52.984427 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bf3c0-e522-4166-a382-a38141db8cc8 admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:52.985594 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61bf3c0-e522-4166-a382-a38141db8cc8 admin admin] RBAC: Authorizing `identity:get_project(project_id=cd4c62df74e348508599a155b573abec)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:52.987159 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8c873-40af-4302-a4a6-e210697b8572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:52.987590 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61bf3c0-e522-4166-a382-a38141db8cc8 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:52.987963 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8c873-40af-4302-a4a6-e210697b8572 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:52.988242 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8c873-40af-4302-a4a6-e210697b8572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:52.988509 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8c873-40af-4302-a4a6-e210697b8572 admin admin] PATH_INFO: `/v3/users/61bb059117bf4224aceb9248817906f7` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:52.989206 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 142/285] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:52 2022] GET /identity/v3/projects/cd4c62df74e348508599a155b573abec => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:52.990005 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bf3c0-e522-4166-a382-a38141db8cc8 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:52.998984 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bf3c0-e522-4166-a382-a38141db8cc8 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:53.002056 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8c873-40af-4302-a4a6-e210697b8572 admin admin] RBAC: Authorizing `identity:get_user(user_id=61bb059117bf4224aceb9248817906f7)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:53.003210 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dc70f-ee09-4d91-9862-407bb7b81cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:53.003911 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dc70f-ee09-4d91-9862-407bb7b81cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:53.004150 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8c873-40af-4302-a4a6-e210697b8572 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:53.004236 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dc70f-ee09-4d91-9862-407bb7b81cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:53.004437 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dc70f-ee09-4d91-9862-407bb7b81cf0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:53.005570 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1dc70f-ee09-4d91-9862-407bb7b81cf0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:53.005936 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 144/286] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:52 2022] GET /identity/v3/users/61bb059117bf4224aceb9248817906f7 => generated 293 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:53.006542 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8c873-40af-4302-a4a6-e210697b8572 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:53.007394 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1dc70f-ee09-4d91-9862-407bb7b81cf0 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:53.009017 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 143/287] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:45:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:53.013615 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dc70f-ee09-4d91-9862-407bb7b81cf0 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:53.016156 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8c873-40af-4302-a4a6-e210697b8572 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:53.020336 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e4d14-aade-49c3-9389-21f7a22f2d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:53.020947 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e4d14-aade-49c3-9389-21f7a22f2d72 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:53.021224 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e4d14-aade-49c3-9389-21f7a22f2d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:53.021529 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e4d14-aade-49c3-9389-21f7a22f2d72 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:53.022722 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dc70f-ee09-4d91-9862-407bb7b81cf0 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:53.026948 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8200cf-feae-44b6-8d3d-4726f44763b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:53.027770 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8200cf-feae-44b6-8d3d-4726f44763b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:53.028085 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8200cf-feae-44b6-8d3d-4726f44763b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:53.028354 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8200cf-feae-44b6-8d3d-4726f44763b3 admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec/users/c9b1d8b3aed9445c8d017f3dcf9ca618/roles/b235f70dfa2a42308edd90003e99cd24` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:53.029184 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e4d14-aade-49c3-9389-21f7a22f2d72 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:53.030300 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8200cf-feae-44b6-8d3d-4726f44763b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4c62df74e348508599a155b573abec, user_id=c9b1d8b3aed9445c8d017f3dcf9ca618, role_id=b235f70dfa2a42308edd90003e99cd24)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:53.030924 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e4d14-aade-49c3-9389-21f7a22f2d72 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:53.032852 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8200cf-feae-44b6-8d3d-4726f44763b3 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:53.040002 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 145/288] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:45:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:45:53.040913 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e4d14-aade-49c3-9389-21f7a22f2d72 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:53.047196 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 144/289] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:45:53 2022] PUT /identity/v3/projects/cd4c62df74e348508599a155b573abec/users/c9b1d8b3aed9445c8d017f3dcf9ca618/roles/b235f70dfa2a42308edd90003e99cd24 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:45:53.049880 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e4d14-aade-49c3-9389-21f7a22f2d72 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:53.050407 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8200cf-feae-44b6-8d3d-4726f44763b3 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:53.119789 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8579d33-d98a-44e3-8ae2-992f835758ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:53.120631 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8579d33-d98a-44e3-8ae2-992f835758ee admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:53.121117 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8579d33-d98a-44e3-8ae2-992f835758ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:53.121656 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8579d33-d98a-44e3-8ae2-992f835758ee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:53.122936 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8579d33-d98a-44e3-8ae2-992f835758ee admin admin] RBAC: Adding query filter params (role.id=80e0463ac1aa4ef2b3739b580669f095, user.id=61bb059117bf4224aceb9248817906f7, scope.system=all) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:53.123251 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8579d33-d98a-44e3-8ae2-992f835758ee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:53.123342 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8200cf-feae-44b6-8d3d-4726f44763b3 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:53.125150 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8579d33-d98a-44e3-8ae2-992f835758ee admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:53.127927 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09b7c7-4cf4-40e1-8482-a10cf29f89f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:53.128614 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09b7c7-4cf4-40e1-8482-a10cf29f89f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:53.128880 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09b7c7-4cf4-40e1-8482-a10cf29f89f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:53.129156 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09b7c7-4cf4-40e1-8482-a10cf29f89f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:53.129921 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09b7c7-4cf4-40e1-8482-a10cf29f89f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:53.131919 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09b7c7-4cf4-40e1-8482-a10cf29f89f5 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:53.135183 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 146/290] 10.222.0.31 () {56 vars in 1329 bytes} [Thu Feb 10 20:45:53 2022] GET /identity/v3/role_assignments?user.id=61bb059117bf4224aceb9248817906f7&scope.system=all&role.id=80e0463ac1aa4ef2b3739b580669f095 => generated 226 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:53.136291 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8579d33-d98a-44e3-8ae2-992f835758ee admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:53.157194 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 145/291] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 10 20:45:53 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:45:53.161764 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8579d33-d98a-44e3-8ae2-992f835758ee admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:53.168149 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a9a8f-5993-4791-840e-f3904f5979d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:53.169586 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a9a8f-5993-4791-840e-f3904f5979d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:53.170087 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a9a8f-5993-4791-840e-f3904f5979d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:53.170538 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a9a8f-5993-4791-840e-f3904f5979d6 admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:53.172353 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a9a8f-5993-4791-840e-f3904f5979d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=cd4c62df74e348508599a155b573abec)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:53.175031 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a9a8f-5993-4791-840e-f3904f5979d6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:53.177830 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 147/292] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:53 2022] GET /identity/v3/projects/cd4c62df74e348508599a155b573abec => generated 302 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:53.184006 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09b7c7-4cf4-40e1-8482-a10cf29f89f5 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:53.195570 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09b7c7-4cf4-40e1-8482-a10cf29f89f5 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:53.200748 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028821d-c086-4141-bc3b-8f5b3ed3759d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:53.201848 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028821d-c086-4141-bc3b-8f5b3ed3759d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:53.202331 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028821d-c086-4141-bc3b-8f5b3ed3759d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:53.202797 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028821d-c086-4141-bc3b-8f5b3ed3759d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:53.203919 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028821d-c086-4141-bc3b-8f5b3ed3759d admin admin] RBAC: Adding query filter params (role.id=80e0463ac1aa4ef2b3739b580669f095, scope.project.id=cd4c62df74e348508599a155b573abec, user.id=c963069608484d6aa6a44039fd4369f4) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:53.204445 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028821d-c086-4141-bc3b-8f5b3ed3759d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:53.206772 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028821d-c086-4141-bc3b-8f5b3ed3759d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:53.214294 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 146/293] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:45:53 2022] GET /identity/v3/role_assignments?user.id=c963069608484d6aa6a44039fd4369f4&scope.project.id=cd4c62df74e348508599a155b573abec&role.id=80e0463ac1aa4ef2b3739b580669f095 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:55.321866 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0a246-cc95-4d6f-aad3-d305be7641e0 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.322433 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0a246-cc95-4d6f-aad3-d305be7641e0 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.322433 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0a246-cc95-4d6f-aad3-d305be7641e0 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.324438 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 148/294] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:55.329903 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c369c-dcbd-4f89-82aa-2d12d8d7a138 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.330302 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c369c-dcbd-4f89-82aa-2d12d8d7a138 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.330524 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c369c-dcbd-4f89-82aa-2d12d8d7a138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.348703 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-086c369c-dcbd-4f89-82aa-2d12d8d7a138 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:55.349912 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-086c369c-dcbd-4f89-82aa-2d12d8d7a138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:55.357471 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 147/295] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:55.380904 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0a246-cc95-4d6f-aad3-d305be7641e0 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:55.385187 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd47ab-5925-440a-9144-6308aeb63b9e None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.385516 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd47ab-5925-440a-9144-6308aeb63b9e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.385793 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd47ab-5925-440a-9144-6308aeb63b9e None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.387863 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 148/296] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:55.392734 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457bca4-d358-42dd-93c3-e46d268c86c9 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.393018 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457bca4-d358-42dd-93c3-e46d268c86c9 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.393294 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457bca4-d358-42dd-93c3-e46d268c86c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.394512 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0a246-cc95-4d6f-aad3-d305be7641e0 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:55.399296 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65c2a3-848f-463c-9d56-65143ceab10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:55.400198 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65c2a3-848f-463c-9d56-65143ceab10d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.401237 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65c2a3-848f-463c-9d56-65143ceab10d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.401237 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65c2a3-848f-463c-9d56-65143ceab10d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.411466 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-3457bca4-d358-42dd-93c3-e46d268c86c9 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:55.412645 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-3457bca4-d358-42dd-93c3-e46d268c86c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:55.413283 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65c2a3-848f-463c-9d56-65143ceab10d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:55.420377 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 149/297] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:45:55.421765 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-6c65c2a3-848f-463c-9d56-65143ceab10d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 20:45:55.423293 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 149/298] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:55.428965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457bca4-d358-42dd-93c3-e46d268c86c9 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:55.438755 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457bca4-d358-42dd-93c3-e46d268c86c9 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:55.443099 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1b070-6a8e-423c-87e0-85eaf821134b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:55.443750 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1b070-6a8e-423c-87e0-85eaf821134b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.444027 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1b070-6a8e-423c-87e0-85eaf821134b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.444295 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1b070-6a8e-423c-87e0-85eaf821134b admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.445054 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1b070-6a8e-423c-87e0-85eaf821134b admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:55.445375 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1b070-6a8e-423c-87e0-85eaf821134b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:55.446978 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1b070-6a8e-423c-87e0-85eaf821134b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:55.451608 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65c2a3-848f-463c-9d56-65143ceab10d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:55.456192 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 150/299] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:45:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:55.462195 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1b070-6a8e-423c-87e0-85eaf821134b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:55.462399 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65c2a3-848f-463c-9d56-65143ceab10d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:55.467689 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd3c4a-8322-474d-a29c-df2aab67a38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:55.468619 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd3c4a-8322-474d-a29c-df2aab67a38c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.469046 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd3c4a-8322-474d-a29c-df2aab67a38c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.469648 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd3c4a-8322-474d-a29c-df2aab67a38c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.474986 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1b070-6a8e-423c-87e0-85eaf821134b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:55.480622 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50f270-2ea9-40d0-bebc-c6af2afacbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:55.481052 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd3c4a-8322-474d-a29c-df2aab67a38c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:55.481811 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50f270-2ea9-40d0-bebc-c6af2afacbaa admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.482247 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50f270-2ea9-40d0-bebc-c6af2afacbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.482664 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50f270-2ea9-40d0-bebc-c6af2afacbaa admin admin] PATH_INFO: `/v3/users/c9b1d8b3aed9445c8d017f3dcf9ca618` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.484041 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50f270-2ea9-40d0-bebc-c6af2afacbaa admin admin] RBAC: Authorizing `identity:get_user(user_id=c9b1d8b3aed9445c8d017f3dcf9ca618)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:55.486334 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50f270-2ea9-40d0-bebc-c6af2afacbaa admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:55.488124 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 151/300] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:55 2022] GET /identity/v3/users/c9b1d8b3aed9445c8d017f3dcf9ca618 => generated 297 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:55.493453 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-7ebd3c4a-8322-474d-a29c-df2aab67a38c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 20:45:55.493453 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 150/301] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:45:55.494207 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd3c4a-8322-474d-a29c-df2aab67a38c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:55.498389 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50f270-2ea9-40d0-bebc-c6af2afacbaa admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:55.504719 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd3c4a-8322-474d-a29c-df2aab67a38c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:55.509318 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a71d22-9ab9-4cfb-b6e3-3a879718b008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:55.510071 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a71d22-9ab9-4cfb-b6e3-3a879718b008 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.510329 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50f270-2ea9-40d0-bebc-c6af2afacbaa admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:55.510568 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a71d22-9ab9-4cfb-b6e3-3a879718b008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.510933 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a71d22-9ab9-4cfb-b6e3-3a879718b008 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.515288 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3a2b7-3fe4-4a33-9c5b-5dcdae2b6b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:55.516291 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3a2b7-3fe4-4a33-9c5b-5dcdae2b6b1b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.516722 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3a2b7-3fe4-4a33-9c5b-5dcdae2b6b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.517129 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3a2b7-3fe4-4a33-9c5b-5dcdae2b6b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.518565 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3a2b7-3fe4-4a33-9c5b-5dcdae2b6b1b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:55.519647 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3a2b7-3fe4-4a33-9c5b-5dcdae2b6b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:55.520359 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a71d22-9ab9-4cfb-b6e3-3a879718b008 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:55.521580 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3a2b7-3fe4-4a33-9c5b-5dcdae2b6b1b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:55.522380 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a71d22-9ab9-4cfb-b6e3-3a879718b008 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:55.532127 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 151/302] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:45:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 20:45:55.533386 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 152/303] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:45:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:55.541157 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a71d22-9ab9-4cfb-b6e3-3a879718b008 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:55.542541 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3a2b7-3fe4-4a33-9c5b-5dcdae2b6b1b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:55.551808 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a71d22-9ab9-4cfb-b6e3-3a879718b008 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:55.552377 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3a2b7-3fe4-4a33-9c5b-5dcdae2b6b1b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:55.557020 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382aa20-dd63-4cff-9a51-8555116a98b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:55.557476 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b6ff4-7b88-4188-b33f-6c22cd12a196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:55.557924 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382aa20-dd63-4cff-9a51-8555116a98b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.558243 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382aa20-dd63-4cff-9a51-8555116a98b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.558522 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382aa20-dd63-4cff-9a51-8555116a98b4 admin admin] PATH_INFO: `/v3/users/61bb059117bf4224aceb9248817906f7` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.559704 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b6ff4-7b88-4188-b33f-6c22cd12a196 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.559857 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382aa20-dd63-4cff-9a51-8555116a98b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=61bb059117bf4224aceb9248817906f7)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:55.560601 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b6ff4-7b88-4188-b33f-6c22cd12a196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.561345 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b6ff4-7b88-4188-b33f-6c22cd12a196 admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.561979 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382aa20-dd63-4cff-9a51-8555116a98b4 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:55.563442 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b6ff4-7b88-4188-b33f-6c22cd12a196 admin admin] RBAC: Authorizing `identity:get_project(project_id=cd4c62df74e348508599a155b573abec)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:55.563580 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 153/304] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:55 2022] GET /identity/v3/users/61bb059117bf4224aceb9248817906f7 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:55.566630 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b6ff4-7b88-4188-b33f-6c22cd12a196 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:55.567032 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34955e-f46e-4a07-bbea-aa4afa3a4767 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.567375 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34955e-f46e-4a07-bbea-aa4afa3a4767 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.567649 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34955e-f46e-4a07-bbea-aa4afa3a4767 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.569283 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 152/305] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:45:55 2022] GET /identity/v3/projects/cd4c62df74e348508599a155b573abec => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:55.574271 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 154/306] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:55.574271 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34955e-f46e-4a07-bbea-aa4afa3a4767 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:55.575155 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b6ff4-7b88-4188-b33f-6c22cd12a196 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:55.585165 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b6ff4-7b88-4188-b33f-6c22cd12a196 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:55.586383 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34955e-f46e-4a07-bbea-aa4afa3a4767 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:55.589545 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45470aed-ebed-49e8-a69d-267bbfa6c9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:55.590188 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45470aed-ebed-49e8-a69d-267bbfa6c9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.590403 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c65c5-ae1f-49ec-925c-2a59cbe03a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:55.590519 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45470aed-ebed-49e8-a69d-267bbfa6c9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.590728 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45470aed-ebed-49e8-a69d-267bbfa6c9a2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.591226 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c65c5-ae1f-49ec-925c-2a59cbe03a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.591497 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c65c5-ae1f-49ec-925c-2a59cbe03a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.591647 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45470aed-ebed-49e8-a69d-267bbfa6c9a2 admin admin] RBAC: Adding query filter params (role.id=b235f70dfa2a42308edd90003e99cd24, scope.project.id=cd4c62df74e348508599a155b573abec, user.id=c9b1d8b3aed9445c8d017f3dcf9ca618) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:55.591763 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c65c5-ae1f-49ec-925c-2a59cbe03a78 admin admin] PATH_INFO: `/v3/system/users/61bb059117bf4224aceb9248817906f7/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.591953 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45470aed-ebed-49e8-a69d-267bbfa6c9a2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:55.593207 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c65c5-ae1f-49ec-925c-2a59cbe03a78 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=61bb059117bf4224aceb9248817906f7, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:55.593804 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45470aed-ebed-49e8-a69d-267bbfa6c9a2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:55.594242 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING py.warnings [None req-8f2c65c5-ae1f-49ec-925c-2a59cbe03a78 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:45:55.594242 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: warnings.warn(msg) Feb 10 20:45:55.594242 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: Feb 10 20:45:55.595086 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c65c5-ae1f-49ec-925c-2a59cbe03a78 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:55.599635 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 153/307] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:45:55 2022] GET /identity/v3/role_assignments?user.id=c9b1d8b3aed9445c8d017f3dcf9ca618&scope.project.id=cd4c62df74e348508599a155b573abec&role.id=b235f70dfa2a42308edd90003e99cd24 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:55.600824 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bd0de-7647-4ec9-965a-049d8cc7f36d None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.601121 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bd0de-7647-4ec9-965a-049d8cc7f36d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.601436 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bd0de-7647-4ec9-965a-049d8cc7f36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.605205 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 155/308] 10.222.0.31 () {58 vars in 1355 bytes} [Thu Feb 10 20:45:55 2022] PUT /identity/v3/system/users/61bb059117bf4224aceb9248817906f7/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:45:55.615169 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4368a-fe54-44b9-a08d-af47f2e73d84 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.616483 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4368a-fe54-44b9-a08d-af47f2e73d84 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.616958 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4368a-fe54-44b9-a08d-af47f2e73d84 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.624699 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 156/309] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:55 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:55.625639 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-005bd0de-7647-4ec9-965a-049d8cc7f36d None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:55.626607 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becfeb2-2cad-4bdb-a1c8-12165625aec3 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.627077 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becfeb2-2cad-4bdb-a1c8-12165625aec3 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.627230 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-005bd0de-7647-4ec9-965a-049d8cc7f36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:55.627637 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becfeb2-2cad-4bdb-a1c8-12165625aec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.637120 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 154/310] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:55.649450 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-4becfeb2-2cad-4bdb-a1c8-12165625aec3 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:55.650921 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4becfeb2-2cad-4bdb-a1c8-12165625aec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:55.665459 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bd0de-7647-4ec9-965a-049d8cc7f36d None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:55.666080 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 157/311] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:55.674446 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bd0de-7647-4ec9-965a-049d8cc7f36d None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:55.679470 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e113b7-67f6-4ba4-a93d-b762b40e0001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:55.680493 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e113b7-67f6-4ba4-a93d-b762b40e0001 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.680856 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e113b7-67f6-4ba4-a93d-b762b40e0001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.681216 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e113b7-67f6-4ba4-a93d-b762b40e0001 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.682805 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e113b7-67f6-4ba4-a93d-b762b40e0001 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:55.684799 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e113b7-67f6-4ba4-a93d-b762b40e0001 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:55.688546 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4becfeb2-2cad-4bdb-a1c8-12165625aec3 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:55.691921 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 155/312] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:45:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:55.693591 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e113b7-67f6-4ba4-a93d-b762b40e0001 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:55.699523 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4becfeb2-2cad-4bdb-a1c8-12165625aec3 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:55.704637 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e113b7-67f6-4ba4-a93d-b762b40e0001 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:55.705698 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbec6d-47b6-4d02-80ab-74ea8c2c94f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:55.706735 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbec6d-47b6-4d02-80ab-74ea8c2c94f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.707290 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbec6d-47b6-4d02-80ab-74ea8c2c94f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.707793 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbec6d-47b6-4d02-80ab-74ea8c2c94f4 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.710865 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c843d-81d2-42fe-835f-7a35cf51030e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:55.712228 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c843d-81d2-42fe-835f-7a35cf51030e admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.712821 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c843d-81d2-42fe-835f-7a35cf51030e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.713403 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c843d-81d2-42fe-835f-7a35cf51030e admin admin] PATH_INFO: `/v3/groups` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.714315 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c843d-81d2-42fe-835f-7a35cf51030e admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:55.715580 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-ec1c843d-81d2-42fe-835f-7a35cf51030e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:45:55.715580 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Feb 10 20:45:55.715580 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: Feb 10 20:45:55.717330 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c843d-81d2-42fe-835f-7a35cf51030e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:55.723520 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbec6d-47b6-4d02-80ab-74ea8c2c94f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:55.731204 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-83bbec6d-47b6-4d02-80ab-74ea8c2c94f4 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 20:45:55.737931 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 158/313] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:55.739183 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbec6d-47b6-4d02-80ab-74ea8c2c94f4 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:55.741037 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 156/314] 10.222.0.31 () {60 vars in 1155 bytes} [Thu Feb 10 20:45:55 2022] POST /identity/v3/groups => generated 229 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:45:55.751282 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbec6d-47b6-4d02-80ab-74ea8c2c94f4 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:55.756622 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4ae6e-b5db-43c4-8a94-975e52565c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:55.757758 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4ae6e-b5db-43c4-8a94-975e52565c91 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.758254 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4ae6e-b5db-43c4-8a94-975e52565c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.758710 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4ae6e-b5db-43c4-8a94-975e52565c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.759683 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4ae6e-b5db-43c4-8a94-975e52565c91 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:55.760150 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4ae6e-b5db-43c4-8a94-975e52565c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:55.762156 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4ae6e-b5db-43c4-8a94-975e52565c91 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:55.773511 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 159/315] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:45:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:55.779958 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c843d-81d2-42fe-835f-7a35cf51030e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:55.790976 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c843d-81d2-42fe-835f-7a35cf51030e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:55.796099 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925731b-54d4-4338-a653-edd10a9e1de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:55.797288 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925731b-54d4-4338-a653-edd10a9e1de0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.797806 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925731b-54d4-4338-a653-edd10a9e1de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.798243 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925731b-54d4-4338-a653-edd10a9e1de0 admin admin] PATH_INFO: `/v3/users/aa7ead633df3422dafa32e7bd3a19979` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.814362 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925731b-54d4-4338-a653-edd10a9e1de0 admin admin] RBAC: Authorizing `identity:get_user(user_id=aa7ead633df3422dafa32e7bd3a19979)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:55.816894 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925731b-54d4-4338-a653-edd10a9e1de0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:55.819140 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 157/316] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:55 2022] GET /identity/v3/users/aa7ead633df3422dafa32e7bd3a19979 => generated 293 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:55.825423 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4ae6e-b5db-43c4-8a94-975e52565c91 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:55.836721 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4ae6e-b5db-43c4-8a94-975e52565c91 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:55.845769 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8980d25-a279-47f2-9944-b8e06c7cfe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:55.846454 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8980d25-a279-47f2-9944-b8e06c7cfe3d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:55.846735 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8980d25-a279-47f2-9944-b8e06c7cfe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:55.847004 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8980d25-a279-47f2-9944-b8e06c7cfe3d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:55.847854 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8980d25-a279-47f2-9944-b8e06c7cfe3d admin admin] RBAC: Adding query filter params (role.id=b235f70dfa2a42308edd90003e99cd24, user.id=aa7ead633df3422dafa32e7bd3a19979, scope.system=all) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:55.848160 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8980d25-a279-47f2-9944-b8e06c7cfe3d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:55.850091 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8980d25-a279-47f2-9944-b8e06c7cfe3d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:55.858448 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 160/317] 10.222.0.31 () {56 vars in 1329 bytes} [Thu Feb 10 20:45:55 2022] GET /identity/v3/role_assignments?user.id=aa7ead633df3422dafa32e7bd3a19979&scope.system=all&role.id=b235f70dfa2a42308edd90003e99cd24 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:57.862840 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e2178-523b-46cb-9465-c07c97e973e6 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:57.863354 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e2178-523b-46cb-9465-c07c97e973e6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:57.863354 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e2178-523b-46cb-9465-c07c97e973e6 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:57.865399 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 158/318] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:57.870795 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805d833-f803-4de2-8574-74dc224bc564 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:57.871195 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805d833-f803-4de2-8574-74dc224bc564 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:57.871371 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805d833-f803-4de2-8574-74dc224bc564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:57.891234 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-d805d833-f803-4de2-8574-74dc224bc564 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:57.893232 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d805d833-f803-4de2-8574-74dc224bc564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:57.904857 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 161/319] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:57.928767 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e2178-523b-46cb-9465-c07c97e973e6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:57.942734 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e2178-523b-46cb-9465-c07c97e973e6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:57.947291 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f2ec9-8626-4d11-847e-4b0db419a9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:57.948080 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f2ec9-8626-4d11-847e-4b0db419a9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:57.948355 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f2ec9-8626-4d11-847e-4b0db419a9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:57.948621 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f2ec9-8626-4d11-847e-4b0db419a9e2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:57.958772 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f2ec9-8626-4d11-847e-4b0db419a9e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:57.965977 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-285f2ec9-8626-4d11-847e-4b0db419a9e2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 20:45:57.967334 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 159/320] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:57.973213 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805d833-f803-4de2-8574-74dc224bc564 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:57.978687 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcc0cd-1dca-4d27-a99f-413f82bae85a None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:57.978943 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcc0cd-1dca-4d27-a99f-413f82bae85a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:57.979215 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcc0cd-1dca-4d27-a99f-413f82bae85a None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:57.980964 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 160/321] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:45:57.983192 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805d833-f803-4de2-8574-74dc224bc564 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:57.986083 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09214ee7-b98a-41d3-920a-faf8c72b36d1 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:57.986332 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09214ee7-b98a-41d3-920a-faf8c72b36d1 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:57.986610 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09214ee7-b98a-41d3-920a-faf8c72b36d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:57.988120 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad38b2-840a-4f19-817f-2a7fddda9afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:57.988776 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad38b2-840a-4f19-817f-2a7fddda9afc admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:57.989047 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad38b2-840a-4f19-817f-2a7fddda9afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:57.989314 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad38b2-840a-4f19-817f-2a7fddda9afc admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:57.990106 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad38b2-840a-4f19-817f-2a7fddda9afc admin admin] RBAC: Adding query filter params (name=member) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:57.990404 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad38b2-840a-4f19-817f-2a7fddda9afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:57.992009 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad38b2-840a-4f19-817f-2a7fddda9afc admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:58.004061 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 162/322] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:45:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:58.004507 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-09214ee7-b98a-41d3-920a-faf8c72b36d1 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:58.005778 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-09214ee7-b98a-41d3-920a-faf8c72b36d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:58.009310 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad38b2-840a-4f19-817f-2a7fddda9afc admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:58.013520 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 161/323] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:45:58.018696 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad38b2-840a-4f19-817f-2a7fddda9afc admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:58.023369 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca19434-7efa-45da-ae66-7b5aee2185c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:58.024204 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca19434-7efa-45da-ae66-7b5aee2185c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:58.024477 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca19434-7efa-45da-ae66-7b5aee2185c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:58.024750 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca19434-7efa-45da-ae66-7b5aee2185c9 admin admin] PATH_INFO: `/v3/users/61bb059117bf4224aceb9248817906f7` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:58.025966 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca19434-7efa-45da-ae66-7b5aee2185c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=61bb059117bf4224aceb9248817906f7)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:58.028060 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca19434-7efa-45da-ae66-7b5aee2185c9 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:58.029766 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 163/324] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:58 2022] GET /identity/v3/users/61bb059117bf4224aceb9248817906f7 => generated 293 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:58.035223 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09214ee7-b98a-41d3-920a-faf8c72b36d1 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:58.036888 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca19434-7efa-45da-ae66-7b5aee2185c9 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:58.045148 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09214ee7-b98a-41d3-920a-faf8c72b36d1 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:58.046383 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca19434-7efa-45da-ae66-7b5aee2185c9 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:58.049508 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8dc4e-b550-4a2c-9391-5194424e2d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:58.050145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8dc4e-b550-4a2c-9391-5194424e2d37 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:58.050415 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8dc4e-b550-4a2c-9391-5194424e2d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:58.050677 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8dc4e-b550-4a2c-9391-5194424e2d37 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:58.050769 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ae849-aad6-4f56-a5cf-5645cf6a7b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:58.051429 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ae849-aad6-4f56-a5cf-5645cf6a7b7d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:58.051523 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8dc4e-b550-4a2c-9391-5194424e2d37 admin admin] RBAC: Adding query filter params (role.id=80e0463ac1aa4ef2b3739b580669f095, user.id=61bb059117bf4224aceb9248817906f7, scope.system=all) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:58.051702 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ae849-aad6-4f56-a5cf-5645cf6a7b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:58.051787 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8dc4e-b550-4a2c-9391-5194424e2d37 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:58.051967 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ae849-aad6-4f56-a5cf-5645cf6a7b7d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:58.053105 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ae849-aad6-4f56-a5cf-5645cf6a7b7d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:58.053618 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8dc4e-b550-4a2c-9391-5194424e2d37 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:58.054808 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ae849-aad6-4f56-a5cf-5645cf6a7b7d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:58.056510 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 164/325] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:45:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:45:58.057617 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd68b8-2846-4fad-a85f-c13e5332523f None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:58.057897 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd68b8-2846-4fad-a85f-c13e5332523f None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:58.058172 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd68b8-2846-4fad-a85f-c13e5332523f None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:58.059889 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 165/326] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:45:58.061577 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd68b8-2846-4fad-a85f-c13e5332523f None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:58.074594 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 162/327] 10.222.0.31 () {56 vars in 1329 bytes} [Thu Feb 10 20:45:58 2022] GET /identity/v3/role_assignments?user.id=61bb059117bf4224aceb9248817906f7&scope.system=all&role.id=80e0463ac1aa4ef2b3739b580669f095 => generated 510 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:58.074594 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5aa4a-7f31-4de5-9385-8b0e06929ee6 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:58.074594 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5aa4a-7f31-4de5-9385-8b0e06929ee6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:58.074594 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5aa4a-7f31-4de5-9385-8b0e06929ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:58.075025 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd68b8-2846-4fad-a85f-c13e5332523f None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:58.078125 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6bcfa-3944-4014-9742-626f46ae914a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:58.078791 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6bcfa-3944-4014-9742-626f46ae914a admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:58.079085 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6bcfa-3944-4014-9742-626f46ae914a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:58.079340 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6bcfa-3944-4014-9742-626f46ae914a admin admin] PATH_INFO: `/v3/groups` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:58.080053 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6bcfa-3944-4014-9742-626f46ae914a admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:58.081085 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING py.warnings [None req-81f6bcfa-3944-4014-9742-626f46ae914a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:45:58.081085 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: warnings.warn(msg) Feb 10 20:45:58.081085 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: Feb 10 20:45:58.082314 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6bcfa-3944-4014-9742-626f46ae914a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:58.089068 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-1fd5aa4a-7f31-4de5-9385-8b0e06929ee6 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:45:58.090441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1fd5aa4a-7f31-4de5-9385-8b0e06929ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:45:58.098939 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 163/328] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:45:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:45:58.101064 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 166/329] 10.222.0.31 () {60 vars in 1155 bytes} [Thu Feb 10 20:45:58 2022] POST /identity/v3/groups => generated 226 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:45:58.122593 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5aa4a-7f31-4de5-9385-8b0e06929ee6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:58.132977 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5aa4a-7f31-4de5-9385-8b0e06929ee6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:58.137864 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17290b97-f5d0-477b-ab21-c22a44fb70e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:58.138700 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17290b97-f5d0-477b-ab21-c22a44fb70e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:58.139010 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17290b97-f5d0-477b-ab21-c22a44fb70e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:58.139255 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17290b97-f5d0-477b-ab21-c22a44fb70e3 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:58.152517 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17290b97-f5d0-477b-ab21-c22a44fb70e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:45:58.159775 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-17290b97-f5d0-477b-ab21-c22a44fb70e3 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 20:45:58.161073 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 164/330] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:45:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:45:58.167464 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6bcfa-3944-4014-9742-626f46ae914a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:58.178356 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6bcfa-3944-4014-9742-626f46ae914a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:58.182965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569ce7e-ae24-4164-aa1c-182af43dd6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:58.183659 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569ce7e-ae24-4164-aa1c-182af43dd6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:58.183939 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569ce7e-ae24-4164-aa1c-182af43dd6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:58.184210 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569ce7e-ae24-4164-aa1c-182af43dd6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:58.185009 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569ce7e-ae24-4164-aa1c-182af43dd6c3 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:45:58.185314 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569ce7e-ae24-4164-aa1c-182af43dd6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:58.187048 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569ce7e-ae24-4164-aa1c-182af43dd6c3 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:58.197911 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 167/331] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:45:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:58.206444 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17290b97-f5d0-477b-ab21-c22a44fb70e3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:58.220273 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17290b97-f5d0-477b-ab21-c22a44fb70e3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:58.226891 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3201f-716a-422a-939b-f3dd8fd66cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:58.227808 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3201f-716a-422a-939b-f3dd8fd66cef admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:58.228081 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3201f-716a-422a-939b-f3dd8fd66cef admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:58.228345 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3201f-716a-422a-939b-f3dd8fd66cef admin admin] PATH_INFO: `/v3/users/aa7ead633df3422dafa32e7bd3a19979` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:58.230090 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3201f-716a-422a-939b-f3dd8fd66cef admin admin] RBAC: Authorizing `identity:get_user(user_id=aa7ead633df3422dafa32e7bd3a19979)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:58.232464 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3201f-716a-422a-939b-f3dd8fd66cef admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:58.234739 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 165/332] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:45:58 2022] GET /identity/v3/users/aa7ead633df3422dafa32e7bd3a19979 => generated 293 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:45:58.241686 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569ce7e-ae24-4164-aa1c-182af43dd6c3 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:45:58.254303 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569ce7e-ae24-4164-aa1c-182af43dd6c3 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:45:58.260058 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b963947-a4c8-45da-88f4-018db01af78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:45:58.260964 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b963947-a4c8-45da-88f4-018db01af78f admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:45:58.261237 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b963947-a4c8-45da-88f4-018db01af78f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:45:58.261540 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b963947-a4c8-45da-88f4-018db01af78f admin admin] PATH_INFO: `/v3/system/users/aa7ead633df3422dafa32e7bd3a19979/roles/b235f70dfa2a42308edd90003e99cd24` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:45:58.263121 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b963947-a4c8-45da-88f4-018db01af78f admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=aa7ead633df3422dafa32e7bd3a19979, role_id=b235f70dfa2a42308edd90003e99cd24)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:45:58.264769 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b963947-a4c8-45da-88f4-018db01af78f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:45:58.274394 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 168/333] 10.222.0.31 () {58 vars in 1355 bytes} [Thu Feb 10 20:45:58 2022] PUT /identity/v3/system/users/aa7ead633df3422dafa32e7bd3a19979/roles/b235f70dfa2a42308edd90003e99cd24 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:46:00.935688 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173466b5-a006-4759-a327-aa5b3d547780 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:00.936572 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173466b5-a006-4759-a327-aa5b3d547780 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:00.937008 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173466b5-a006-4759-a327-aa5b3d547780 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:00.939266 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 166/334] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:00.955376 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e2e23-218b-4ef2-9e75-0fd730c55313 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:00.956326 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e2e23-218b-4ef2-9e75-0fd730c55313 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:00.956822 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e2e23-218b-4ef2-9e75-0fd730c55313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:00.980893 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-316e2e23-218b-4ef2-9e75-0fd730c55313 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:00.982424 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-316e2e23-218b-4ef2-9e75-0fd730c55313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:00.989966 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e0d1c-ef7b-4b21-863e-90ae0804536a None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:00.990293 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e0d1c-ef7b-4b21-863e-90ae0804536a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:00.990504 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e0d1c-ef7b-4b21-863e-90ae0804536a None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:00.992410 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 167/335] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:46:00.998340 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa31bdb-fe92-4b0e-8da8-00d2156420c7 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:00.998639 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa31bdb-fe92-4b0e-8da8-00d2156420c7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:00.998878 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa31bdb-fe92-4b0e-8da8-00d2156420c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.000919 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 169/336] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:01.026549 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-faa31bdb-fe92-4b0e-8da8-00d2156420c7 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:01.028093 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-faa31bdb-fe92-4b0e-8da8-00d2156420c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:01.038240 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 168/337] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:46:01.039835 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e2e23-218b-4ef2-9e75-0fd730c55313 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:01.054305 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e2e23-218b-4ef2-9e75-0fd730c55313 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:01.061718 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcd518-68ad-429b-a2e2-e6f21fefcc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:01.062521 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcd518-68ad-429b-a2e2-e6f21fefcc4c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.062795 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcd518-68ad-429b-a2e2-e6f21fefcc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.063063 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcd518-68ad-429b-a2e2-e6f21fefcc4c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.078537 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa31bdb-fe92-4b0e-8da8-00d2156420c7 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:01.083057 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fcd518-68ad-429b-a2e2-e6f21fefcc4c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:01.089896 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-d9fcd518-68ad-429b-a2e2-e6f21fefcc4c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 20:46:01.090271 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa31bdb-fe92-4b0e-8da8-00d2156420c7 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:01.094340 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 170/338] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:01.097259 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcd518-68ad-429b-a2e2-e6f21fefcc4c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:01.106635 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec79999-38be-4fef-847d-b607d57c8573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:01.107451 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec79999-38be-4fef-847d-b607d57c8573 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.107726 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec79999-38be-4fef-847d-b607d57c8573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.107991 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec79999-38be-4fef-847d-b607d57c8573 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.110599 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcd518-68ad-429b-a2e2-e6f21fefcc4c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:01.121312 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74bccb-c7e7-431b-adb9-6fc00f79deb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:01.122014 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74bccb-c7e7-431b-adb9-6fc00f79deb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.122291 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74bccb-c7e7-431b-adb9-6fc00f79deb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.122559 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74bccb-c7e7-431b-adb9-6fc00f79deb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.123323 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74bccb-c7e7-431b-adb9-6fc00f79deb3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:01.123617 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74bccb-c7e7-431b-adb9-6fc00f79deb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:01.125209 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74bccb-c7e7-431b-adb9-6fc00f79deb3 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:01.138372 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec79999-38be-4fef-847d-b607d57c8573 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:01.141248 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 171/339] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:46:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:01.145427 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-2ec79999-38be-4fef-847d-b607d57c8573 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 20:46:01.147116 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 169/340] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:01.147225 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74bccb-c7e7-431b-adb9-6fc00f79deb3 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:01.153782 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec79999-38be-4fef-847d-b607d57c8573 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:01.159328 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74bccb-c7e7-431b-adb9-6fc00f79deb3 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:01.166891 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec79999-38be-4fef-847d-b607d57c8573 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:01.169147 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60321421-bc9c-452e-88b2-fc54e2d998e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:01.169850 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60321421-bc9c-452e-88b2-fc54e2d998e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.170122 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60321421-bc9c-452e-88b2-fc54e2d998e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.170385 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60321421-bc9c-452e-88b2-fc54e2d998e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.178434 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dee93b-34d8-4101-b33a-fbc38cee865b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:01.179114 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dee93b-34d8-4101-b33a-fbc38cee865b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.179394 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dee93b-34d8-4101-b33a-fbc38cee865b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.179661 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dee93b-34d8-4101-b33a-fbc38cee865b admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.180428 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dee93b-34d8-4101-b33a-fbc38cee865b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:01.180725 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dee93b-34d8-4101-b33a-fbc38cee865b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:01.182626 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dee93b-34d8-4101-b33a-fbc38cee865b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:01.190461 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60321421-bc9c-452e-88b2-fc54e2d998e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:01.192654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60321421-bc9c-452e-88b2-fc54e2d998e0 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:01.200949 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 170/341] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:46:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:01.203732 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 172/342] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 20:46:01.206872 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dee93b-34d8-4101-b33a-fbc38cee865b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:01.209832 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60321421-bc9c-452e-88b2-fc54e2d998e0 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:01.224115 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60321421-bc9c-452e-88b2-fc54e2d998e0 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:01.231982 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dee93b-34d8-4101-b33a-fbc38cee865b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:01.239275 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77d00e-e6dc-4af1-9ac2-d0ee765067af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:01.240188 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77d00e-e6dc-4af1-9ac2-d0ee765067af admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.240495 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77d00e-e6dc-4af1-9ac2-d0ee765067af admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.240874 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77d00e-e6dc-4af1-9ac2-d0ee765067af admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.242254 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77d00e-e6dc-4af1-9ac2-d0ee765067af admin admin] RBAC: Authorizing `identity:get_project(project_id=cd4c62df74e348508599a155b573abec)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:01.242577 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f50a1-4db5-4f72-9cc3-504922c4ce12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:01.243229 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f50a1-4db5-4f72-9cc3-504922c4ce12 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.243504 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f50a1-4db5-4f72-9cc3-504922c4ce12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.243797 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f50a1-4db5-4f72-9cc3-504922c4ce12 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.244803 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77d00e-e6dc-4af1-9ac2-d0ee765067af admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:01.250630 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 173/343] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:46:01 2022] GET /identity/v3/projects/cd4c62df74e348508599a155b573abec => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:01.253339 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77d00e-e6dc-4af1-9ac2-d0ee765067af admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:01.259501 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f50a1-4db5-4f72-9cc3-504922c4ce12 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:01.261249 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f50a1-4db5-4f72-9cc3-504922c4ce12 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:01.275660 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77d00e-e6dc-4af1-9ac2-d0ee765067af admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:01.281276 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 171/344] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:46:01.287326 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa375a-0365-4b65-b49e-806fe725c362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:01.287665 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f50a1-4db5-4f72-9cc3-504922c4ce12 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:01.288213 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa375a-0365-4b65-b49e-806fe725c362 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.288458 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa375a-0365-4b65-b49e-806fe725c362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.288719 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa375a-0365-4b65-b49e-806fe725c362 admin admin] PATH_INFO: `/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.297472 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa375a-0365-4b65-b49e-806fe725c362 admin admin] RBAC: Authorizing `identity:get_group(group_id=5ca0dfa6905142f1bfc55c5c0cfb20ab)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:01.298512 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING py.warnings [None req-5dfa375a-0365-4b65-b49e-806fe725c362 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:46:01.298512 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: warnings.warn(msg) Feb 10 20:46:01.298512 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: Feb 10 20:46:01.299673 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa375a-0365-4b65-b49e-806fe725c362 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:01.301255 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f50a1-4db5-4f72-9cc3-504922c4ce12 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:01.305556 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 174/345] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 10 20:46:01 2022] GET /identity/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:01.307009 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab93d8-ea96-4499-a74e-0e7034cebe60 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.307287 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab93d8-ea96-4499-a74e-0e7034cebe60 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.307555 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab93d8-ea96-4499-a74e-0e7034cebe60 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.309299 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 175/346] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:01.311315 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab93d8-ea96-4499-a74e-0e7034cebe60 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:01.315395 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf4544-1093-4ff4-85b6-2ccc81d2c374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:01.316263 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf4544-1093-4ff4-85b6-2ccc81d2c374 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.316537 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf4544-1093-4ff4-85b6-2ccc81d2c374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.316896 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf4544-1093-4ff4-85b6-2ccc81d2c374 admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.318142 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf4544-1093-4ff4-85b6-2ccc81d2c374 admin admin] RBAC: Authorizing `identity:get_project(project_id=882013caabf941cd8a950baeb731deb7)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:01.320173 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf4544-1093-4ff4-85b6-2ccc81d2c374 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:01.322138 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 172/347] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:46:01 2022] GET /identity/v3/projects/882013caabf941cd8a950baeb731deb7 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:01.324831 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136b669-a710-48dd-9cd9-2969dd1ab65f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.325138 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136b669-a710-48dd-9cd9-2969dd1ab65f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.325447 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136b669-a710-48dd-9cd9-2969dd1ab65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.328471 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab93d8-ea96-4499-a74e-0e7034cebe60 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:01.336747 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fe0d2-c44a-4a8f-a346-75c524e9898c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:01.337423 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fe0d2-c44a-4a8f-a346-75c524e9898c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.337705 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fe0d2-c44a-4a8f-a346-75c524e9898c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.337970 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fe0d2-c44a-4a8f-a346-75c524e9898c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.338806 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897fe0d2-c44a-4a8f-a346-75c524e9898c admin admin] RBAC: Adding query filter params (group.id=5ca0dfa6905142f1bfc55c5c0cfb20ab, role.id=80e0463ac1aa4ef2b3739b580669f095, scope.project.id=cd4c62df74e348508599a155b573abec) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:01.339107 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897fe0d2-c44a-4a8f-a346-75c524e9898c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:01.341938 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897fe0d2-c44a-4a8f-a346-75c524e9898c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:01.354376 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 176/348] 10.222.0.31 () {56 vars in 1397 bytes} [Thu Feb 10 20:46:01 2022] GET /identity/v3/role_assignments?group.id=5ca0dfa6905142f1bfc55c5c0cfb20ab&scope.project.id=cd4c62df74e348508599a155b573abec&role.id=80e0463ac1aa4ef2b3739b580669f095 => generated 260 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:01.361259 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fe0d2-c44a-4a8f-a346-75c524e9898c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:01.362604 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-b136b669-a710-48dd-9cd9-2969dd1ab65f None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:01.363946 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b136b669-a710-48dd-9cd9-2969dd1ab65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:01.382282 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fe0d2-c44a-4a8f-a346-75c524e9898c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:01.387242 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4a2a2-080d-40d0-9fc4-037cbd21a86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:01.388075 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 173/349] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:01.388259 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4a2a2-080d-40d0-9fc4-037cbd21a86a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.388535 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4a2a2-080d-40d0-9fc4-037cbd21a86a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.388804 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4a2a2-080d-40d0-9fc4-037cbd21a86a admin admin] PATH_INFO: `/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.390067 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4a2a2-080d-40d0-9fc4-037cbd21a86a admin admin] RBAC: Authorizing `identity:get_group(group_id=5ca0dfa6905142f1bfc55c5c0cfb20ab)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:01.392018 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4a2a2-080d-40d0-9fc4-037cbd21a86a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:01.393675 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 177/350] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 10 20:46:01 2022] GET /identity/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:01.399834 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136b669-a710-48dd-9cd9-2969dd1ab65f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:01.415279 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136b669-a710-48dd-9cd9-2969dd1ab65f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:01.427151 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451d398-7c6a-467d-9ba6-cc114b47c3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:01.427824 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451d398-7c6a-467d-9ba6-cc114b47c3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.428096 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451d398-7c6a-467d-9ba6-cc114b47c3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.428360 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451d398-7c6a-467d-9ba6-cc114b47c3f5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.429210 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451d398-7c6a-467d-9ba6-cc114b47c3f5 admin admin] RBAC: Adding query filter params (group.id=5ca0dfa6905142f1bfc55c5c0cfb20ab, role.id=80e0463ac1aa4ef2b3739b580669f095, scope.project.id=882013caabf941cd8a950baeb731deb7) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:01.429577 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451d398-7c6a-467d-9ba6-cc114b47c3f5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:01.431670 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451d398-7c6a-467d-9ba6-cc114b47c3f5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:01.440769 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4a2a2-080d-40d0-9fc4-037cbd21a86a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:01.442760 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 174/351] 10.222.0.31 () {56 vars in 1397 bytes} [Thu Feb 10 20:46:01 2022] GET /identity/v3/role_assignments?group.id=5ca0dfa6905142f1bfc55c5c0cfb20ab&scope.project.id=882013caabf941cd8a950baeb731deb7&role.id=80e0463ac1aa4ef2b3739b580669f095 => generated 260 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:01.452869 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4a2a2-080d-40d0-9fc4-037cbd21a86a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:01.465739 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f1847-6c96-45bf-8a8e-878e339e61fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:01.466668 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f1847-6c96-45bf-8a8e-878e339e61fe admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.466992 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f1847-6c96-45bf-8a8e-878e339e61fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.467257 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f1847-6c96-45bf-8a8e-878e339e61fe admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.479428 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f1847-6c96-45bf-8a8e-878e339e61fe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:01.491297 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-7e5f1847-6c96-45bf-8a8e-878e339e61fe admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 20:46:01.492576 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 178/352] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 10 20:46:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:01.498753 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451d398-7c6a-467d-9ba6-cc114b47c3f5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:01.519245 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451d398-7c6a-467d-9ba6-cc114b47c3f5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:01.538293 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10701846-0174-473e-9dba-45837f7f31b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:01.538997 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10701846-0174-473e-9dba-45837f7f31b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.539273 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10701846-0174-473e-9dba-45837f7f31b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.539539 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10701846-0174-473e-9dba-45837f7f31b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.540328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10701846-0174-473e-9dba-45837f7f31b8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:01.540630 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10701846-0174-473e-9dba-45837f7f31b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:01.542865 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10701846-0174-473e-9dba-45837f7f31b8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:01.551981 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 175/353] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:01.557893 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f1847-6c96-45bf-8a8e-878e339e61fe admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:01.575306 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f1847-6c96-45bf-8a8e-878e339e61fe admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:01.583253 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f560065-e89b-4799-bdd5-ac052b578208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:01.583977 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f560065-e89b-4799-bdd5-ac052b578208 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.584260 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f560065-e89b-4799-bdd5-ac052b578208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.584526 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f560065-e89b-4799-bdd5-ac052b578208 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.595182 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f560065-e89b-4799-bdd5-ac052b578208 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:01.598746 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525f104-f6fa-4aa4-9089-767b36973ef6 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.599025 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525f104-f6fa-4aa4-9089-767b36973ef6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.599295 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525f104-f6fa-4aa4-9089-767b36973ef6 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.601282 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 176/354] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:01.601854 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f560065-e89b-4799-bdd5-ac052b578208 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:01.612859 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 179/355] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:46:01.618599 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525f104-f6fa-4aa4-9089-767b36973ef6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:01.620047 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451dc394-b20f-46e0-a02c-7b53a457f278 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.620475 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451dc394-b20f-46e0-a02c-7b53a457f278 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.621023 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451dc394-b20f-46e0-a02c-7b53a457f278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.644493 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-451dc394-b20f-46e0-a02c-7b53a457f278 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:01.645961 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-451dc394-b20f-46e0-a02c-7b53a457f278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:01.646891 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525f104-f6fa-4aa4-9089-767b36973ef6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:01.661858 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 180/356] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:01.664479 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7eb9e-ccea-4dd1-bbed-7dbdfaf87556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:01.665392 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7eb9e-ccea-4dd1-bbed-7dbdfaf87556 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.665659 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7eb9e-ccea-4dd1-bbed-7dbdfaf87556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.665921 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7eb9e-ccea-4dd1-bbed-7dbdfaf87556 admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.670194 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7eb9e-ccea-4dd1-bbed-7dbdfaf87556 admin admin] RBAC: Authorizing `identity:get_project(project_id=882013caabf941cd8a950baeb731deb7)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:01.673245 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7eb9e-ccea-4dd1-bbed-7dbdfaf87556 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:01.674359 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 177/357] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:46:01 2022] GET /identity/v3/projects/882013caabf941cd8a950baeb731deb7 => generated 298 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:01.679987 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451dc394-b20f-46e0-a02c-7b53a457f278 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:01.691208 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451dc394-b20f-46e0-a02c-7b53a457f278 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:01.704193 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5becf-e3c2-48f2-b6fd-035ddbeae7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:01.704193 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5becf-e3c2-48f2-b6fd-035ddbeae7fe admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.704193 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5becf-e3c2-48f2-b6fd-035ddbeae7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.704193 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5becf-e3c2-48f2-b6fd-035ddbeae7fe admin admin] PATH_INFO: `/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.705849 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5becf-e3c2-48f2-b6fd-035ddbeae7fe admin admin] RBAC: Authorizing `identity:get_group(group_id=5ca0dfa6905142f1bfc55c5c0cfb20ab)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:01.708071 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5becf-e3c2-48f2-b6fd-035ddbeae7fe admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:01.710019 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 181/358] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 10 20:46:01 2022] GET /identity/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:01.716460 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7eb9e-ccea-4dd1-bbed-7dbdfaf87556 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:01.719786 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5becf-e3c2-48f2-b6fd-035ddbeae7fe admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:01.730348 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5becf-e3c2-48f2-b6fd-035ddbeae7fe admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:01.735979 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f314ef-aa03-44fe-b158-964d2a049798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:01.736118 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7eb9e-ccea-4dd1-bbed-7dbdfaf87556 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:01.737140 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f314ef-aa03-44fe-b158-964d2a049798 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.737667 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f314ef-aa03-44fe-b158-964d2a049798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.738285 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f314ef-aa03-44fe-b158-964d2a049798 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.747122 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bac2c2-12e2-4ce8-a8da-7092f1b0dff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:01.747783 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bac2c2-12e2-4ce8-a8da-7092f1b0dff3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.748059 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bac2c2-12e2-4ce8-a8da-7092f1b0dff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.748321 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bac2c2-12e2-4ce8-a8da-7092f1b0dff3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.749156 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bac2c2-12e2-4ce8-a8da-7092f1b0dff3 admin admin] RBAC: Adding query filter params (group.id=5ca0dfa6905142f1bfc55c5c0cfb20ab, role.id=fbf072f915fc46ee9a80c656e2bb2b30, scope.project.id=882013caabf941cd8a950baeb731deb7) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:01.749505 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bac2c2-12e2-4ce8-a8da-7092f1b0dff3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:01.751344 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bac2c2-12e2-4ce8-a8da-7092f1b0dff3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:01.753771 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f314ef-aa03-44fe-b158-964d2a049798 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:01.760585 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 178/359] 10.222.0.31 () {56 vars in 1397 bytes} [Thu Feb 10 20:46:01 2022] GET /identity/v3/role_assignments?group.id=5ca0dfa6905142f1bfc55c5c0cfb20ab&scope.project.id=882013caabf941cd8a950baeb731deb7&role.id=fbf072f915fc46ee9a80c656e2bb2b30 => generated 260 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:01.762666 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-b0f314ef-aa03-44fe-b158-964d2a049798 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 20:46:01.769631 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 182/360] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:01.776501 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bac2c2-12e2-4ce8-a8da-7092f1b0dff3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:01.793226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bac2c2-12e2-4ce8-a8da-7092f1b0dff3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:01.806304 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222a481-86e1-462f-ace6-a2e4dfdda50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:01.806999 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222a481-86e1-462f-ace6-a2e4dfdda50c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.807274 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222a481-86e1-462f-ace6-a2e4dfdda50c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.807537 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222a481-86e1-462f-ace6-a2e4dfdda50c admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.808311 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222a481-86e1-462f-ace6-a2e4dfdda50c admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:01.808607 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222a481-86e1-462f-ace6-a2e4dfdda50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:01.810302 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222a481-86e1-462f-ace6-a2e4dfdda50c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:01.824005 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 179/361] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:46:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:01.829561 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f314ef-aa03-44fe-b158-964d2a049798 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:01.843990 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f314ef-aa03-44fe-b158-964d2a049798 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:01.852583 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001ce1a-20f7-40e4-b4f0-c2aecc5d9c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:01.853920 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001ce1a-20f7-40e4-b4f0-c2aecc5d9c6f admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.854419 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001ce1a-20f7-40e4-b4f0-c2aecc5d9c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.854884 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001ce1a-20f7-40e4-b4f0-c2aecc5d9c6f admin admin] PATH_INFO: `/v3/users/aa7ead633df3422dafa32e7bd3a19979` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.862450 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001ce1a-20f7-40e4-b4f0-c2aecc5d9c6f admin admin] RBAC: Authorizing `identity:get_user(user_id=aa7ead633df3422dafa32e7bd3a19979)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:01.865064 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001ce1a-20f7-40e4-b4f0-c2aecc5d9c6f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:01.867052 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 183/362] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:46:01 2022] GET /identity/v3/users/aa7ead633df3422dafa32e7bd3a19979 => generated 293 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:01.873117 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222a481-86e1-462f-ace6-a2e4dfdda50c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:01.887136 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222a481-86e1-462f-ace6-a2e4dfdda50c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:01.893562 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f12536-aa8e-43c0-8f9b-f3ffbb8efa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:01.894276 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f12536-aa8e-43c0-8f9b-f3ffbb8efa51 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:01.894552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f12536-aa8e-43c0-8f9b-f3ffbb8efa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:01.894827 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f12536-aa8e-43c0-8f9b-f3ffbb8efa51 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:01.895765 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f12536-aa8e-43c0-8f9b-f3ffbb8efa51 admin admin] RBAC: Adding query filter params (role.id=b235f70dfa2a42308edd90003e99cd24, user.id=aa7ead633df3422dafa32e7bd3a19979, scope.system=all) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:01.896069 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f12536-aa8e-43c0-8f9b-f3ffbb8efa51 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:01.898142 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f12536-aa8e-43c0-8f9b-f3ffbb8efa51 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:01.916010 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 180/363] 10.222.0.31 () {56 vars in 1329 bytes} [Thu Feb 10 20:46:01 2022] GET /identity/v3/role_assignments?user.id=aa7ead633df3422dafa32e7bd3a19979&scope.system=all&role.id=b235f70dfa2a42308edd90003e99cd24 => generated 510 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:02.361110 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9046e-0226-4a12-833b-025b47a4752a None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:02.362181 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9046e-0226-4a12-833b-025b47a4752a None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:02.362656 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9046e-0226-4a12-833b-025b47a4752a None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:02.364678 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 184/364] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:02.370481 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f83d6-c568-4321-91af-78390343cad6 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:02.370911 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f83d6-c568-4321-91af-78390343cad6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:02.371085 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f83d6-c568-4321-91af-78390343cad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:02.392688 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-810f83d6-c568-4321-91af-78390343cad6 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:02.393887 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-810f83d6-c568-4321-91af-78390343cad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:02.401750 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 181/365] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:02.426290 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9046e-0226-4a12-833b-025b47a4752a None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:02.441979 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9046e-0226-4a12-833b-025b47a4752a None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:02.452221 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38256603-7a4f-4968-8ee5-8acf14c8512a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:02.453302 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38256603-7a4f-4968-8ee5-8acf14c8512a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:02.453821 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38256603-7a4f-4968-8ee5-8acf14c8512a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:02.454285 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38256603-7a4f-4968-8ee5-8acf14c8512a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:02.468973 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38256603-7a4f-4968-8ee5-8acf14c8512a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:02.476729 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-38256603-7a4f-4968-8ee5-8acf14c8512a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 20:46:02.478567 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 185/366] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 10 20:46:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:02.484093 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f83d6-c568-4321-91af-78390343cad6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:02.498313 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f83d6-c568-4321-91af-78390343cad6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:02.511716 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8abe5-d5be-47b1-bd4e-f17a8616c585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:02.512394 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8abe5-d5be-47b1-bd4e-f17a8616c585 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:02.512666 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8abe5-d5be-47b1-bd4e-f17a8616c585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:02.512928 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8abe5-d5be-47b1-bd4e-f17a8616c585 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:02.513732 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8abe5-d5be-47b1-bd4e-f17a8616c585 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:02.514029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8abe5-d5be-47b1-bd4e-f17a8616c585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:02.515637 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8abe5-d5be-47b1-bd4e-f17a8616c585 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:02.530545 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 182/367] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:02.535837 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38256603-7a4f-4968-8ee5-8acf14c8512a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:02.554658 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38256603-7a4f-4968-8ee5-8acf14c8512a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:02.560416 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2e98b-0d8a-447f-946a-a8f72eac2cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:02.561119 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2e98b-0d8a-447f-946a-a8f72eac2cbd admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:02.561413 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2e98b-0d8a-447f-946a-a8f72eac2cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:02.561684 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2e98b-0d8a-447f-946a-a8f72eac2cbd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:02.577677 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2e98b-0d8a-447f-946a-a8f72eac2cbd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:02.579511 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2e98b-0d8a-447f-946a-a8f72eac2cbd admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:02.592938 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 186/368] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:46:02.598527 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8abe5-d5be-47b1-bd4e-f17a8616c585 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:02.610532 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8abe5-d5be-47b1-bd4e-f17a8616c585 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:02.617200 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6746462-a4aa-4f93-9d2a-956c662b8e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:02.618378 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6746462-a4aa-4f93-9d2a-956c662b8e7a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:02.618905 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6746462-a4aa-4f93-9d2a-956c662b8e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:02.619360 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6746462-a4aa-4f93-9d2a-956c662b8e7a admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:02.626245 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6746462-a4aa-4f93-9d2a-956c662b8e7a admin admin] RBAC: Authorizing `identity:get_project(project_id=cd4c62df74e348508599a155b573abec)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:02.628745 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6746462-a4aa-4f93-9d2a-956c662b8e7a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:02.631285 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 183/369] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:46:02 2022] GET /identity/v3/projects/cd4c62df74e348508599a155b573abec => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:02.636470 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2e98b-0d8a-447f-946a-a8f72eac2cbd admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:02.648890 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2e98b-0d8a-447f-946a-a8f72eac2cbd admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:02.657853 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a0ad9-c8d4-48f3-ab58-e65e3a931a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:02.658710 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a0ad9-c8d4-48f3-ab58-e65e3a931a52 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:02.658995 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a0ad9-c8d4-48f3-ab58-e65e3a931a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:02.659249 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a0ad9-c8d4-48f3-ab58-e65e3a931a52 admin admin] PATH_INFO: `/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:02.662144 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a0ad9-c8d4-48f3-ab58-e65e3a931a52 admin admin] RBAC: Authorizing `identity:get_group(group_id=5ca0dfa6905142f1bfc55c5c0cfb20ab)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:02.664118 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a0ad9-c8d4-48f3-ab58-e65e3a931a52 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:02.666136 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 187/370] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 10 20:46:02 2022] GET /identity/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:02.671928 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6746462-a4aa-4f93-9d2a-956c662b8e7a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:02.686745 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6746462-a4aa-4f93-9d2a-956c662b8e7a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:02.692186 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fea66-745e-4f82-873d-17b4a421e3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:02.693105 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fea66-745e-4f82-873d-17b4a421e3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:02.693802 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fea66-745e-4f82-873d-17b4a421e3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:02.694319 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fea66-745e-4f82-873d-17b4a421e3e9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:02.695548 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845fea66-745e-4f82-873d-17b4a421e3e9 admin admin] RBAC: Adding query filter params (group.id=5ca0dfa6905142f1bfc55c5c0cfb20ab, role.id=fbf072f915fc46ee9a80c656e2bb2b30, scope.project.id=cd4c62df74e348508599a155b573abec) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:02.696058 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845fea66-745e-4f82-873d-17b4a421e3e9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:02.704173 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845fea66-745e-4f82-873d-17b4a421e3e9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:02.711203 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 184/371] 10.222.0.31 () {56 vars in 1397 bytes} [Thu Feb 10 20:46:02 2022] GET /identity/v3/role_assignments?group.id=5ca0dfa6905142f1bfc55c5c0cfb20ab&scope.project.id=cd4c62df74e348508599a155b573abec&role.id=fbf072f915fc46ee9a80c656e2bb2b30 => generated 260 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:03.060835 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49add2-ca90-4edd-ade0-db8c7575decb None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:03.061541 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49add2-ca90-4edd-ade0-db8c7575decb None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:03.062013 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49add2-ca90-4edd-ade0-db8c7575decb None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:03.064231 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 188/372] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:03.070098 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f2f0e-eb6c-4dd3-b08e-c1f6d3975351 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:03.070617 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f2f0e-eb6c-4dd3-b08e-c1f6d3975351 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:03.071088 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f2f0e-eb6c-4dd3-b08e-c1f6d3975351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:03.098585 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-3a0f2f0e-eb6c-4dd3-b08e-c1f6d3975351 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:03.100183 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3a0f2f0e-eb6c-4dd3-b08e-c1f6d3975351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:03.108585 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 185/373] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:46:03.149770 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49add2-ca90-4edd-ade0-db8c7575decb None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:03.166666 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49add2-ca90-4edd-ade0-db8c7575decb None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:03.171412 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3d4e6-0b39-421c-a878-1b0e52892034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:03.172452 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3d4e6-0b39-421c-a878-1b0e52892034 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:03.172913 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3d4e6-0b39-421c-a878-1b0e52892034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:03.173389 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3d4e6-0b39-421c-a878-1b0e52892034 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:03.185317 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3d4e6-0b39-421c-a878-1b0e52892034 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:03.192505 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-9bf3d4e6-0b39-421c-a878-1b0e52892034 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:46:03.197222 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 189/374] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:46:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:03.202218 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f2f0e-eb6c-4dd3-b08e-c1f6d3975351 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:03.211747 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f2f0e-eb6c-4dd3-b08e-c1f6d3975351 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:03.218161 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b2114-0012-46e4-be4d-497c5eb2de3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:03.219117 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b2114-0012-46e4-be4d-497c5eb2de3e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:03.219581 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b2114-0012-46e4-be4d-497c5eb2de3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:03.220031 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b2114-0012-46e4-be4d-497c5eb2de3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:03.220974 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b2114-0012-46e4-be4d-497c5eb2de3e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:03.221546 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b2114-0012-46e4-be4d-497c5eb2de3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:03.223334 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b2114-0012-46e4-be4d-497c5eb2de3e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:03.232476 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 186/375] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:03.238667 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3d4e6-0b39-421c-a878-1b0e52892034 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:03.249380 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3d4e6-0b39-421c-a878-1b0e52892034 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:03.255635 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a38cf4-b07b-4677-9a4f-4c07b4bc91b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:03.256661 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a38cf4-b07b-4677-9a4f-4c07b4bc91b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:03.257221 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a38cf4-b07b-4677-9a4f-4c07b4bc91b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:03.257821 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a38cf4-b07b-4677-9a4f-4c07b4bc91b5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:03.267658 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a38cf4-b07b-4677-9a4f-4c07b4bc91b5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:03.272080 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a38cf4-b07b-4677-9a4f-4c07b4bc91b5 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:03.286941 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 190/376] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:46:03.290970 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b2114-0012-46e4-be4d-497c5eb2de3e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:03.304895 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b2114-0012-46e4-be4d-497c5eb2de3e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:03.309814 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4a886-01cf-436e-bec1-31ad65986579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:03.311031 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4a886-01cf-436e-bec1-31ad65986579 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:03.311543 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4a886-01cf-436e-bec1-31ad65986579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:03.312037 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4a886-01cf-436e-bec1-31ad65986579 admin admin] PATH_INFO: `/v3/projects/3c795df8915a438b8adfbed3181b36a2` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:03.313438 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4a886-01cf-436e-bec1-31ad65986579 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c795df8915a438b8adfbed3181b36a2)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:03.315524 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4a886-01cf-436e-bec1-31ad65986579 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:03.321476 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 187/377] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:46:03 2022] GET /identity/v3/projects/3c795df8915a438b8adfbed3181b36a2 => generated 344 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:03.323810 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a38cf4-b07b-4677-9a4f-4c07b4bc91b5 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:03.333207 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a38cf4-b07b-4677-9a4f-4c07b4bc91b5 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:03.337941 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06540c-98a6-4eef-b35d-4cdb9b5ac19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:03.339116 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06540c-98a6-4eef-b35d-4cdb9b5ac19d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:03.339578 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06540c-98a6-4eef-b35d-4cdb9b5ac19d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:03.340030 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06540c-98a6-4eef-b35d-4cdb9b5ac19d admin admin] PATH_INFO: `/v3/groups/ff9d8d29877c4b7684e40a5a841dfca4` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:03.345431 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06540c-98a6-4eef-b35d-4cdb9b5ac19d admin admin] RBAC: Authorizing `identity:get_group(group_id=ff9d8d29877c4b7684e40a5a841dfca4)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:03.347589 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06540c-98a6-4eef-b35d-4cdb9b5ac19d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:03.353500 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 191/378] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 10 20:46:03 2022] GET /identity/v3/groups/ff9d8d29877c4b7684e40a5a841dfca4 => generated 229 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:03.355983 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4a886-01cf-436e-bec1-31ad65986579 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:03.366167 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4a886-01cf-436e-bec1-31ad65986579 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:03.372984 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfff51a-7d68-4c3f-a389-478e4b608ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:03.374350 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfff51a-7d68-4c3f-a389-478e4b608ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:03.374838 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfff51a-7d68-4c3f-a389-478e4b608ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:03.375290 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfff51a-7d68-4c3f-a389-478e4b608ec7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:03.376344 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfff51a-7d68-4c3f-a389-478e4b608ec7 admin admin] RBAC: Adding query filter params (group.id=ff9d8d29877c4b7684e40a5a841dfca4, role.id=e06447c1c62d465c9f9c58168be71ed8, scope.project.id=3c795df8915a438b8adfbed3181b36a2) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:03.376881 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfff51a-7d68-4c3f-a389-478e4b608ec7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:03.378978 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfff51a-7d68-4c3f-a389-478e4b608ec7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:03.389538 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 188/379] 10.222.0.31 () {56 vars in 1397 bytes} [Thu Feb 10 20:46:03 2022] GET /identity/v3/role_assignments?group.id=ff9d8d29877c4b7684e40a5a841dfca4&scope.project.id=3c795df8915a438b8adfbed3181b36a2&role.id=e06447c1c62d465c9f9c58168be71ed8 => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:04.290413 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dce278-75a8-4051-a466-67f55091d541 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:04.291429 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dce278-75a8-4051-a466-67f55091d541 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:04.291899 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dce278-75a8-4051-a466-67f55091d541 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:04.294668 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 192/380] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:04.301726 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bd9ab-e266-452b-b1fb-36ba90a9e9c1 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:04.302342 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bd9ab-e266-452b-b1fb-36ba90a9e9c1 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:04.302803 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bd9ab-e266-452b-b1fb-36ba90a9e9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:04.322631 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-db7bd9ab-e266-452b-b1fb-36ba90a9e9c1 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:04.324157 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-db7bd9ab-e266-452b-b1fb-36ba90a9e9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:04.337427 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 189/381] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:04.355429 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dce278-75a8-4051-a466-67f55091d541 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:04.370606 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dce278-75a8-4051-a466-67f55091d541 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:04.375247 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99519e4-9c6b-430d-8918-e349ad940c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:04.376268 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99519e4-9c6b-430d-8918-e349ad940c3e admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:04.376732 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99519e4-9c6b-430d-8918-e349ad940c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:04.377198 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99519e4-9c6b-430d-8918-e349ad940c3e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:04.388096 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99519e4-9c6b-430d-8918-e349ad940c3e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:04.399713 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-d99519e4-9c6b-430d-8918-e349ad940c3e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 20:46:04.401215 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 193/382] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:04.407394 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bd9ab-e266-452b-b1fb-36ba90a9e9c1 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:04.417085 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bd9ab-e266-452b-b1fb-36ba90a9e9c1 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:04.424911 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d7d43-4222-436f-9a4f-62c7522ba6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:04.425846 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d7d43-4222-436f-9a4f-62c7522ba6ab admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:04.426334 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d7d43-4222-436f-9a4f-62c7522ba6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:04.426786 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d7d43-4222-436f-9a4f-62c7522ba6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:04.427783 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d7d43-4222-436f-9a4f-62c7522ba6ab admin admin] RBAC: Adding query filter params (name=member) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:04.428283 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d7d43-4222-436f-9a4f-62c7522ba6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:04.430161 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d7d43-4222-436f-9a4f-62c7522ba6ab admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:04.445253 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 190/383] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:46:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:04.450767 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99519e4-9c6b-430d-8918-e349ad940c3e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:04.460721 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99519e4-9c6b-430d-8918-e349ad940c3e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:04.467815 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383c957-9e03-4081-8e18-377c7061cf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:04.468983 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383c957-9e03-4081-8e18-377c7061cf43 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:04.469501 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383c957-9e03-4081-8e18-377c7061cf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:04.469982 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383c957-9e03-4081-8e18-377c7061cf43 admin admin] PATH_INFO: `/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:04.471358 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383c957-9e03-4081-8e18-377c7061cf43 admin admin] RBAC: Authorizing `identity:get_group(group_id=5ca0dfa6905142f1bfc55c5c0cfb20ab)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:04.473533 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383c957-9e03-4081-8e18-377c7061cf43 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:04.475673 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 194/384] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 10 20:46:04 2022] GET /identity/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:04.481023 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d7d43-4222-436f-9a4f-62c7522ba6ab admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:04.490652 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1dfb4-83d1-4934-8a3e-19d88229c61b None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:04.491203 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1dfb4-83d1-4934-8a3e-19d88229c61b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:04.491509 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d7d43-4222-436f-9a4f-62c7522ba6ab admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:04.491965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1dfb4-83d1-4934-8a3e-19d88229c61b None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:04.494215 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 195/385] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:04.501737 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa692ae-896a-4c60-b26b-b7a7c96c3c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:04.502603 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa692ae-896a-4c60-b26b-b7a7c96c3c80 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:04.502711 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280dd52-1942-4444-b929-4a817fc51841 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:04.502891 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa692ae-896a-4c60-b26b-b7a7c96c3c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:04.503145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa692ae-896a-4c60-b26b-b7a7c96c3c80 admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:04.503556 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280dd52-1942-4444-b929-4a817fc51841 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:04.504020 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280dd52-1942-4444-b929-4a817fc51841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:04.504352 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa692ae-896a-4c60-b26b-b7a7c96c3c80 admin admin] RBAC: Authorizing `identity:get_project(project_id=882013caabf941cd8a950baeb731deb7)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:04.506554 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa692ae-896a-4c60-b26b-b7a7c96c3c80 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:04.508519 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 191/386] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:46:04 2022] GET /identity/v3/projects/882013caabf941cd8a950baeb731deb7 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:04.513679 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa692ae-896a-4c60-b26b-b7a7c96c3c80 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:04.523226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa692ae-896a-4c60-b26b-b7a7c96c3c80 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:04.526741 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-3280dd52-1942-4444-b929-4a817fc51841 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:04.528165 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-3280dd52-1942-4444-b929-4a817fc51841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:04.545873 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cf3b6-4ed3-41c9-a4f0-9e480a8a6f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:04.547056 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cf3b6-4ed3-41c9-a4f0-9e480a8a6f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:04.547550 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cf3b6-4ed3-41c9-a4f0-9e480a8a6f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:04.548107 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cf3b6-4ed3-41c9-a4f0-9e480a8a6f5b admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:04.550064 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 196/387] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:46:04.550547 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cf3b6-4ed3-41c9-a4f0-9e480a8a6f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=882013caabf941cd8a950baeb731deb7, group_id=5ca0dfa6905142f1bfc55c5c0cfb20ab, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:04.555573 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cf3b6-4ed3-41c9-a4f0-9e480a8a6f5b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:04.574942 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 192/388] 10.222.0.31 () {58 vars in 1463 bytes} [Thu Feb 10 20:46:04 2022] PUT /identity/v3/projects/882013caabf941cd8a950baeb731deb7/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:46:04.591133 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280dd52-1942-4444-b929-4a817fc51841 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:04.607981 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280dd52-1942-4444-b929-4a817fc51841 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:04.687072 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fe5e4-3aba-4826-bc51-d3184b3575aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:04.687913 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fe5e4-3aba-4826-bc51-d3184b3575aa admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:04.688197 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fe5e4-3aba-4826-bc51-d3184b3575aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:04.688529 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fe5e4-3aba-4826-bc51-d3184b3575aa admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:04.706741 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0fe5e4-3aba-4826-bc51-d3184b3575aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:04.714343 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-3a0fe5e4-3aba-4826-bc51-d3184b3575aa admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 20:46:04.716012 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 197/389] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 10 20:46:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:04.721549 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cf3b6-4ed3-41c9-a4f0-9e480a8a6f5b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:04.735499 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cf3b6-4ed3-41c9-a4f0-9e480a8a6f5b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:04.739235 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015721af-e495-4dd9-98fb-2ddec25c42ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:04.739937 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015721af-e495-4dd9-98fb-2ddec25c42ad admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:04.740202 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015721af-e495-4dd9-98fb-2ddec25c42ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:04.740472 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015721af-e495-4dd9-98fb-2ddec25c42ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:04.741245 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015721af-e495-4dd9-98fb-2ddec25c42ad admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:04.741579 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015721af-e495-4dd9-98fb-2ddec25c42ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:04.743289 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015721af-e495-4dd9-98fb-2ddec25c42ad admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:04.755060 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 193/390] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:04.760802 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fe5e4-3aba-4826-bc51-d3184b3575aa admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:04.774941 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fe5e4-3aba-4826-bc51-d3184b3575aa admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:04.783456 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddada2-6ae4-45d4-a68b-ce6286fa6703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:04.784348 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddada2-6ae4-45d4-a68b-ce6286fa6703 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:04.784621 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddada2-6ae4-45d4-a68b-ce6286fa6703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:04.784954 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddada2-6ae4-45d4-a68b-ce6286fa6703 admin admin] PATH_INFO: `/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:04.786201 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddada2-6ae4-45d4-a68b-ce6286fa6703 admin admin] RBAC: Authorizing `identity:get_group(group_id=5ca0dfa6905142f1bfc55c5c0cfb20ab)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:04.788156 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddada2-6ae4-45d4-a68b-ce6286fa6703 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:04.790953 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 198/391] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 10 20:46:04 2022] GET /identity/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:04.795625 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015721af-e495-4dd9-98fb-2ddec25c42ad admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:04.806419 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015721af-e495-4dd9-98fb-2ddec25c42ad admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:04.813065 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edf157-2bde-4fa1-aff7-164d3a21ae14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:04.814338 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edf157-2bde-4fa1-aff7-164d3a21ae14 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:04.814833 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edf157-2bde-4fa1-aff7-164d3a21ae14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:04.815317 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edf157-2bde-4fa1-aff7-164d3a21ae14 admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:04.816814 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08edf157-2bde-4fa1-aff7-164d3a21ae14 admin admin] RBAC: Authorizing `identity:get_project(project_id=882013caabf941cd8a950baeb731deb7)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:04.819327 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08edf157-2bde-4fa1-aff7-164d3a21ae14 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:04.821868 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 194/392] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:46:04 2022] GET /identity/v3/projects/882013caabf941cd8a950baeb731deb7 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:04.830069 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddada2-6ae4-45d4-a68b-ce6286fa6703 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:04.842457 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddada2-6ae4-45d4-a68b-ce6286fa6703 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:04.849379 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c473a8-2a0f-4c68-8900-d2b90e74b960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:04.850259 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c473a8-2a0f-4c68-8900-d2b90e74b960 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:04.850539 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c473a8-2a0f-4c68-8900-d2b90e74b960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:04.850809 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c473a8-2a0f-4c68-8900-d2b90e74b960 admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab/roles/fbf072f915fc46ee9a80c656e2bb2b30` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:04.853115 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c473a8-2a0f-4c68-8900-d2b90e74b960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=882013caabf941cd8a950baeb731deb7, group_id=5ca0dfa6905142f1bfc55c5c0cfb20ab, role_id=fbf072f915fc46ee9a80c656e2bb2b30)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:04.859889 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c473a8-2a0f-4c68-8900-d2b90e74b960 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:04.892073 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 199/393] 10.222.0.31 () {58 vars in 1463 bytes} [Thu Feb 10 20:46:04 2022] PUT /identity/v3/projects/882013caabf941cd8a950baeb731deb7/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab/roles/fbf072f915fc46ee9a80c656e2bb2b30 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:46:05.226100 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80845cc1-8a25-4c42-8ee5-c6d2c7c38108 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:05.226487 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80845cc1-8a25-4c42-8ee5-c6d2c7c38108 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:05.226655 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80845cc1-8a25-4c42-8ee5-c6d2c7c38108 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:05.228845 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 195/394] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:05.237061 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d04c3-2b08-4d09-9227-b00482c4f505 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:05.237332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d04c3-2b08-4d09-9227-b00482c4f505 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:05.237620 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d04c3-2b08-4d09-9227-b00482c4f505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:05.256671 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-127d04c3-2b08-4d09-9227-b00482c4f505 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:05.257895 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-127d04c3-2b08-4d09-9227-b00482c4f505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:05.319423 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 200/395] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:46:05.341950 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80845cc1-8a25-4c42-8ee5-c6d2c7c38108 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:05.354909 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80845cc1-8a25-4c42-8ee5-c6d2c7c38108 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:05.359953 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8e3e4-e0a2-4122-9747-0fab63ead0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:05.360806 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8e3e4-e0a2-4122-9747-0fab63ead0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:05.361079 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8e3e4-e0a2-4122-9747-0fab63ead0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:05.361342 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8e3e4-e0a2-4122-9747-0fab63ead0e7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:05.374803 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8e3e4-e0a2-4122-9747-0fab63ead0e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:05.381625 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-71c8e3e4-e0a2-4122-9747-0fab63ead0e7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 20:46:05.385433 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 196/396] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:05.389053 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d04c3-2b08-4d09-9227-b00482c4f505 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:05.398595 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d04c3-2b08-4d09-9227-b00482c4f505 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:05.408953 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a272d10-c578-4101-bbc6-62f8f3683fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:05.409687 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a272d10-c578-4101-bbc6-62f8f3683fdb admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:05.409959 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a272d10-c578-4101-bbc6-62f8f3683fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:05.410265 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a272d10-c578-4101-bbc6-62f8f3683fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:05.411030 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a272d10-c578-4101-bbc6-62f8f3683fdb admin admin] RBAC: Adding query filter params (name=member) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:05.411325 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a272d10-c578-4101-bbc6-62f8f3683fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:05.413061 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a272d10-c578-4101-bbc6-62f8f3683fdb admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:05.427912 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 201/397] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:46:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:05.429253 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8e3e4-e0a2-4122-9747-0fab63ead0e7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:05.442918 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8e3e4-e0a2-4122-9747-0fab63ead0e7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:05.453403 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448f606-01e6-4e2d-8a02-6587a02ae6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:05.454539 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448f606-01e6-4e2d-8a02-6587a02ae6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:05.455041 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448f606-01e6-4e2d-8a02-6587a02ae6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:05.455517 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448f606-01e6-4e2d-8a02-6587a02ae6f3 admin admin] PATH_INFO: `/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:05.456927 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448f606-01e6-4e2d-8a02-6587a02ae6f3 admin admin] RBAC: Authorizing `identity:get_group(group_id=5ca0dfa6905142f1bfc55c5c0cfb20ab)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:05.458182 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-3448f606-01e6-4e2d-8a02-6587a02ae6f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:46:05.458182 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Feb 10 20:46:05.458182 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: Feb 10 20:46:05.459712 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448f606-01e6-4e2d-8a02-6587a02ae6f3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:05.461870 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 197/398] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 10 20:46:05 2022] GET /identity/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:05.468196 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a272d10-c578-4101-bbc6-62f8f3683fdb admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:05.478350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a272d10-c578-4101-bbc6-62f8f3683fdb admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:05.490604 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789f1fc-8a20-45a5-a7e8-b5127991b87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:05.491474 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789f1fc-8a20-45a5-a7e8-b5127991b87c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:05.491752 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789f1fc-8a20-45a5-a7e8-b5127991b87c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:05.492025 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789f1fc-8a20-45a5-a7e8-b5127991b87c admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:05.498142 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789f1fc-8a20-45a5-a7e8-b5127991b87c admin admin] RBAC: Authorizing `identity:get_project(project_id=cd4c62df74e348508599a155b573abec)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:05.500280 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789f1fc-8a20-45a5-a7e8-b5127991b87c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:05.501208 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a40217-6231-4dc4-bce3-49eafb95ca93 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:05.501716 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a40217-6231-4dc4-bce3-49eafb95ca93 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:05.502181 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a40217-6231-4dc4-bce3-49eafb95ca93 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:05.502349 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 202/399] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:46:05 2022] GET /identity/v3/projects/cd4c62df74e348508599a155b573abec => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:05.504526 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 198/400] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:46:05.507743 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789f1fc-8a20-45a5-a7e8-b5127991b87c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:05.509406 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eeecbf-c8ae-4cc5-bb53-98f5f1b19025 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:05.509738 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eeecbf-c8ae-4cc5-bb53-98f5f1b19025 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:05.510008 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eeecbf-c8ae-4cc5-bb53-98f5f1b19025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:05.526958 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789f1fc-8a20-45a5-a7e8-b5127991b87c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:05.541176 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96c0a6-13e5-440f-9c20-eddafa763645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:05.544460 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96c0a6-13e5-440f-9c20-eddafa763645 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:05.544460 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96c0a6-13e5-440f-9c20-eddafa763645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:05.544460 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96c0a6-13e5-440f-9c20-eddafa763645 admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:05.547737 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-56eeecbf-c8ae-4cc5-bb53-98f5f1b19025 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:05.548937 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-56eeecbf-c8ae-4cc5-bb53-98f5f1b19025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:05.550546 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96c0a6-13e5-440f-9c20-eddafa763645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4c62df74e348508599a155b573abec, group_id=5ca0dfa6905142f1bfc55c5c0cfb20ab, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:05.553188 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96c0a6-13e5-440f-9c20-eddafa763645 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:05.565215 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 199/401] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:05.580437 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 203/402] 10.222.0.31 () {58 vars in 1463 bytes} [Thu Feb 10 20:46:05 2022] PUT /identity/v3/projects/cd4c62df74e348508599a155b573abec/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:46:05.588819 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eeecbf-c8ae-4cc5-bb53-98f5f1b19025 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:05.598697 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eeecbf-c8ae-4cc5-bb53-98f5f1b19025 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:05.670755 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f4668-1fd1-4420-8b2c-1dd73245f6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:05.671579 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f4668-1fd1-4420-8b2c-1dd73245f6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:05.671858 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f4668-1fd1-4420-8b2c-1dd73245f6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:05.672124 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f4668-1fd1-4420-8b2c-1dd73245f6b6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:05.684555 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f4668-1fd1-4420-8b2c-1dd73245f6b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:05.697585 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-b14f4668-1fd1-4420-8b2c-1dd73245f6b6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 20:46:05.699396 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 200/403] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 10 20:46:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:05.705070 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96c0a6-13e5-440f-9c20-eddafa763645 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:05.716280 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96c0a6-13e5-440f-9c20-eddafa763645 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:05.721553 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab079c1-0617-414d-96a2-012825cba7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:05.722240 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab079c1-0617-414d-96a2-012825cba7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:05.722561 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab079c1-0617-414d-96a2-012825cba7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:05.722830 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab079c1-0617-414d-96a2-012825cba7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:05.723604 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab079c1-0617-414d-96a2-012825cba7d5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:05.723956 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab079c1-0617-414d-96a2-012825cba7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:05.725728 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab079c1-0617-414d-96a2-012825cba7d5 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:05.737091 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 204/404] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:05.742336 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f4668-1fd1-4420-8b2c-1dd73245f6b6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:05.753000 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f4668-1fd1-4420-8b2c-1dd73245f6b6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:05.761952 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacba15a-f79b-4c1f-bfb9-7c23559fb3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:05.762884 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacba15a-f79b-4c1f-bfb9-7c23559fb3ca admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:05.763162 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacba15a-f79b-4c1f-bfb9-7c23559fb3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:05.763432 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacba15a-f79b-4c1f-bfb9-7c23559fb3ca admin admin] PATH_INFO: `/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:05.764771 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacba15a-f79b-4c1f-bfb9-7c23559fb3ca admin admin] RBAC: Authorizing `identity:get_group(group_id=5ca0dfa6905142f1bfc55c5c0cfb20ab)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:05.766940 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacba15a-f79b-4c1f-bfb9-7c23559fb3ca admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:05.768874 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 201/405] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 10 20:46:05 2022] GET /identity/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:05.774477 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab079c1-0617-414d-96a2-012825cba7d5 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:05.785319 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab079c1-0617-414d-96a2-012825cba7d5 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:05.790820 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1119cb-9212-45ef-a95f-9523b383663f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:05.791844 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1119cb-9212-45ef-a95f-9523b383663f admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:05.792120 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1119cb-9212-45ef-a95f-9523b383663f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:05.792396 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1119cb-9212-45ef-a95f-9523b383663f admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:05.794679 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1119cb-9212-45ef-a95f-9523b383663f admin admin] RBAC: Authorizing `identity:get_project(project_id=cd4c62df74e348508599a155b573abec)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:05.796854 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1119cb-9212-45ef-a95f-9523b383663f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:05.798749 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 205/406] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:46:05 2022] GET /identity/v3/projects/cd4c62df74e348508599a155b573abec => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:05.804603 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacba15a-f79b-4c1f-bfb9-7c23559fb3ca admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:05.816069 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacba15a-f79b-4c1f-bfb9-7c23559fb3ca admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:05.825999 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adfc23-ac87-4bcb-9b71-8ae508641b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:05.826961 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adfc23-ac87-4bcb-9b71-8ae508641b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:05.827237 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adfc23-ac87-4bcb-9b71-8ae508641b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:05.827552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adfc23-ac87-4bcb-9b71-8ae508641b6a admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab/roles/fbf072f915fc46ee9a80c656e2bb2b30` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:05.830082 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68adfc23-ac87-4bcb-9b71-8ae508641b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4c62df74e348508599a155b573abec, group_id=5ca0dfa6905142f1bfc55c5c0cfb20ab, role_id=fbf072f915fc46ee9a80c656e2bb2b30)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:05.832921 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68adfc23-ac87-4bcb-9b71-8ae508641b6a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:05.863362 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 202/407] 10.222.0.31 () {58 vars in 1463 bytes} [Thu Feb 10 20:46:05 2022] PUT /identity/v3/projects/cd4c62df74e348508599a155b573abec/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab/roles/fbf072f915fc46ee9a80c656e2bb2b30 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:46:06.408393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d059d4-b48e-4f7b-8152-7d4c57d2ebde None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:06.409104 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d059d4-b48e-4f7b-8152-7d4c57d2ebde None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:06.409104 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d059d4-b48e-4f7b-8152-7d4c57d2ebde None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:06.411387 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 206/408] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:06.418355 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dd1fe-7817-49bb-9fe8-5cdecdf94f0d None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:06.418355 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dd1fe-7817-49bb-9fe8-5cdecdf94f0d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:06.418355 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dd1fe-7817-49bb-9fe8-5cdecdf94f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:06.442318 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-fc2dd1fe-7817-49bb-9fe8-5cdecdf94f0d None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:06.444242 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-fc2dd1fe-7817-49bb-9fe8-5cdecdf94f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:06.520023 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 203/409] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:06.554099 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d059d4-b48e-4f7b-8152-7d4c57d2ebde None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:06.575407 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d059d4-b48e-4f7b-8152-7d4c57d2ebde None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:06.584997 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad969dd8-b2f3-4686-9dd9-7a2557214589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:06.585830 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad969dd8-b2f3-4686-9dd9-7a2557214589 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:06.586106 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad969dd8-b2f3-4686-9dd9-7a2557214589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:06.586373 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad969dd8-b2f3-4686-9dd9-7a2557214589 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:06.597730 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad969dd8-b2f3-4686-9dd9-7a2557214589 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:06.608608 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-ad969dd8-b2f3-4686-9dd9-7a2557214589 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:46:06.610258 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 207/410] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:46:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:06.615754 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dd1fe-7817-49bb-9fe8-5cdecdf94f0d None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:06.627546 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dd1fe-7817-49bb-9fe8-5cdecdf94f0d None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:06.639858 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ef194-5172-4bc0-999f-4d310a722c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:06.640812 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ef194-5172-4bc0-999f-4d310a722c19 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:06.641287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ef194-5172-4bc0-999f-4d310a722c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:06.641829 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ef194-5172-4bc0-999f-4d310a722c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:06.642808 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ef194-5172-4bc0-999f-4d310a722c19 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:06.643320 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ef194-5172-4bc0-999f-4d310a722c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:06.645128 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ef194-5172-4bc0-999f-4d310a722c19 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:06.660256 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 204/411] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:06.665494 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad969dd8-b2f3-4686-9dd9-7a2557214589 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:06.675374 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad969dd8-b2f3-4686-9dd9-7a2557214589 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:06.685272 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba92dd-4da6-480f-a82d-0be7776fc7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:06.686153 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba92dd-4da6-480f-a82d-0be7776fc7cf admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:06.686427 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba92dd-4da6-480f-a82d-0be7776fc7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:06.686702 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba92dd-4da6-480f-a82d-0be7776fc7cf admin admin] PATH_INFO: `/v3/groups/ff9d8d29877c4b7684e40a5a841dfca4` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:06.687869 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba92dd-4da6-480f-a82d-0be7776fc7cf admin admin] RBAC: Authorizing `identity:get_group(group_id=ff9d8d29877c4b7684e40a5a841dfca4)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:06.689786 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba92dd-4da6-480f-a82d-0be7776fc7cf admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:06.695702 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 208/412] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 10 20:46:06 2022] GET /identity/v3/groups/ff9d8d29877c4b7684e40a5a841dfca4 => generated 229 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:06.696945 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ef194-5172-4bc0-999f-4d310a722c19 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:06.710451 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ef194-5172-4bc0-999f-4d310a722c19 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:06.721564 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c68367-7711-4b32-9832-dac35c954e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:06.722736 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c68367-7711-4b32-9832-dac35c954e48 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:06.723227 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c68367-7711-4b32-9832-dac35c954e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:06.723685 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c68367-7711-4b32-9832-dac35c954e48 admin admin] PATH_INFO: `/v3/projects/3c795df8915a438b8adfbed3181b36a2` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:06.730145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c68367-7711-4b32-9832-dac35c954e48 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c795df8915a438b8adfbed3181b36a2)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:06.732167 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c68367-7711-4b32-9832-dac35c954e48 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:06.734455 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 205/413] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:46:06 2022] GET /identity/v3/projects/3c795df8915a438b8adfbed3181b36a2 => generated 344 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:06.741194 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba92dd-4da6-480f-a82d-0be7776fc7cf admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:06.751360 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba92dd-4da6-480f-a82d-0be7776fc7cf admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:06.761525 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc69b5-8f3c-4792-a96e-9745501182f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:06.762671 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc69b5-8f3c-4792-a96e-9745501182f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:06.763183 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc69b5-8f3c-4792-a96e-9745501182f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:06.763649 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc69b5-8f3c-4792-a96e-9745501182f8 admin admin] PATH_INFO: `/v3/projects/3c795df8915a438b8adfbed3181b36a2/groups/ff9d8d29877c4b7684e40a5a841dfca4/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:06.766665 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc69b5-8f3c-4792-a96e-9745501182f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c795df8915a438b8adfbed3181b36a2, group_id=ff9d8d29877c4b7684e40a5a841dfca4, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:06.769527 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc69b5-8f3c-4792-a96e-9745501182f8 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:06.801540 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 209/414] 10.222.0.31 () {58 vars in 1463 bytes} [Thu Feb 10 20:46:06 2022] PUT /identity/v3/projects/3c795df8915a438b8adfbed3181b36a2/groups/ff9d8d29877c4b7684e40a5a841dfca4/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:46:07.424172 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbda3ea-3022-4cad-a973-4a6ec015aaef None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:07.424565 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbda3ea-3022-4cad-a973-4a6ec015aaef None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:07.424762 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbda3ea-3022-4cad-a973-4a6ec015aaef None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:07.426951 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 206/415] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:07.432884 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361243f-335c-413c-b92a-995a7a7ea3a2 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:07.433433 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361243f-335c-413c-b92a-995a7a7ea3a2 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:07.433433 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361243f-335c-413c-b92a-995a7a7ea3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:07.456260 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-b361243f-335c-413c-b92a-995a7a7ea3a2 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:07.457461 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b361243f-335c-413c-b92a-995a7a7ea3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:07.533387 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 210/416] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:07.572015 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbda3ea-3022-4cad-a973-4a6ec015aaef None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:07.590449 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbda3ea-3022-4cad-a973-4a6ec015aaef None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:07.599710 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee481c30-d177-47a1-84d6-82cba736b61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:07.600506 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee481c30-d177-47a1-84d6-82cba736b61f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:07.600781 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee481c30-d177-47a1-84d6-82cba736b61f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:07.601044 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee481c30-d177-47a1-84d6-82cba736b61f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:07.615269 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee481c30-d177-47a1-84d6-82cba736b61f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:07.622224 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-ee481c30-d177-47a1-84d6-82cba736b61f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 20:46:07.623426 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 207/417] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:07.629450 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361243f-335c-413c-b92a-995a7a7ea3a2 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:07.642940 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361243f-335c-413c-b92a-995a7a7ea3a2 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:07.647402 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41196d-7054-4538-bca0-15efc882a011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:07.648061 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41196d-7054-4538-bca0-15efc882a011 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:07.648332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41196d-7054-4538-bca0-15efc882a011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:07.648596 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41196d-7054-4538-bca0-15efc882a011 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:07.649375 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41196d-7054-4538-bca0-15efc882a011 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:07.649676 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41196d-7054-4538-bca0-15efc882a011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:07.651256 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41196d-7054-4538-bca0-15efc882a011 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:07.660590 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 211/418] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:46:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:07.666379 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee481c30-d177-47a1-84d6-82cba736b61f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:07.679157 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee481c30-d177-47a1-84d6-82cba736b61f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:07.685169 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd25f85-6742-4924-b199-4ba503453356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:07.685838 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd25f85-6742-4924-b199-4ba503453356 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:07.686116 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd25f85-6742-4924-b199-4ba503453356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:07.686384 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd25f85-6742-4924-b199-4ba503453356 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:07.696980 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd25f85-6742-4924-b199-4ba503453356 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:07.698768 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd25f85-6742-4924-b199-4ba503453356 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:07.709450 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 208/419] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:46:07.714881 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41196d-7054-4538-bca0-15efc882a011 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:07.725743 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41196d-7054-4538-bca0-15efc882a011 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:07.731451 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457ae7e-5295-4073-99db-b82822f6d5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:07.732545 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457ae7e-5295-4073-99db-b82822f6d5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:07.733021 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457ae7e-5295-4073-99db-b82822f6d5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:07.733552 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457ae7e-5295-4073-99db-b82822f6d5f5 admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:07.734965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457ae7e-5295-4073-99db-b82822f6d5f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=882013caabf941cd8a950baeb731deb7)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:07.737209 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457ae7e-5295-4073-99db-b82822f6d5f5 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:07.739458 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 212/420] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:46:07 2022] GET /identity/v3/projects/882013caabf941cd8a950baeb731deb7 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:07.745044 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd25f85-6742-4924-b199-4ba503453356 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:07.754866 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd25f85-6742-4924-b199-4ba503453356 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:07.759602 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de22ea-f717-41e0-9dae-98775ee36aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:07.760673 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de22ea-f717-41e0-9dae-98775ee36aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:07.761148 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de22ea-f717-41e0-9dae-98775ee36aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:07.761646 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de22ea-f717-41e0-9dae-98775ee36aa3 admin admin] PATH_INFO: `/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:07.763100 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de22ea-f717-41e0-9dae-98775ee36aa3 admin admin] RBAC: Authorizing `identity:get_group(group_id=5ca0dfa6905142f1bfc55c5c0cfb20ab)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:07.765187 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de22ea-f717-41e0-9dae-98775ee36aa3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:07.767313 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 209/421] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 10 20:46:07 2022] GET /identity/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:07.773270 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457ae7e-5295-4073-99db-b82822f6d5f5 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:07.783440 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457ae7e-5295-4073-99db-b82822f6d5f5 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:07.788553 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad33a35-1469-4cd1-9a9f-07c3259c5bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:07.789432 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad33a35-1469-4cd1-9a9f-07c3259c5bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:07.789894 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad33a35-1469-4cd1-9a9f-07c3259c5bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:07.790388 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad33a35-1469-4cd1-9a9f-07c3259c5bd6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:07.791362 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad33a35-1469-4cd1-9a9f-07c3259c5bd6 admin admin] RBAC: Adding query filter params (group.id=5ca0dfa6905142f1bfc55c5c0cfb20ab, role.id=80e0463ac1aa4ef2b3739b580669f095, scope.project.id=882013caabf941cd8a950baeb731deb7) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:07.791873 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad33a35-1469-4cd1-9a9f-07c3259c5bd6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:07.794071 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad33a35-1469-4cd1-9a9f-07c3259c5bd6 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:07.804541 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 213/422] 10.222.0.31 () {56 vars in 1397 bytes} [Thu Feb 10 20:46:07 2022] GET /identity/v3/role_assignments?group.id=5ca0dfa6905142f1bfc55c5c0cfb20ab&scope.project.id=882013caabf941cd8a950baeb731deb7&role.id=80e0463ac1aa4ef2b3739b580669f095 => generated 611 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:08.191829 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082259f7-2b27-41b2-a532-3fb314f402c6 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:08.192610 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082259f7-2b27-41b2-a532-3fb314f402c6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:08.193101 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082259f7-2b27-41b2-a532-3fb314f402c6 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:08.195116 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 210/423] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:08.201089 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e8a5a-919a-44e1-9a26-919a62454fc4 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:08.201388 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e8a5a-919a-44e1-9a26-919a62454fc4 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:08.201695 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e8a5a-919a-44e1-9a26-919a62454fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:08.225447 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-c70e8a5a-919a-44e1-9a26-919a62454fc4 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:08.226651 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-c70e8a5a-919a-44e1-9a26-919a62454fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:08.234898 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 214/424] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:08.262127 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082259f7-2b27-41b2-a532-3fb314f402c6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:08.280086 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082259f7-2b27-41b2-a532-3fb314f402c6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:08.288663 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1fd90-72e2-4eda-a680-fae17093fa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:08.289514 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1fd90-72e2-4eda-a680-fae17093fa92 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:08.289794 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1fd90-72e2-4eda-a680-fae17093fa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:08.290065 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1fd90-72e2-4eda-a680-fae17093fa92 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:08.307917 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1fd90-72e2-4eda-a680-fae17093fa92 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:08.316666 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-bba1fd90-72e2-4eda-a680-fae17093fa92 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 20:46:08.318243 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 211/425] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 10 20:46:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:08.324062 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e8a5a-919a-44e1-9a26-919a62454fc4 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:08.335963 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e8a5a-919a-44e1-9a26-919a62454fc4 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:08.346600 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62127acd-5b09-4751-b432-acf6dfd41bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:08.347282 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62127acd-5b09-4751-b432-acf6dfd41bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:08.347555 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62127acd-5b09-4751-b432-acf6dfd41bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:08.347821 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62127acd-5b09-4751-b432-acf6dfd41bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:08.348595 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62127acd-5b09-4751-b432-acf6dfd41bd1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:08.348892 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62127acd-5b09-4751-b432-acf6dfd41bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:08.350534 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62127acd-5b09-4751-b432-acf6dfd41bd1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:08.365098 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 215/426] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:08.370352 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1fd90-72e2-4eda-a680-fae17093fa92 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:08.383213 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1fd90-72e2-4eda-a680-fae17093fa92 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:08.389861 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe79e08-0fb8-46be-be56-073e6c8f446c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:08.390517 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe79e08-0fb8-46be-be56-073e6c8f446c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:08.390791 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe79e08-0fb8-46be-be56-073e6c8f446c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:08.391063 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe79e08-0fb8-46be-be56-073e6c8f446c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:08.403810 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe79e08-0fb8-46be-be56-073e6c8f446c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:08.405679 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe79e08-0fb8-46be-be56-073e6c8f446c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:08.419960 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 212/427] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:46:08.425727 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62127acd-5b09-4751-b432-acf6dfd41bd1 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:08.439152 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62127acd-5b09-4751-b432-acf6dfd41bd1 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:08.445745 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac66927-a6ef-4462-a7a5-f91f95ad997b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:08.446551 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac66927-a6ef-4462-a7a5-f91f95ad997b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:08.446829 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac66927-a6ef-4462-a7a5-f91f95ad997b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:08.447101 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac66927-a6ef-4462-a7a5-f91f95ad997b admin admin] PATH_INFO: `/v3/projects/882013caabf941cd8a950baeb731deb7` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:08.449092 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac66927-a6ef-4462-a7a5-f91f95ad997b admin admin] RBAC: Authorizing `identity:get_project(project_id=882013caabf941cd8a950baeb731deb7)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:08.451282 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac66927-a6ef-4462-a7a5-f91f95ad997b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:08.457523 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 216/428] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:46:08 2022] GET /identity/v3/projects/882013caabf941cd8a950baeb731deb7 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:08.459205 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe79e08-0fb8-46be-be56-073e6c8f446c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:08.468809 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe79e08-0fb8-46be-be56-073e6c8f446c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:08.476448 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059706b4-0c0a-404c-9671-21c636b9f8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:08.477339 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059706b4-0c0a-404c-9671-21c636b9f8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:08.477654 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059706b4-0c0a-404c-9671-21c636b9f8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:08.477922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059706b4-0c0a-404c-9671-21c636b9f8d9 admin admin] PATH_INFO: `/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:08.480242 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059706b4-0c0a-404c-9671-21c636b9f8d9 admin admin] RBAC: Authorizing `identity:get_group(group_id=5ca0dfa6905142f1bfc55c5c0cfb20ab)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:08.482302 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059706b4-0c0a-404c-9671-21c636b9f8d9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:08.484424 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 213/429] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 10 20:46:08 2022] GET /identity/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:08.490583 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac66927-a6ef-4462-a7a5-f91f95ad997b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:08.501550 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac66927-a6ef-4462-a7a5-f91f95ad997b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:08.508622 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa786f6-0c76-4e70-aca9-ba9f5b8f786e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:08.509284 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa786f6-0c76-4e70-aca9-ba9f5b8f786e admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:08.509591 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa786f6-0c76-4e70-aca9-ba9f5b8f786e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:08.509864 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa786f6-0c76-4e70-aca9-ba9f5b8f786e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:08.510725 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa786f6-0c76-4e70-aca9-ba9f5b8f786e admin admin] RBAC: Adding query filter params (group.id=5ca0dfa6905142f1bfc55c5c0cfb20ab, role.id=fbf072f915fc46ee9a80c656e2bb2b30, scope.project.id=882013caabf941cd8a950baeb731deb7) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:08.511012 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa786f6-0c76-4e70-aca9-ba9f5b8f786e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:08.512851 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa786f6-0c76-4e70-aca9-ba9f5b8f786e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:08.523611 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 217/430] 10.222.0.31 () {56 vars in 1397 bytes} [Thu Feb 10 20:46:08 2022] GET /identity/v3/role_assignments?group.id=5ca0dfa6905142f1bfc55c5c0cfb20ab&scope.project.id=882013caabf941cd8a950baeb731deb7&role.id=fbf072f915fc46ee9a80c656e2bb2b30 => generated 611 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:08.708851 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862da72-2988-4fd5-9cb3-b18a766918a3 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:08.709387 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862da72-2988-4fd5-9cb3-b18a766918a3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:08.709387 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862da72-2988-4fd5-9cb3-b18a766918a3 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:08.711186 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 214/431] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:08.717130 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dd09b-9867-41c7-9df7-a5b602c07338 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:08.717447 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dd09b-9867-41c7-9df7-a5b602c07338 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:08.717723 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dd09b-9867-41c7-9df7-a5b602c07338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:08.735799 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-fa1dd09b-9867-41c7-9df7-a5b602c07338 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:08.736967 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-fa1dd09b-9867-41c7-9df7-a5b602c07338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:08.749475 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 218/432] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:08.769753 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278640a-84f6-4640-85c8-e23ee79a4ace None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:08.770058 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278640a-84f6-4640-85c8-e23ee79a4ace None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:08.770299 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278640a-84f6-4640-85c8-e23ee79a4ace None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:08.773137 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 215/433] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:08.774308 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dd09b-9867-41c7-9df7-a5b602c07338 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:08.781428 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d91cae-7671-453d-bcab-6779d9d51c5e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:08.781717 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d91cae-7671-453d-bcab-6779d9d51c5e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:08.781971 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d91cae-7671-453d-bcab-6779d9d51c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:08.784610 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dd09b-9867-41c7-9df7-a5b602c07338 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:08.795113 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23490e1-6fed-4ec7-95bf-f92419a8b11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:08.795940 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23490e1-6fed-4ec7-95bf-f92419a8b11d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:08.796221 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23490e1-6fed-4ec7-95bf-f92419a8b11d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:08.796493 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23490e1-6fed-4ec7-95bf-f92419a8b11d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:08.805707 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-52d91cae-7671-453d-bcab-6779d9d51c5e None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:08.806911 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-52d91cae-7671-453d-bcab-6779d9d51c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:08.811308 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23490e1-6fed-4ec7-95bf-f92419a8b11d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:08.816262 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 216/434] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:46:08.818651 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-d23490e1-6fed-4ec7-95bf-f92419a8b11d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 20:46:08.819999 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 219/435] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 10 20:46:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:08.825525 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d91cae-7671-453d-bcab-6779d9d51c5e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:08.835104 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d91cae-7671-453d-bcab-6779d9d51c5e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:08.840253 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b0b1d-fef4-4b6f-9fc4-098a85f81648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:08.840916 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b0b1d-fef4-4b6f-9fc4-098a85f81648 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:08.841195 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b0b1d-fef4-4b6f-9fc4-098a85f81648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:08.841494 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b0b1d-fef4-4b6f-9fc4-098a85f81648 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:08.842356 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b0b1d-fef4-4b6f-9fc4-098a85f81648 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:08.842654 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b0b1d-fef4-4b6f-9fc4-098a85f81648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:08.843444 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23490e1-6fed-4ec7-95bf-f92419a8b11d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:08.844266 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b0b1d-fef4-4b6f-9fc4-098a85f81648 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:08.854317 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 217/436] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:08.854684 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23490e1-6fed-4ec7-95bf-f92419a8b11d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:08.859123 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54683b-7394-450e-8c07-94805eeffc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:08.859760 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b0b1d-fef4-4b6f-9fc4-098a85f81648 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:08.859921 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54683b-7394-450e-8c07-94805eeffc91 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:08.860169 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54683b-7394-450e-8c07-94805eeffc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:08.860435 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54683b-7394-450e-8c07-94805eeffc91 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:08.871262 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b0b1d-fef4-4b6f-9fc4-098a85f81648 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:08.874866 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54683b-7394-450e-8c07-94805eeffc91 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:08.875768 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75ff4a-7590-4f06-bfeb-e383c5a661ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:08.876405 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75ff4a-7590-4f06-bfeb-e383c5a661ea admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:08.876689 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75ff4a-7590-4f06-bfeb-e383c5a661ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:08.876959 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75ff4a-7590-4f06-bfeb-e383c5a661ea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:08.883063 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-3f54683b-7394-450e-8c07-94805eeffc91 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 20:46:08.884363 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 220/437] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:08.885499 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75ff4a-7590-4f06-bfeb-e383c5a661ea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:08.887230 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75ff4a-7590-4f06-bfeb-e383c5a661ea admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:08.890417 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54683b-7394-450e-8c07-94805eeffc91 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:08.896548 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 218/438] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 20:46:08.899977 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54683b-7394-450e-8c07-94805eeffc91 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:08.901841 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75ff4a-7590-4f06-bfeb-e383c5a661ea admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:08.904819 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1117a6-44b8-4e04-b63b-0784236141dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:08.905499 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1117a6-44b8-4e04-b63b-0784236141dd admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:08.905784 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1117a6-44b8-4e04-b63b-0784236141dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:08.906040 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1117a6-44b8-4e04-b63b-0784236141dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:08.906792 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1117a6-44b8-4e04-b63b-0784236141dd admin admin] RBAC: Adding query filter params (name=member) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:08.907084 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1117a6-44b8-4e04-b63b-0784236141dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:08.908689 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1117a6-44b8-4e04-b63b-0784236141dd admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:08.912006 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75ff4a-7590-4f06-bfeb-e383c5a661ea admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:08.916897 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fa086-c06c-4d0a-a587-67c4932ea2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:08.917785 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fa086-c06c-4d0a-a587-67c4932ea2ae admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:08.918064 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fa086-c06c-4d0a-a587-67c4932ea2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:08.918329 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fa086-c06c-4d0a-a587-67c4932ea2ae admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:08.919543 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fa086-c06c-4d0a-a587-67c4932ea2ae admin admin] RBAC: Authorizing `identity:get_project(project_id=cd4c62df74e348508599a155b573abec)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:08.921716 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fa086-c06c-4d0a-a587-67c4932ea2ae admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:08.923539 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 219/440] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:46:08 2022] GET /identity/v3/projects/cd4c62df74e348508599a155b573abec => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:08.923654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 221/440] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:46:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:08.928450 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fa086-c06c-4d0a-a587-67c4932ea2ae admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:08.928648 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1117a6-44b8-4e04-b63b-0784236141dd admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:08.938713 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fa086-c06c-4d0a-a587-67c4932ea2ae admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:08.938876 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1117a6-44b8-4e04-b63b-0784236141dd admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:08.942490 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c0259-f2cb-41a0-b686-5681c410b731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:08.943129 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c0259-f2cb-41a0-b686-5681c410b731 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:08.943408 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c0259-f2cb-41a0-b686-5681c410b731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:08.943677 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c0259-f2cb-41a0-b686-5681c410b731 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:08.944259 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb49ba6-3acf-4471-a34a-af4cc01eb64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:08.945085 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb49ba6-3acf-4471-a34a-af4cc01eb64f admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:08.945429 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb49ba6-3acf-4471-a34a-af4cc01eb64f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:08.945747 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb49ba6-3acf-4471-a34a-af4cc01eb64f admin admin] PATH_INFO: `/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:08.946974 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb49ba6-3acf-4471-a34a-af4cc01eb64f admin admin] RBAC: Authorizing `identity:get_group(group_id=5ca0dfa6905142f1bfc55c5c0cfb20ab)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:08.949074 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb49ba6-3acf-4471-a34a-af4cc01eb64f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:08.951090 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 222/441] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 10 20:46:08 2022] GET /identity/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:08.952298 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c0259-f2cb-41a0-b686-5681c410b731 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:08.954183 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c0259-f2cb-41a0-b686-5681c410b731 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:08.956635 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb49ba6-3acf-4471-a34a-af4cc01eb64f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:08.968295 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb49ba6-3acf-4471-a34a-af4cc01eb64f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:08.970664 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 220/442] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:46:08.976021 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c0259-f2cb-41a0-b686-5681c410b731 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:08.976320 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ff108-68d0-404b-ae25-5acebc0869c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:08.977075 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ff108-68d0-404b-ae25-5acebc0869c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:08.977432 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ff108-68d0-404b-ae25-5acebc0869c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:08.977770 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ff108-68d0-404b-ae25-5acebc0869c3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:08.978679 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ff108-68d0-404b-ae25-5acebc0869c3 admin admin] RBAC: Adding query filter params (group.id=5ca0dfa6905142f1bfc55c5c0cfb20ab, role.id=fbf072f915fc46ee9a80c656e2bb2b30, scope.project.id=cd4c62df74e348508599a155b573abec) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:08.979052 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ff108-68d0-404b-ae25-5acebc0869c3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:08.982404 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ff108-68d0-404b-ae25-5acebc0869c3 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:08.986139 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c0259-f2cb-41a0-b686-5681c410b731 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:08.990478 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 223/443] 10.222.0.31 () {56 vars in 1397 bytes} [Thu Feb 10 20:46:08 2022] GET /identity/v3/role_assignments?group.id=5ca0dfa6905142f1bfc55c5c0cfb20ab&scope.project.id=cd4c62df74e348508599a155b573abec&role.id=fbf072f915fc46ee9a80c656e2bb2b30 => generated 611 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:08.991275 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c93a93-25bb-49f2-ad43-28cff57ebc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:08.992331 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c93a93-25bb-49f2-ad43-28cff57ebc3c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:08.992610 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c93a93-25bb-49f2-ad43-28cff57ebc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:08.992878 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c93a93-25bb-49f2-ad43-28cff57ebc3c admin admin] PATH_INFO: `/v3/projects/cd4c62df74e348508599a155b573abec` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:08.994138 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c93a93-25bb-49f2-ad43-28cff57ebc3c admin admin] RBAC: Authorizing `identity:get_project(project_id=cd4c62df74e348508599a155b573abec)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:08.996383 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c93a93-25bb-49f2-ad43-28cff57ebc3c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:08.999652 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 221/444] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:46:08 2022] GET /identity/v3/projects/cd4c62df74e348508599a155b573abec => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:09.004562 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ff108-68d0-404b-ae25-5acebc0869c3 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:09.017262 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ff108-68d0-404b-ae25-5acebc0869c3 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:09.021831 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbc463-8efa-43df-838d-cbaa38f82113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:09.022722 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbc463-8efa-43df-838d-cbaa38f82113 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:09.022998 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbc463-8efa-43df-838d-cbaa38f82113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:09.023273 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbc463-8efa-43df-838d-cbaa38f82113 admin admin] PATH_INFO: `/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:09.024523 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dbc463-8efa-43df-838d-cbaa38f82113 admin admin] RBAC: Authorizing `identity:get_group(group_id=5ca0dfa6905142f1bfc55c5c0cfb20ab)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:09.026534 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dbc463-8efa-43df-838d-cbaa38f82113 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:09.028574 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 224/445] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 10 20:46:09 2022] GET /identity/v3/groups/5ca0dfa6905142f1bfc55c5c0cfb20ab => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:09.036063 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c93a93-25bb-49f2-ad43-28cff57ebc3c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:09.047328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c93a93-25bb-49f2-ad43-28cff57ebc3c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:09.052642 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad44d6-038b-4554-9528-a43ff28f237e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:09.053319 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad44d6-038b-4554-9528-a43ff28f237e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:09.053631 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad44d6-038b-4554-9528-a43ff28f237e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:09.053902 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad44d6-038b-4554-9528-a43ff28f237e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:09.054763 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad44d6-038b-4554-9528-a43ff28f237e admin admin] RBAC: Adding query filter params (group.id=5ca0dfa6905142f1bfc55c5c0cfb20ab, role.id=80e0463ac1aa4ef2b3739b580669f095, scope.project.id=cd4c62df74e348508599a155b573abec) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:09.055063 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad44d6-038b-4554-9528-a43ff28f237e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:09.056953 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad44d6-038b-4554-9528-a43ff28f237e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:09.065033 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 222/446] 10.222.0.31 () {56 vars in 1397 bytes} [Thu Feb 10 20:46:09 2022] GET /identity/v3/role_assignments?group.id=5ca0dfa6905142f1bfc55c5c0cfb20ab&scope.project.id=cd4c62df74e348508599a155b573abec&role.id=80e0463ac1aa4ef2b3739b580669f095 => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:09.614900 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf8029-32d5-4ff3-9348-87c822e36672 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:09.615428 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf8029-32d5-4ff3-9348-87c822e36672 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:09.615428 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf8029-32d5-4ff3-9348-87c822e36672 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:09.617180 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 225/447] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:09.622710 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6ed1c-2a80-4c25-aee1-d86036448d6f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:09.622963 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6ed1c-2a80-4c25-aee1-d86036448d6f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:09.623231 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6ed1c-2a80-4c25-aee1-d86036448d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:09.641594 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-78a6ed1c-2a80-4c25-aee1-d86036448d6f None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:09.642763 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-78a6ed1c-2a80-4c25-aee1-d86036448d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:09.651518 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 223/448] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:09.675433 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf8029-32d5-4ff3-9348-87c822e36672 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:09.687912 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf8029-32d5-4ff3-9348-87c822e36672 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:09.692449 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e214b83-fb40-491b-85ea-d0190155c5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:09.693229 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e214b83-fb40-491b-85ea-d0190155c5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:09.693592 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e214b83-fb40-491b-85ea-d0190155c5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:09.693862 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e214b83-fb40-491b-85ea-d0190155c5c6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:09.705210 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e214b83-fb40-491b-85ea-d0190155c5c6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:09.712058 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-7e214b83-fb40-491b-85ea-d0190155c5c6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:46:09.713263 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 226/449] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:46:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:09.719270 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6ed1c-2a80-4c25-aee1-d86036448d6f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:09.728361 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6ed1c-2a80-4c25-aee1-d86036448d6f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:09.733458 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dfc9b-dc45-4870-aec1-eb5edde26375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:09.734112 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dfc9b-dc45-4870-aec1-eb5edde26375 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:09.734385 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dfc9b-dc45-4870-aec1-eb5edde26375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:09.734649 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dfc9b-dc45-4870-aec1-eb5edde26375 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:09.735412 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dfc9b-dc45-4870-aec1-eb5edde26375 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:09.735716 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dfc9b-dc45-4870-aec1-eb5edde26375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:09.737296 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dfc9b-dc45-4870-aec1-eb5edde26375 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:09.745771 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 224/450] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:09.751538 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e214b83-fb40-491b-85ea-d0190155c5c6 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:09.761826 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e214b83-fb40-491b-85ea-d0190155c5c6 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:09.766092 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d6e37-7c90-4d87-a773-8d1e87dc3648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:09.766715 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d6e37-7c90-4d87-a773-8d1e87dc3648 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:09.766984 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d6e37-7c90-4d87-a773-8d1e87dc3648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:09.767250 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d6e37-7c90-4d87-a773-8d1e87dc3648 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:09.775086 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d6e37-7c90-4d87-a773-8d1e87dc3648 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:09.776835 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d6e37-7c90-4d87-a773-8d1e87dc3648 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:09.785801 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 227/451] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:46:09.791854 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dfc9b-dc45-4870-aec1-eb5edde26375 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:09.801375 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dfc9b-dc45-4870-aec1-eb5edde26375 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:09.805800 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa455b-3ff8-49c3-b145-a46425934cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:09.806671 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa455b-3ff8-49c3-b145-a46425934cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:09.806944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa455b-3ff8-49c3-b145-a46425934cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:09.807208 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa455b-3ff8-49c3-b145-a46425934cb6 admin admin] PATH_INFO: `/v3/projects/3c795df8915a438b8adfbed3181b36a2` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:09.808394 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa455b-3ff8-49c3-b145-a46425934cb6 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c795df8915a438b8adfbed3181b36a2)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:09.810214 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa455b-3ff8-49c3-b145-a46425934cb6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:09.811907 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 225/452] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:46:09 2022] GET /identity/v3/projects/3c795df8915a438b8adfbed3181b36a2 => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:09.817415 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d6e37-7c90-4d87-a773-8d1e87dc3648 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:09.826307 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d6e37-7c90-4d87-a773-8d1e87dc3648 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:09.830685 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f91d5-033f-4dd8-b630-681d08b24547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:09.831572 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f91d5-033f-4dd8-b630-681d08b24547 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:09.831857 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f91d5-033f-4dd8-b630-681d08b24547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:09.832107 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f91d5-033f-4dd8-b630-681d08b24547 admin admin] PATH_INFO: `/v3/groups/ff9d8d29877c4b7684e40a5a841dfca4` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:09.833295 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f91d5-033f-4dd8-b630-681d08b24547 admin admin] RBAC: Authorizing `identity:get_group(group_id=ff9d8d29877c4b7684e40a5a841dfca4)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:09.835224 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f91d5-033f-4dd8-b630-681d08b24547 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:09.836811 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 228/453] 10.222.0.31 () {56 vars in 1201 bytes} [Thu Feb 10 20:46:09 2022] GET /identity/v3/groups/ff9d8d29877c4b7684e40a5a841dfca4 => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:09.842552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa455b-3ff8-49c3-b145-a46425934cb6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:09.852335 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa455b-3ff8-49c3-b145-a46425934cb6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:09.856729 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66d052-4fe4-4974-b418-c348ead98b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:09.857401 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66d052-4fe4-4974-b418-c348ead98b8f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:09.857686 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66d052-4fe4-4974-b418-c348ead98b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:09.857958 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66d052-4fe4-4974-b418-c348ead98b8f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:09.858826 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66d052-4fe4-4974-b418-c348ead98b8f admin admin] RBAC: Adding query filter params (group.id=ff9d8d29877c4b7684e40a5a841dfca4, role.id=e06447c1c62d465c9f9c58168be71ed8, scope.project.id=3c795df8915a438b8adfbed3181b36a2) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:09.859132 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66d052-4fe4-4974-b418-c348ead98b8f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:09.860968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66d052-4fe4-4974-b418-c348ead98b8f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:09.866802 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 226/454] 10.222.0.31 () {56 vars in 1397 bytes} [Thu Feb 10 20:46:09 2022] GET /identity/v3/role_assignments?group.id=ff9d8d29877c4b7684e40a5a841dfca4&scope.project.id=3c795df8915a438b8adfbed3181b36a2&role.id=e06447c1c62d465c9f9c58168be71ed8 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:12.692084 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf8d1f-63ab-4025-a572-ebece798059c None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:12.692599 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf8d1f-63ab-4025-a572-ebece798059c None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:12.692599 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf8d1f-63ab-4025-a572-ebece798059c None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:12.694749 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 229/455] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:12.700282 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858d313-f759-438f-a6d9-91f210909094 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:12.700685 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858d313-f759-438f-a6d9-91f210909094 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:12.700873 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858d313-f759-438f-a6d9-91f210909094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:12.709980 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ca5cd-61ad-413b-bb7a-e72d79d8917c None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:12.710260 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ca5cd-61ad-413b-bb7a-e72d79d8917c None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:12.710531 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ca5cd-61ad-413b-bb7a-e72d79d8917c None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:12.712765 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 230/456] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:12.718776 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794fa14-2984-4c56-afa2-c930f8c707eb None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:12.719498 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794fa14-2984-4c56-afa2-c930f8c707eb None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:12.720004 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794fa14-2984-4c56-afa2-c930f8c707eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:12.726410 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7858d313-f759-438f-a6d9-91f210909094 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:12.727838 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7858d313-f759-438f-a6d9-91f210909094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:12.742658 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-8794fa14-2984-4c56-afa2-c930f8c707eb None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:12.743850 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 227/457] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:12.744426 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-8794fa14-2984-4c56-afa2-c930f8c707eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:12.760858 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 231/458] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:12.768299 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858d313-f759-438f-a6d9-91f210909094 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:12.777243 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858d313-f759-438f-a6d9-91f210909094 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:12.789039 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b3e45-2b81-475c-bbae-6c597d4969b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:12.789865 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b3e45-2b81-475c-bbae-6c597d4969b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:12.790141 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b3e45-2b81-475c-bbae-6c597d4969b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:12.790409 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b3e45-2b81-475c-bbae-6c597d4969b2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:12.801835 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794fa14-2984-4c56-afa2-c930f8c707eb None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:12.807488 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b3e45-2b81-475c-bbae-6c597d4969b2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:12.809342 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b3e45-2b81-475c-bbae-6c597d4969b2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:12.812372 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794fa14-2984-4c56-afa2-c930f8c707eb None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:12.826641 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bacec1-31be-405e-8ce0-3a8d18f20500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:12.827891 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bacec1-31be-405e-8ce0-3a8d18f20500 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:12.828374 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bacec1-31be-405e-8ce0-3a8d18f20500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:12.828841 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bacec1-31be-405e-8ce0-3a8d18f20500 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:12.848496 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-9a5b3e45-2b81-475c-bbae-6c597d4969b2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:12.853339 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bacec1-31be-405e-8ce0-3a8d18f20500 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:12.855499 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bacec1-31be-405e-8ce0-3a8d18f20500 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:12.859551 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 228/459] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:12.866441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b3e45-2b81-475c-bbae-6c597d4969b2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:12.884649 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b3e45-2b81-475c-bbae-6c597d4969b2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:12.889278 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-91bacec1-31be-405e-8ce0-3a8d18f20500 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:12.889278 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 232/460] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:12.894837 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bacec1-31be-405e-8ce0-3a8d18f20500 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:12.899428 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f4445-e5fb-40dc-81f5-93f579690e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:12.900107 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f4445-e5fb-40dc-81f5-93f579690e4d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:12.900386 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f4445-e5fb-40dc-81f5-93f579690e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:12.900661 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f4445-e5fb-40dc-81f5-93f579690e4d admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:12.901422 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f4445-e5fb-40dc-81f5-93f579690e4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:12.901730 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f4445-e5fb-40dc-81f5-93f579690e4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:12.902740 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-9c6f4445-e5fb-40dc-81f5-93f579690e4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:46:12.902740 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Feb 10 20:46:12.902740 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: Feb 10 20:46:12.903641 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f4445-e5fb-40dc-81f5-93f579690e4d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:12.904626 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bacec1-31be-405e-8ce0-3a8d18f20500 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:12.909141 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac4466-1b77-420e-91a3-1e05b162694f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:12.909806 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac4466-1b77-420e-91a3-1e05b162694f admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:12.910083 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac4466-1b77-420e-91a3-1e05b162694f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:12.910351 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac4466-1b77-420e-91a3-1e05b162694f admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:12.911071 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac4466-1b77-420e-91a3-1e05b162694f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:12.911369 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac4466-1b77-420e-91a3-1e05b162694f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:12.912961 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac4466-1b77-420e-91a3-1e05b162694f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:12.922624 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 229/461] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:12.923937 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e988c26-acf8-4ae0-bf89-db8d62b45860 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:12.924227 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e988c26-acf8-4ae0-bf89-db8d62b45860 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:12.924510 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e988c26-acf8-4ae0-bf89-db8d62b45860 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:12.926186 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 230/462] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:12.929436 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 233/463] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:12.931266 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e988c26-acf8-4ae0-bf89-db8d62b45860 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:12.934977 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e858e-a57e-4e87-b392-36d6290da5d0 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:12.935268 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e858e-a57e-4e87-b392-36d6290da5d0 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:12.935543 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e858e-a57e-4e87-b392-36d6290da5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:12.944472 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e988c26-acf8-4ae0-bf89-db8d62b45860 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:12.949730 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82320471-fd22-4227-94ed-7c386af8f443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:12.950132 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82320471-fd22-4227-94ed-7c386af8f443 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:12.950411 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82320471-fd22-4227-94ed-7c386af8f443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:12.950683 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82320471-fd22-4227-94ed-7c386af8f443 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:12.951415 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82320471-fd22-4227-94ed-7c386af8f443 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:12.953332 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82320471-fd22-4227-94ed-7c386af8f443 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:12.955096 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-7d4e858e-a57e-4e87-b392-36d6290da5d0 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:12.956417 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-7d4e858e-a57e-4e87-b392-36d6290da5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:12.964485 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 234/464] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:12.965376 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e858e-a57e-4e87-b392-36d6290da5d0 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:12.975124 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e858e-a57e-4e87-b392-36d6290da5d0 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:12.980639 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a9cec-caf9-4ee8-9acc-f56d6eb72d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:12.981341 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a9cec-caf9-4ee8-9acc-f56d6eb72d86 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:12.981645 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a9cec-caf9-4ee8-9acc-f56d6eb72d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:12.981918 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a9cec-caf9-4ee8-9acc-f56d6eb72d86 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:12.982967 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a9cec-caf9-4ee8-9acc-f56d6eb72d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:12.985149 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a9cec-caf9-4ee8-9acc-f56d6eb72d86 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:12.989127 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 231/465] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 10 20:46:12 2022] POST /identity/v3/users => generated 248 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:46:12.999951 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82320471-fd22-4227-94ed-7c386af8f443 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:13.013527 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82320471-fd22-4227-94ed-7c386af8f443 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:13.018820 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afe0d0-0e22-49bc-9493-a3d3de767af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:13.019666 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe0d0-0e22-49bc-9493-a3d3de767af6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:13.019947 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe0d0-0e22-49bc-9493-a3d3de767af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:13.020221 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe0d0-0e22-49bc-9493-a3d3de767af6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:13.033619 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 235/466] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 10 20:46:12 2022] POST /identity/v3/users => generated 246 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:46:13.039388 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afe0d0-0e22-49bc-9493-a3d3de767af6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:13.041331 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afe0d0-0e22-49bc-9493-a3d3de767af6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:13.059955 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-46afe0d0-0e22-49bc-9493-a3d3de767af6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:13.061160 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 232/467] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:13.067326 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a9cec-caf9-4ee8-9acc-f56d6eb72d86 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:13.077420 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a9cec-caf9-4ee8-9acc-f56d6eb72d86 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:13.082188 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c74dc-227a-4efb-b2c6-21a8a4372ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:13.082879 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c74dc-227a-4efb-b2c6-21a8a4372ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:13.083161 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c74dc-227a-4efb-b2c6-21a8a4372ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:13.083447 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c74dc-227a-4efb-b2c6-21a8a4372ec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:13.084351 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c74dc-227a-4efb-b2c6-21a8a4372ec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:13.084479 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c74dc-227a-4efb-b2c6-21a8a4372ec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:13.086146 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c74dc-227a-4efb-b2c6-21a8a4372ec7 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:13.099140 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 236/468] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:13.104630 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afe0d0-0e22-49bc-9493-a3d3de767af6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:13.112535 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee1fee-a54a-4671-aded-6c3bc550273f None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:13.112886 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee1fee-a54a-4671-aded-6c3bc550273f None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:13.113080 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee1fee-a54a-4671-aded-6c3bc550273f None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:13.115021 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 237/469] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:13.120341 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afe0d0-0e22-49bc-9493-a3d3de767af6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:13.121123 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80740622-470a-4311-a6e7-46f07860b55e None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:13.121449 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80740622-470a-4311-a6e7-46f07860b55e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:13.121727 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80740622-470a-4311-a6e7-46f07860b55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:13.131711 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76d39f-cc02-4206-8bcf-696ae920c8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:13.132407 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76d39f-cc02-4206-8bcf-696ae920c8ce admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:13.132690 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76d39f-cc02-4206-8bcf-696ae920c8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:13.132962 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76d39f-cc02-4206-8bcf-696ae920c8ce admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:13.133780 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76d39f-cc02-4206-8bcf-696ae920c8ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:13.135842 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76d39f-cc02-4206-8bcf-696ae920c8ce admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:13.153722 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-80740622-470a-4311-a6e7-46f07860b55e None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:13.155013 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-80740622-470a-4311-a6e7-46f07860b55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:13.166709 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 238/470] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:46:13.183255 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 233/471] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 10 20:46:13 2022] POST /identity/v3/users => generated 248 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:46:13.233137 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80740622-470a-4311-a6e7-46f07860b55e None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:13.243119 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80740622-470a-4311-a6e7-46f07860b55e None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:13.252268 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdb9f3-8ffa-4c4e-b558-318cb3d946b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:13.253259 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdb9f3-8ffa-4c4e-b558-318cb3d946b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:13.253650 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdb9f3-8ffa-4c4e-b558-318cb3d946b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:13.254062 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdb9f3-8ffa-4c4e-b558-318cb3d946b2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:13.267690 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdb9f3-8ffa-4c4e-b558-318cb3d946b2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:13.269688 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdb9f3-8ffa-4c4e-b558-318cb3d946b2 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:13.289590 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-26cdb9f3-8ffa-4c4e-b558-318cb3d946b2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:13.291186 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 239/472] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:13.298289 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76d39f-cc02-4206-8bcf-696ae920c8ce admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:13.312193 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76d39f-cc02-4206-8bcf-696ae920c8ce admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:13.316834 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0c859-4d74-41e0-b50c-38aafe14a2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:13.317553 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0c859-4d74-41e0-b50c-38aafe14a2fd admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:13.317832 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0c859-4d74-41e0-b50c-38aafe14a2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:13.318103 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0c859-4d74-41e0-b50c-38aafe14a2fd admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:13.318869 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0c859-4d74-41e0-b50c-38aafe14a2fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:13.319174 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0c859-4d74-41e0-b50c-38aafe14a2fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:13.320833 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0c859-4d74-41e0-b50c-38aafe14a2fd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:13.334686 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 234/473] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:13.340573 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdb9f3-8ffa-4c4e-b558-318cb3d946b2 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:13.350864 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdb9f3-8ffa-4c4e-b558-318cb3d946b2 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:13.355471 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4eebd8-5cbb-4d6c-8c2c-b6eb07e90b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:13.356169 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eebd8-5cbb-4d6c-8c2c-b6eb07e90b96 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:13.356441 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eebd8-5cbb-4d6c-8c2c-b6eb07e90b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:13.356714 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eebd8-5cbb-4d6c-8c2c-b6eb07e90b96 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:13.357512 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4eebd8-5cbb-4d6c-8c2c-b6eb07e90b96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:13.359517 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4eebd8-5cbb-4d6c-8c2c-b6eb07e90b96 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:13.386443 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 240/474] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 10 20:46:13 2022] POST /identity/v3/users => generated 249 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:46:14.203989 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab960c3c-c43d-454a-a371-09840ac0df35 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:14.204533 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab960c3c-c43d-454a-a371-09840ac0df35 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:14.204533 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab960c3c-c43d-454a-a371-09840ac0df35 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:14.206627 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 235/475] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:14.213978 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffb3fe-d487-4947-9f94-0afd4c1d3dcd None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:14.213978 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffb3fe-d487-4947-9f94-0afd4c1d3dcd None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:14.213978 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffb3fe-d487-4947-9f94-0afd4c1d3dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:14.246428 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-38ffb3fe-d487-4947-9f94-0afd4c1d3dcd None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:14.248070 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-38ffb3fe-d487-4947-9f94-0afd4c1d3dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:14.263290 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 241/476] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:14.307547 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab960c3c-c43d-454a-a371-09840ac0df35 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:14.333246 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab960c3c-c43d-454a-a371-09840ac0df35 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:14.343809 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05df62-adc2-4b0a-886b-71e4848fd599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:14.344487 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05df62-adc2-4b0a-886b-71e4848fd599 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:14.344764 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05df62-adc2-4b0a-886b-71e4848fd599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:14.345039 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05df62-adc2-4b0a-886b-71e4848fd599 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:14.345843 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05df62-adc2-4b0a-886b-71e4848fd599 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:14.347451 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05df62-adc2-4b0a-886b-71e4848fd599 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:14.371580 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.sql.core [None req-5f05df62-adc2-4b0a-886b-71e4848fd599 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 10 20:46:14.371580 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 10 20:46:14.371580 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [parameters: {'id': '480ea3aa1a7d4b9d9bcb8107160f636a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 10 20:46:14.371580 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79128) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 10 20:46:14.395766 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-5f05df62-adc2-4b0a-886b-71e4848fd599 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 10 20:46:14.402995 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 236/477] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:46:14 2022] POST /identity/v3/roles => generated 144 bytes in 92 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:14.405221 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffb3fe-d487-4947-9f94-0afd4c1d3dcd None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:14.413886 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffb3fe-d487-4947-9f94-0afd4c1d3dcd None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:14.431801 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857df06d-6c03-416e-ab73-3c40551ca6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:14.432998 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857df06d-6c03-416e-ab73-3c40551ca6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:14.433517 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857df06d-6c03-416e-ab73-3c40551ca6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:14.433979 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857df06d-6c03-416e-ab73-3c40551ca6c3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:14.449781 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857df06d-6c03-416e-ab73-3c40551ca6c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:14.457338 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-857df06d-6c03-416e-ab73-3c40551ca6c3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 20:46:14.459078 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 242/478] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 10 20:46:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:14.464850 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05df62-adc2-4b0a-886b-71e4848fd599 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:14.485970 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05df62-adc2-4b0a-886b-71e4848fd599 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:14.495387 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9436d-268a-4af4-819c-c50242de2acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:14.496119 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9436d-268a-4af4-819c-c50242de2acc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:14.496651 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9436d-268a-4af4-819c-c50242de2acc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:14.497107 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9436d-268a-4af4-819c-c50242de2acc admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:14.498111 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9436d-268a-4af4-819c-c50242de2acc admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:14.498415 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9436d-268a-4af4-819c-c50242de2acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:14.500027 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9436d-268a-4af4-819c-c50242de2acc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:14.519446 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 237/479] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:15.724669 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823e3aa-50dd-4f87-a703-ef6f7724ce8c None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:15.725183 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823e3aa-50dd-4f87-a703-ef6f7724ce8c None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:15.725183 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823e3aa-50dd-4f87-a703-ef6f7724ce8c None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:15.727267 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 243/480] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:15.732839 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce598b-cb17-42b0-945f-73c27c6cd2b1 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:15.733239 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce598b-cb17-42b0-945f-73c27c6cd2b1 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:15.733426 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce598b-cb17-42b0-945f-73c27c6cd2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:15.763110 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-23ce598b-cb17-42b0-945f-73c27c6cd2b1 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:15.764291 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-23ce598b-cb17-42b0-945f-73c27c6cd2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:15.776610 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 238/481] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:46:15.812174 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823e3aa-50dd-4f87-a703-ef6f7724ce8c None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:15.832097 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823e3aa-50dd-4f87-a703-ef6f7724ce8c None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:15.836600 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67efda-6b93-499f-9b06-2f2cad3e5037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:15.837404 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67efda-6b93-499f-9b06-2f2cad3e5037 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:15.837685 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67efda-6b93-499f-9b06-2f2cad3e5037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:15.837955 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67efda-6b93-499f-9b06-2f2cad3e5037 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:15.857697 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67efda-6b93-499f-9b06-2f2cad3e5037 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:15.864532 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-0f67efda-6b93-499f-9b06-2f2cad3e5037 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 20:46:15.870370 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 244/482] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:46:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:15.876198 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce598b-cb17-42b0-945f-73c27c6cd2b1 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:15.892127 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce598b-cb17-42b0-945f-73c27c6cd2b1 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:15.902028 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8620ee0-87d6-4ba9-b55e-2f3a20026aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:15.902709 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8620ee0-87d6-4ba9-b55e-2f3a20026aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:15.903280 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8620ee0-87d6-4ba9-b55e-2f3a20026aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:15.903549 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8620ee0-87d6-4ba9-b55e-2f3a20026aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:15.904318 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8620ee0-87d6-4ba9-b55e-2f3a20026aa5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:15.904614 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8620ee0-87d6-4ba9-b55e-2f3a20026aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:15.906267 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8620ee0-87d6-4ba9-b55e-2f3a20026aa5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:15.921670 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 239/483] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 10 20:46:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:15.927144 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67efda-6b93-499f-9b06-2f2cad3e5037 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:15.940814 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67efda-6b93-499f-9b06-2f2cad3e5037 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:15.949427 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169415a-ca6f-4708-b040-951a846f93a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:15.950221 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169415a-ca6f-4708-b040-951a846f93a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:15.950502 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169415a-ca6f-4708-b040-951a846f93a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:15.950769 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169415a-ca6f-4708-b040-951a846f93a2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:15.969711 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169415a-ca6f-4708-b040-951a846f93a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:15.971546 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169415a-ca6f-4708-b040-951a846f93a2 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:15.990161 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2d40a-8427-46ac-bcdf-815528d551b5 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:15.990454 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2d40a-8427-46ac-bcdf-815528d551b5 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:15.990708 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2d40a-8427-46ac-bcdf-815528d551b5 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:15.994410 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 240/484] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:15.997660 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-a169415a-ca6f-4708-b040-951a846f93a2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:15.998046 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6496370-4f07-4643-9764-79045e98ff91 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:15.998332 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6496370-4f07-4643-9764-79045e98ff91 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:15.998610 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6496370-4f07-4643-9764-79045e98ff91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:15.999110 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 245/485] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:16.004356 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169415a-ca6f-4708-b040-951a846f93a2 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.017055 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-d6496370-4f07-4643-9764-79045e98ff91 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:16.018472 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d6496370-4f07-4643-9764-79045e98ff91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:16.019685 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169415a-ca6f-4708-b040-951a846f93a2 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.026203 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff6e1f-1067-4b8e-a282-8f268ef5e48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.026852 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff6e1f-1067-4b8e-a282-8f268ef5e48a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.027275 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 241/486] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:46:16.027426 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff6e1f-1067-4b8e-a282-8f268ef5e48a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.027426 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff6e1f-1067-4b8e-a282-8f268ef5e48a admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.028082 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff6e1f-1067-4b8e-a282-8f268ef5e48a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:16.028429 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff6e1f-1067-4b8e-a282-8f268ef5e48a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.030046 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff6e1f-1067-4b8e-a282-8f268ef5e48a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.054077 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6496370-4f07-4643-9764-79045e98ff91 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.055070 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 246/487] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:16.060121 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff6e1f-1067-4b8e-a282-8f268ef5e48a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.063876 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6496370-4f07-4643-9764-79045e98ff91 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.068973 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e577936-7941-4e81-aef8-8818222c0296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.070017 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e577936-7941-4e81-aef8-8818222c0296 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.071059 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e577936-7941-4e81-aef8-8818222c0296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.071512 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e577936-7941-4e81-aef8-8818222c0296 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.074253 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff6e1f-1067-4b8e-a282-8f268ef5e48a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.081302 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3dcab-1b5a-4749-880f-04e6351f0225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.082129 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3dcab-1b5a-4749-880f-04e6351f0225 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.082406 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3dcab-1b5a-4749-880f-04e6351f0225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.082669 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3dcab-1b5a-4749-880f-04e6351f0225 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.084645 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e577936-7941-4e81-aef8-8818222c0296 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:16.092871 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-6e577936-7941-4e81-aef8-8818222c0296 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 20:46:16.099434 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 242/488] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:16.100551 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e3dcab-1b5a-4749-880f-04e6351f0225 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.101199 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e577936-7941-4e81-aef8-8818222c0296 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.102630 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e3dcab-1b5a-4749-880f-04e6351f0225 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.112434 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e577936-7941-4e81-aef8-8818222c0296 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.117433 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef560f9-568b-4d2c-bae5-724a9444b199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.118503 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef560f9-568b-4d2c-bae5-724a9444b199 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.119025 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef560f9-568b-4d2c-bae5-724a9444b199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.119516 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef560f9-568b-4d2c-bae5-724a9444b199 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.120465 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef560f9-568b-4d2c-bae5-724a9444b199 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:16.121026 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef560f9-568b-4d2c-bae5-724a9444b199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.122934 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef560f9-568b-4d2c-bae5-724a9444b199 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.124761 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-c2e3dcab-1b5a-4749-880f-04e6351f0225 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 20:46:16.126171 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 247/489] 10.222.0.31 () {56 vars in 1114 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:16.137389 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3dcab-1b5a-4749-880f-04e6351f0225 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.137822 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 243/490] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:16.139701 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef560f9-568b-4d2c-bae5-724a9444b199 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.150249 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef560f9-568b-4d2c-bae5-724a9444b199 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.152779 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3dcab-1b5a-4749-880f-04e6351f0225 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.155662 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebac938-813c-47c8-b4aa-8154601a32ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.156703 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebac938-813c-47c8-b4aa-8154601a32ec admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.157208 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebac938-813c-47c8-b4aa-8154601a32ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.157695 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebac938-813c-47c8-b4aa-8154601a32ec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.168954 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d4acd-e509-4b7c-8a11-1832906b6c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.171141 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d4acd-e509-4b7c-8a11-1832906b6c1a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.171981 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d4acd-e509-4b7c-8a11-1832906b6c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.172674 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d4acd-e509-4b7c-8a11-1832906b6c1a admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.174570 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d4acd-e509-4b7c-8a11-1832906b6c1a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:16.175025 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebac938-813c-47c8-b4aa-8154601a32ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.176400 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d4acd-e509-4b7c-8a11-1832906b6c1a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.178312 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebac938-813c-47c8-b4aa-8154601a32ec admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.179387 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING py.warnings [None req-f27d4acd-e509-4b7c-8a11-1832906b6c1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:46:16.179387 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: warnings.warn(msg) Feb 10 20:46:16.179387 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: Feb 10 20:46:16.180908 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d4acd-e509-4b7c-8a11-1832906b6c1a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.216676 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-6ebac938-813c-47c8-b4aa-8154601a32ec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:16.222738 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 244/491] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:16.240974 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebac938-813c-47c8-b4aa-8154601a32ec admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.248076 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 248/492] 10.222.0.31 () {56 vars in 1154 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:16.249952 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe274a8f-6d98-46fa-ab66-51cce6eca85c None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.250502 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe274a8f-6d98-46fa-ab66-51cce6eca85c None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.250990 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe274a8f-6d98-46fa-ab66-51cce6eca85c None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.252882 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 249/493] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:16.254841 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe274a8f-6d98-46fa-ab66-51cce6eca85c None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.261141 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebac938-813c-47c8-b4aa-8154601a32ec admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.265471 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9219ce-4583-4364-bbcb-26fc14f03046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.266140 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9219ce-4583-4364-bbcb-26fc14f03046 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.266414 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9219ce-4583-4364-bbcb-26fc14f03046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.266694 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9219ce-4583-4364-bbcb-26fc14f03046 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.267420 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9219ce-4583-4364-bbcb-26fc14f03046 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:16.267720 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9219ce-4583-4364-bbcb-26fc14f03046 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.269311 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9219ce-4583-4364-bbcb-26fc14f03046 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.277654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe274a8f-6d98-46fa-ab66-51cce6eca85c None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.283515 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 245/494] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:16.286719 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d27426-b1ed-42d9-b3eb-fbde38475e0c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.287271 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d27426-b1ed-42d9-b3eb-fbde38475e0c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.287747 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d27426-b1ed-42d9-b3eb-fbde38475e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.288383 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e760c1-87d1-47d5-bd80-0339157b4c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.289027 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e760c1-87d1-47d5-bd80-0339157b4c2f admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.289312 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e760c1-87d1-47d5-bd80-0339157b4c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.289610 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e760c1-87d1-47d5-bd80-0339157b4c2f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.298696 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e760c1-87d1-47d5-bd80-0339157b4c2f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.300484 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e760c1-87d1-47d5-bd80-0339157b4c2f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.308493 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e1d27426-b1ed-42d9-b3eb-fbde38475e0c None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:16.310028 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e1d27426-b1ed-42d9-b3eb-fbde38475e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:16.310437 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 250/495] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:46:16.315114 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e760c1-87d1-47d5-bd80-0339157b4c2f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.325183 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e760c1-87d1-47d5-bd80-0339157b4c2f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.326229 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 246/496] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:16.333376 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d27426-b1ed-42d9-b3eb-fbde38475e0c None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.337505 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173a7ba-213a-4a9f-9d11-8f8b454806a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.338532 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d27426-b1ed-42d9-b3eb-fbde38475e0c None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.338831 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173a7ba-213a-4a9f-9d11-8f8b454806a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.339353 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173a7ba-213a-4a9f-9d11-8f8b454806a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.339903 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173a7ba-213a-4a9f-9d11-8f8b454806a0 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.346446 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93147823-d480-4c4a-abc7-691e29f230f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.348560 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93147823-d480-4c4a-abc7-691e29f230f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.348866 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93147823-d480-4c4a-abc7-691e29f230f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.349136 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93147823-d480-4c4a-abc7-691e29f230f7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.355096 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173a7ba-213a-4a9f-9d11-8f8b454806a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.360104 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173a7ba-213a-4a9f-9d11-8f8b454806a0 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.367024 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93147823-d480-4c4a-abc7-691e29f230f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.369398 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93147823-d480-4c4a-abc7-691e29f230f7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.377152 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-8173a7ba-213a-4a9f-9d11-8f8b454806a0 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 10 20:46:16.378780 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 251/497] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:16.379863 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173a7ba-213a-4a9f-9d11-8f8b454806a0 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.392696 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173a7ba-213a-4a9f-9d11-8f8b454806a0 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.399885 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6eec11-03b1-4d7d-b6b4-9006c510fad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.400538 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-93147823-d480-4c4a-abc7-691e29f230f7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:16.401164 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6eec11-03b1-4d7d-b6b4-9006c510fad7 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.401972 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 247/498] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:16.402213 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6eec11-03b1-4d7d-b6b4-9006c510fad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.402567 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93147823-d480-4c4a-abc7-691e29f230f7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.402880 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6eec11-03b1-4d7d-b6b4-9006c510fad7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.416116 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6eec11-03b1-4d7d-b6b4-9006c510fad7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:16.417244 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93147823-d480-4c4a-abc7-691e29f230f7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.422019 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5c50c-25b8-4b15-9618-1c163a4e419c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.422660 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5c50c-25b8-4b15-9618-1c163a4e419c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.422938 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5c50c-25b8-4b15-9618-1c163a4e419c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.423203 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5c50c-25b8-4b15-9618-1c163a4e419c admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.424044 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5c50c-25b8-4b15-9618-1c163a4e419c admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:16.424340 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5c50c-25b8-4b15-9618-1c163a4e419c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.425371 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-a5c5c50c-25b8-4b15-9618-1c163a4e419c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:46:16.425371 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Feb 10 20:46:16.425371 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: Feb 10 20:46:16.426512 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5c50c-25b8-4b15-9618-1c163a4e419c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.427008 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-7e6eec11-03b1-4d7d-b6b4-9006c510fad7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 20:46:16.428873 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 252/499] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:16.429964 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6eec11-03b1-4d7d-b6b4-9006c510fad7 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.444029 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6eec11-03b1-4d7d-b6b4-9006c510fad7 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.449692 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3e2d0-2d3a-49d2-9d51-36e17889c835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.450423 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3e2d0-2d3a-49d2-9d51-36e17889c835 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.450699 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3e2d0-2d3a-49d2-9d51-36e17889c835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.450966 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3e2d0-2d3a-49d2-9d51-36e17889c835 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.451688 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3e2d0-2d3a-49d2-9d51-36e17889c835 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:16.452031 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3e2d0-2d3a-49d2-9d51-36e17889c835 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.453706 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3e2d0-2d3a-49d2-9d51-36e17889c835 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.465244 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 253/500] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:16.466064 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3e2d0-2d3a-49d2-9d51-36e17889c835 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.479338 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 248/501] 10.222.0.31 () {56 vars in 1158 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:16.480116 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3e2d0-2d3a-49d2-9d51-36e17889c835 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.480953 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5c50c-25b8-4b15-9618-1c163a4e419c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.484908 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576723c-b014-465a-8a44-cd0cad4598a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.485598 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576723c-b014-465a-8a44-cd0cad4598a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.485874 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576723c-b014-465a-8a44-cd0cad4598a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.486138 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576723c-b014-465a-8a44-cd0cad4598a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.486886 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576723c-b014-465a-8a44-cd0cad4598a1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:16.487178 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576723c-b014-465a-8a44-cd0cad4598a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.488759 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576723c-b014-465a-8a44-cd0cad4598a1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.491202 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5c50c-25b8-4b15-9618-1c163a4e419c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.495988 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168307bc-3cf1-4065-a982-9babbb14f376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.496756 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168307bc-3cf1-4065-a982-9babbb14f376 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.496964 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 254/502] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:16.497331 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168307bc-3cf1-4065-a982-9babbb14f376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.497637 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168307bc-3cf1-4065-a982-9babbb14f376 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.502462 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9b2ae-5339-4421-b25b-c1859df7e843 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.502744 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9b2ae-5339-4421-b25b-c1859df7e843 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.503013 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9b2ae-5339-4421-b25b-c1859df7e843 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.504577 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168307bc-3cf1-4065-a982-9babbb14f376 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.504686 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 255/503] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:16.509005 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9b2ae-5339-4421-b25b-c1859df7e843 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.509121 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168307bc-3cf1-4065-a982-9babbb14f376 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.520619 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9b2ae-5339-4421-b25b-c1859df7e843 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.521936 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-168307bc-3cf1-4065-a982-9babbb14f376 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:16.523225 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 249/504] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:16.525404 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168307bc-3cf1-4065-a982-9babbb14f376 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.529413 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbebcc0-f38e-4611-bbc7-a187662adfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.530047 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbebcc0-f38e-4611-bbc7-a187662adfed admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.530322 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbebcc0-f38e-4611-bbc7-a187662adfed admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.530587 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbebcc0-f38e-4611-bbc7-a187662adfed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.540042 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168307bc-3cf1-4065-a982-9babbb14f376 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.543778 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbebcc0-f38e-4611-bbc7-a187662adfed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.544691 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4dc0b-cd66-486c-a15b-4e9227b1c4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.545842 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4dc0b-cd66-486c-a15b-4e9227b1c4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.545940 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbebcc0-f38e-4611-bbc7-a187662adfed admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.546125 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4dc0b-cd66-486c-a15b-4e9227b1c4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.546395 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4dc0b-cd66-486c-a15b-4e9227b1c4a5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.559274 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 256/505] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:46:16.559274 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a31066-d908-4a0c-b5d2-41841747e001 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.559274 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a31066-d908-4a0c-b5d2-41841747e001 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.559274 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a31066-d908-4a0c-b5d2-41841747e001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.560974 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4dc0b-cd66-486c-a15b-4e9227b1c4a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.562954 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4dc0b-cd66-486c-a15b-4e9227b1c4a5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.577576 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-74a31066-d908-4a0c-b5d2-41841747e001 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:16.578696 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-74a31066-d908-4a0c-b5d2-41841747e001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:16.581140 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-e0e4dc0b-cd66-486c-a15b-4e9227b1c4a5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:16.582386 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 250/506] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:16.583150 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4dc0b-cd66-486c-a15b-4e9227b1c4a5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.601381 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 257/507] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:16.601381 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a31066-d908-4a0c-b5d2-41841747e001 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.601617 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4dc0b-cd66-486c-a15b-4e9227b1c4a5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.605874 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3e391-90b8-48c3-b1ca-7b9dd6bad71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.606571 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3e391-90b8-48c3-b1ca-7b9dd6bad71e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.607520 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3e391-90b8-48c3-b1ca-7b9dd6bad71e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.607870 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3e391-90b8-48c3-b1ca-7b9dd6bad71e admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.609029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3e391-90b8-48c3-b1ca-7b9dd6bad71e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:16.609434 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3e391-90b8-48c3-b1ca-7b9dd6bad71e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.610513 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-a1f3e391-90b8-48c3-b1ca-7b9dd6bad71e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:46:16.610513 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Feb 10 20:46:16.610513 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: Feb 10 20:46:16.610969 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a31066-d908-4a0c-b5d2-41841747e001 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.612040 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3e391-90b8-48c3-b1ca-7b9dd6bad71e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.615709 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac239b3c-dcb6-406a-8b54-7e29fac5e410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.616602 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac239b3c-dcb6-406a-8b54-7e29fac5e410 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.617009 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac239b3c-dcb6-406a-8b54-7e29fac5e410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.617387 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac239b3c-dcb6-406a-8b54-7e29fac5e410 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.627771 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac239b3c-dcb6-406a-8b54-7e29fac5e410 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.629618 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac239b3c-dcb6-406a-8b54-7e29fac5e410 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.630861 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 251/508] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:16.636523 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3e391-90b8-48c3-b1ca-7b9dd6bad71e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.645564 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3e391-90b8-48c3-b1ca-7b9dd6bad71e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.646345 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-ac239b3c-dcb6-406a-8b54-7e29fac5e410 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:16.647794 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 258/509] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:16.650258 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94297e4a-253e-42a4-8f79-757838fffa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.650468 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac239b3c-dcb6-406a-8b54-7e29fac5e410 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.651100 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94297e4a-253e-42a4-8f79-757838fffa35 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.651520 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94297e4a-253e-42a4-8f79-757838fffa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.652010 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94297e4a-253e-42a4-8f79-757838fffa35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.652593 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94297e4a-253e-42a4-8f79-757838fffa35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:16.652892 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94297e4a-253e-42a4-8f79-757838fffa35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.654512 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94297e4a-253e-42a4-8f79-757838fffa35 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.660646 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac239b3c-dcb6-406a-8b54-7e29fac5e410 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.666125 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 252/510] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:16.666813 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94297e4a-253e-42a4-8f79-757838fffa35 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.671276 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a366246-be17-4cd7-a96a-d0025f6fad95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.672241 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a366246-be17-4cd7-a96a-d0025f6fad95 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.672657 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a366246-be17-4cd7-a96a-d0025f6fad95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.673129 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a366246-be17-4cd7-a96a-d0025f6fad95 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.679278 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94297e4a-253e-42a4-8f79-757838fffa35 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.683495 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d669e7a-df20-49be-92fa-152b97115fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.684103 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d669e7a-df20-49be-92fa-152b97115fcc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.684374 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d669e7a-df20-49be-92fa-152b97115fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.684644 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d669e7a-df20-49be-92fa-152b97115fcc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.685494 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d669e7a-df20-49be-92fa-152b97115fcc admin admin] RBAC: Adding query filter params (role.id=67325e5669ca4296b3b2c0eb443fda3e, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=c0d84b0d7e3d423aa972e58be27c772c) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:16.685793 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d669e7a-df20-49be-92fa-152b97115fcc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.686314 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a366246-be17-4cd7-a96a-d0025f6fad95 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:16.687614 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d669e7a-df20-49be-92fa-152b97115fcc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.692960 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 253/511] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/role_assignments?user.id=c0d84b0d7e3d423aa972e58be27c772c&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=67325e5669ca4296b3b2c0eb443fda3e => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:16.693869 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d669e7a-df20-49be-92fa-152b97115fcc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.694865 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-5a366246-be17-4cd7-a96a-d0025f6fad95 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 20:46:16.696176 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 259/512] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:16.698206 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a366246-be17-4cd7-a96a-d0025f6fad95 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.712008 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a366246-be17-4cd7-a96a-d0025f6fad95 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.712224 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d669e7a-df20-49be-92fa-152b97115fcc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.716829 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639d493-e5af-40e0-93a9-c420eaeab8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.717431 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28017f-2fe0-4251-9699-e2c09c35f8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.717576 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639d493-e5af-40e0-93a9-c420eaeab8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.717828 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639d493-e5af-40e0-93a9-c420eaeab8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.718109 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639d493-e5af-40e0-93a9-c420eaeab8f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.718840 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28017f-2fe0-4251-9699-e2c09c35f8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.718970 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639d493-e5af-40e0-93a9-c420eaeab8f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:16.719143 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639d493-e5af-40e0-93a9-c420eaeab8f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.719537 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28017f-2fe0-4251-9699-e2c09c35f8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.719961 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28017f-2fe0-4251-9699-e2c09c35f8b9 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.720777 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639d493-e5af-40e0-93a9-c420eaeab8f0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.729141 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a28017f-2fe0-4251-9699-e2c09c35f8b9 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.732036 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a28017f-2fe0-4251-9699-e2c09c35f8b9 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.736130 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 254/513] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:16.741975 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639d493-e5af-40e0-93a9-c420eaeab8f0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.748957 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-4a28017f-2fe0-4251-9699-e2c09c35f8b9 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 10 20:46:16.750789 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 260/514] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:16.751950 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28017f-2fe0-4251-9699-e2c09c35f8b9 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.752071 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639d493-e5af-40e0-93a9-c420eaeab8f0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.756535 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d48da3-62cd-42ef-bf7e-6dede6cd4366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.757205 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d48da3-62cd-42ef-bf7e-6dede6cd4366 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.757537 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d48da3-62cd-42ef-bf7e-6dede6cd4366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.757809 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d48da3-62cd-42ef-bf7e-6dede6cd4366 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.758833 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d48da3-62cd-42ef-bf7e-6dede6cd4366 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:16.759138 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d48da3-62cd-42ef-bf7e-6dede6cd4366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.761489 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d48da3-62cd-42ef-bf7e-6dede6cd4366 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.764364 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28017f-2fe0-4251-9699-e2c09c35f8b9 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.769747 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c40b18-6972-46f6-b0e0-5523dc3faab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.770898 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c40b18-6972-46f6-b0e0-5523dc3faab4 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.771322 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c40b18-6972-46f6-b0e0-5523dc3faab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.771806 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c40b18-6972-46f6-b0e0-5523dc3faab4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.776356 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 255/515] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:16.777728 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d48da3-62cd-42ef-bf7e-6dede6cd4366 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.783112 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c40b18-6972-46f6-b0e0-5523dc3faab4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.785486 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c40b18-6972-46f6-b0e0-5523dc3faab4 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.788436 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d48da3-62cd-42ef-bf7e-6dede6cd4366 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.793699 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422dfeb-4490-43fb-a6f7-fec807bdc2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.794375 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422dfeb-4490-43fb-a6f7-fec807bdc2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.794658 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422dfeb-4490-43fb-a6f7-fec807bdc2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.794923 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422dfeb-4490-43fb-a6f7-fec807bdc2d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.796137 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422dfeb-4490-43fb-a6f7-fec807bdc2d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:16.796446 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422dfeb-4490-43fb-a6f7-fec807bdc2d0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.798363 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422dfeb-4490-43fb-a6f7-fec807bdc2d0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.802240 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-c1c40b18-6972-46f6-b0e0-5523dc3faab4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:16.803854 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 261/516] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:16.804826 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c40b18-6972-46f6-b0e0-5523dc3faab4 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.819111 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c40b18-6972-46f6-b0e0-5523dc3faab4 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.824916 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265529d-d0fe-4ac5-85d1-cc2774f17e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.826239 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265529d-d0fe-4ac5-85d1-cc2774f17e2b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.826694 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265529d-d0fe-4ac5-85d1-cc2774f17e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.827103 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265529d-d0fe-4ac5-85d1-cc2774f17e2b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.828658 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 256/517] 10.222.0.31 () {56 vars in 1158 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:16.830007 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422dfeb-4490-43fb-a6f7-fec807bdc2d0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.841888 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422dfeb-4490-43fb-a6f7-fec807bdc2d0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.842306 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265529d-d0fe-4ac5-85d1-cc2774f17e2b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.844455 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265529d-d0fe-4ac5-85d1-cc2774f17e2b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.846864 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b72b61-a84f-4046-86e2-90a71462a862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.847635 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b72b61-a84f-4046-86e2-90a71462a862 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.848343 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b72b61-a84f-4046-86e2-90a71462a862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.848683 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b72b61-a84f-4046-86e2-90a71462a862 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.849624 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b72b61-a84f-4046-86e2-90a71462a862 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:16.849997 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b72b61-a84f-4046-86e2-90a71462a862 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.852011 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b72b61-a84f-4046-86e2-90a71462a862 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.865958 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-1265529d-d0fe-4ac5-85d1-cc2774f17e2b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:16.867766 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 262/519] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:16.868929 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265529d-d0fe-4ac5-85d1-cc2774f17e2b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.873467 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 257/519] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:16.874822 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b72b61-a84f-4046-86e2-90a71462a862 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.886112 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265529d-d0fe-4ac5-85d1-cc2774f17e2b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.892410 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b72b61-a84f-4046-86e2-90a71462a862 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.892820 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f3d85-f51e-4933-8803-83b70c7a1e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.893820 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f3d85-f51e-4933-8803-83b70c7a1e1a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.894339 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f3d85-f51e-4933-8803-83b70c7a1e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.894787 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f3d85-f51e-4933-8803-83b70c7a1e1a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.897545 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fddae0-84d9-4e81-8281-1eba01ebed34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.898293 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fddae0-84d9-4e81-8281-1eba01ebed34 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.898668 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fddae0-84d9-4e81-8281-1eba01ebed34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.899030 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fddae0-84d9-4e81-8281-1eba01ebed34 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.899982 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fddae0-84d9-4e81-8281-1eba01ebed34 admin admin] RBAC: Adding query filter params (role.id=67325e5669ca4296b3b2c0eb443fda3e, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=ce66e520f6f84eab9e85c81022a0c743) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:16.900384 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fddae0-84d9-4e81-8281-1eba01ebed34 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.902617 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fddae0-84d9-4e81-8281-1eba01ebed34 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.905714 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f3d85-f51e-4933-8803-83b70c7a1e1a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.908495 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f3d85-f51e-4933-8803-83b70c7a1e1a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.913441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 258/520] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/role_assignments?user.id=ce66e520f6f84eab9e85c81022a0c743&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=67325e5669ca4296b3b2c0eb443fda3e => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:16.914548 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fddae0-84d9-4e81-8281-1eba01ebed34 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.931011 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 263/521] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:46:16.935960 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f3d85-f51e-4933-8803-83b70c7a1e1a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.941997 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fddae0-84d9-4e81-8281-1eba01ebed34 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.949598 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f3d85-f51e-4933-8803-83b70c7a1e1a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:16.952448 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1189bd-a921-4c3f-85e6-d6047b7114c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.953309 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1189bd-a921-4c3f-85e6-d6047b7114c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.953869 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1189bd-a921-4c3f-85e6-d6047b7114c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.954282 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1189bd-a921-4c3f-85e6-d6047b7114c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.955164 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1189bd-a921-4c3f-85e6-d6047b7114c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:16.956057 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1189bd-a921-4c3f-85e6-d6047b7114c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.958287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1189bd-a921-4c3f-85e6-d6047b7114c4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:16.965440 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f90fbd-db08-453f-bcdd-96d30844682a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:16.966489 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f90fbd-db08-453f-bcdd-96d30844682a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:16.972543 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f90fbd-db08-453f-bcdd-96d30844682a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:16.973065 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f90fbd-db08-453f-bcdd-96d30844682a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:16.987019 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 259/522] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:16.991361 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f90fbd-db08-453f-bcdd-96d30844682a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:16.993668 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1189bd-a921-4c3f-85e6-d6047b7114c4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:16.995522 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f90fbd-db08-453f-bcdd-96d30844682a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:17.010730 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1189bd-a921-4c3f-85e6-d6047b7114c4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:17.022431 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820b0f7-c2f1-44a0-9931-b235c452e614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:17.023554 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820b0f7-c2f1-44a0-9931-b235c452e614 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:17.024951 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820b0f7-c2f1-44a0-9931-b235c452e614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:17.025435 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820b0f7-c2f1-44a0-9931-b235c452e614 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:17.036198 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-19f90fbd-db08-453f-bcdd-96d30844682a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:17.039305 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 264/523] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:17.042483 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820b0f7-c2f1-44a0-9931-b235c452e614 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:17.044809 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820b0f7-c2f1-44a0-9931-b235c452e614 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:17.046422 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f90fbd-db08-453f-bcdd-96d30844682a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:17.064397 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f90fbd-db08-453f-bcdd-96d30844682a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:17.075279 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32117c16-3302-427f-a585-5dd0efae6423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:17.075536 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-2820b0f7-c2f1-44a0-9931-b235c452e614 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 10 20:46:17.076421 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32117c16-3302-427f-a585-5dd0efae6423 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:17.076843 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32117c16-3302-427f-a585-5dd0efae6423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:17.077112 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 260/524] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:46:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:17.077526 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32117c16-3302-427f-a585-5dd0efae6423 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:17.078552 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32117c16-3302-427f-a585-5dd0efae6423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:17.079090 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32117c16-3302-427f-a585-5dd0efae6423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:17.080961 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32117c16-3302-427f-a585-5dd0efae6423 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:17.082823 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820b0f7-c2f1-44a0-9931-b235c452e614 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:17.096127 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 265/525] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:17.105558 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32117c16-3302-427f-a585-5dd0efae6423 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:17.107746 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820b0f7-c2f1-44a0-9931-b235c452e614 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:17.116227 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a9c0f-48cc-4711-958f-c286b87a473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:17.116958 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a9c0f-48cc-4711-958f-c286b87a473f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:17.117236 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a9c0f-48cc-4711-958f-c286b87a473f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:17.117526 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a9c0f-48cc-4711-958f-c286b87a473f admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:17.118419 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a9c0f-48cc-4711-958f-c286b87a473f admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:17.118718 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a9c0f-48cc-4711-958f-c286b87a473f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:17.119605 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32117c16-3302-427f-a585-5dd0efae6423 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:17.120622 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a9c0f-48cc-4711-958f-c286b87a473f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:17.130638 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabf5ef-f5af-492b-8aac-9b13e43922a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:17.132706 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabf5ef-f5af-492b-8aac-9b13e43922a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:17.132986 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabf5ef-f5af-492b-8aac-9b13e43922a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:17.133254 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabf5ef-f5af-492b-8aac-9b13e43922a6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:17.142306 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 261/526] 10.222.0.31 () {56 vars in 1160 bytes} [Thu Feb 10 20:46:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:17.148399 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a9c0f-48cc-4711-958f-c286b87a473f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:17.158782 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a9c0f-48cc-4711-958f-c286b87a473f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:17.160855 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabf5ef-f5af-492b-8aac-9b13e43922a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:17.162904 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabf5ef-f5af-492b-8aac-9b13e43922a6 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:17.163774 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df6e6c-56b3-40a4-98f2-1cccc83fc0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:17.164558 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df6e6c-56b3-40a4-98f2-1cccc83fc0bc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:17.164946 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df6e6c-56b3-40a4-98f2-1cccc83fc0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:17.165309 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df6e6c-56b3-40a4-98f2-1cccc83fc0bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:17.174810 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df6e6c-56b3-40a4-98f2-1cccc83fc0bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:17.176786 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df6e6c-56b3-40a4-98f2-1cccc83fc0bc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:17.186548 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 262/527] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 20:46:17.192027 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df6e6c-56b3-40a4-98f2-1cccc83fc0bc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:17.196542 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-5aabf5ef-f5af-492b-8aac-9b13e43922a6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:17.200434 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df6e6c-56b3-40a4-98f2-1cccc83fc0bc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:17.206839 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 266/528] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:17.210226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3795b-53b9-4ad8-88a6-14743e2394d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:17.211699 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabf5ef-f5af-492b-8aac-9b13e43922a6 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:17.213235 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3795b-53b9-4ad8-88a6-14743e2394d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:17.217219 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3795b-53b9-4ad8-88a6-14743e2394d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:17.217955 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3795b-53b9-4ad8-88a6-14743e2394d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:17.232267 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabf5ef-f5af-492b-8aac-9b13e43922a6 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:17.241209 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28825423-9dea-43f1-b2ab-d779699b6a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:17.242376 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3795b-53b9-4ad8-88a6-14743e2394d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:17.243307 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28825423-9dea-43f1-b2ab-d779699b6a8d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:17.244300 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28825423-9dea-43f1-b2ab-d779699b6a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:17.245207 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28825423-9dea-43f1-b2ab-d779699b6a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:17.246272 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28825423-9dea-43f1-b2ab-d779699b6a8d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:17.247206 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3795b-53b9-4ad8-88a6-14743e2394d0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:17.247621 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28825423-9dea-43f1-b2ab-d779699b6a8d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:17.249987 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING py.warnings [None req-28825423-9dea-43f1-b2ab-d779699b6a8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:46:17.249987 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: warnings.warn(msg) Feb 10 20:46:17.249987 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: Feb 10 20:46:17.252281 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28825423-9dea-43f1-b2ab-d779699b6a8d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:17.280424 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-2cb3795b-53b9-4ad8-88a6-14743e2394d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:17.280424 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 263/529] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:17.285953 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3795b-53b9-4ad8-88a6-14743e2394d0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:17.287696 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 267/530] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:17.293658 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28825423-9dea-43f1-b2ab-d779699b6a8d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:17.296621 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3795b-53b9-4ad8-88a6-14743e2394d0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:17.301279 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976ca01-0cac-4528-a436-49d5d0883cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:17.305375 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976ca01-0cac-4528-a436-49d5d0883cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:17.305375 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976ca01-0cac-4528-a436-49d5d0883cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:17.305375 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976ca01-0cac-4528-a436-49d5d0883cf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:17.305375 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976ca01-0cac-4528-a436-49d5d0883cf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:17.305375 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976ca01-0cac-4528-a436-49d5d0883cf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:17.305971 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976ca01-0cac-4528-a436-49d5d0883cf8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:17.311450 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28825423-9dea-43f1-b2ab-d779699b6a8d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:17.326727 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90225b-d90e-4d68-85cd-0f5a3a6b4873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:17.327807 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90225b-d90e-4d68-85cd-0f5a3a6b4873 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:17.328177 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 264/531] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:17.328351 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90225b-d90e-4d68-85cd-0f5a3a6b4873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:17.328731 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90225b-d90e-4d68-85cd-0f5a3a6b4873 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:17.329769 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90225b-d90e-4d68-85cd-0f5a3a6b4873 admin admin] RBAC: Adding query filter params (role.id=67325e5669ca4296b3b2c0eb443fda3e, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=256860d94eb142c6b2175ae89f977e4a) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:17.330155 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90225b-d90e-4d68-85cd-0f5a3a6b4873 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:17.335941 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976ca01-0cac-4528-a436-49d5d0883cf8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:17.341129 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90225b-d90e-4d68-85cd-0f5a3a6b4873 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:17.353372 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976ca01-0cac-4528-a436-49d5d0883cf8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:17.354699 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 268/532] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:46:17 2022] GET /identity/v3/role_assignments?user.id=256860d94eb142c6b2175ae89f977e4a&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=67325e5669ca4296b3b2c0eb443fda3e => generated 259 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:17.359352 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15147d-c06f-43ec-9e36-22fdedba3d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:17.360359 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15147d-c06f-43ec-9e36-22fdedba3d8d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:17.360758 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15147d-c06f-43ec-9e36-22fdedba3d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:17.361210 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15147d-c06f-43ec-9e36-22fdedba3d8d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:17.369468 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15147d-c06f-43ec-9e36-22fdedba3d8d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:17.371570 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15147d-c06f-43ec-9e36-22fdedba3d8d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:17.386001 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-9d15147d-c06f-43ec-9e36-22fdedba3d8d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:17.387421 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 265/533] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:17.395331 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90225b-d90e-4d68-85cd-0f5a3a6b4873 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:17.405768 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90225b-d90e-4d68-85cd-0f5a3a6b4873 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:17.417922 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f297c-0f13-4f7c-b5b3-27ecde64d4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:17.418775 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f297c-0f13-4f7c-b5b3-27ecde64d4df admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:17.419181 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f297c-0f13-4f7c-b5b3-27ecde64d4df admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:17.419541 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f297c-0f13-4f7c-b5b3-27ecde64d4df admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:17.420562 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f297c-0f13-4f7c-b5b3-27ecde64d4df admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:17.420965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f297c-0f13-4f7c-b5b3-27ecde64d4df admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:17.423489 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f297c-0f13-4f7c-b5b3-27ecde64d4df admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:17.442772 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 269/534] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:17.449014 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15147d-c06f-43ec-9e36-22fdedba3d8d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:17.459731 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15147d-c06f-43ec-9e36-22fdedba3d8d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:17.469979 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40c11b-89a7-41d8-8694-f34060b9f113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:17.470827 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40c11b-89a7-41d8-8694-f34060b9f113 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:17.471232 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40c11b-89a7-41d8-8694-f34060b9f113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:17.471596 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40c11b-89a7-41d8-8694-f34060b9f113 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:17.472644 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40c11b-89a7-41d8-8694-f34060b9f113 admin admin] RBAC: Adding query filter params (role.id=67325e5669ca4296b3b2c0eb443fda3e, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=b07a9ae7262b44ce88e1338c83360356) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:17.473045 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40c11b-89a7-41d8-8694-f34060b9f113 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:17.475154 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40c11b-89a7-41d8-8694-f34060b9f113 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:17.489934 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 266/535] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:46:17 2022] GET /identity/v3/role_assignments?user.id=b07a9ae7262b44ce88e1338c83360356&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=67325e5669ca4296b3b2c0eb443fda3e => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:17.508742 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03c9db-986b-4445-a9fd-4f5df4026a91 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:17.509203 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03c9db-986b-4445-a9fd-4f5df4026a91 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:17.509598 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03c9db-986b-4445-a9fd-4f5df4026a91 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:17.511697 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 270/536] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:17.526443 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39206a29-f7b5-4f64-bc1a-6164bf7a99fb None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:17.526443 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39206a29-f7b5-4f64-bc1a-6164bf7a99fb None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:17.526443 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39206a29-f7b5-4f64-bc1a-6164bf7a99fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:17.546700 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-39206a29-f7b5-4f64-bc1a-6164bf7a99fb None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:17.547936 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-39206a29-f7b5-4f64-bc1a-6164bf7a99fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:17.562565 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 267/537] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:17.601111 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03c9db-986b-4445-a9fd-4f5df4026a91 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:17.615251 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03c9db-986b-4445-a9fd-4f5df4026a91 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:17.622537 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc115488-6067-4c2a-8102-f2037770549b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:17.623406 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc115488-6067-4c2a-8102-f2037770549b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:17.623771 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc115488-6067-4c2a-8102-f2037770549b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:17.624041 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc115488-6067-4c2a-8102-f2037770549b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:17.637043 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc115488-6067-4c2a-8102-f2037770549b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:17.639156 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc115488-6067-4c2a-8102-f2037770549b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:17.658930 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-cc115488-6067-4c2a-8102-f2037770549b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:17.660543 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 271/538] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:17.666566 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39206a29-f7b5-4f64-bc1a-6164bf7a99fb None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:17.676640 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39206a29-f7b5-4f64-bc1a-6164bf7a99fb None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:17.695069 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad06c8c-907d-4b1c-a43f-2ea8e02db608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:17.695752 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad06c8c-907d-4b1c-a43f-2ea8e02db608 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:17.696022 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad06c8c-907d-4b1c-a43f-2ea8e02db608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:17.696284 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad06c8c-907d-4b1c-a43f-2ea8e02db608 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:17.697026 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad06c8c-907d-4b1c-a43f-2ea8e02db608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:17.697316 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad06c8c-907d-4b1c-a43f-2ea8e02db608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:17.699031 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad06c8c-907d-4b1c-a43f-2ea8e02db608 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:17.714597 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 268/539] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:17.720609 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc115488-6067-4c2a-8102-f2037770549b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:17.731793 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc115488-6067-4c2a-8102-f2037770549b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:17.736374 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19432f6a-299f-4e12-ad1c-70c95c9d1814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:17.737207 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19432f6a-299f-4e12-ad1c-70c95c9d1814 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:17.737621 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19432f6a-299f-4e12-ad1c-70c95c9d1814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:17.737822 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19432f6a-299f-4e12-ad1c-70c95c9d1814 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:17.738552 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19432f6a-299f-4e12-ad1c-70c95c9d1814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:17.740548 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19432f6a-299f-4e12-ad1c-70c95c9d1814 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:17.770539 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 272/540] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 10 20:46:17 2022] POST /identity/v3/users => generated 247 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:46:19.374302 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda24390-cef0-4fa3-b44e-e70c476dccf6 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:19.375024 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda24390-cef0-4fa3-b44e-e70c476dccf6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:19.375024 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda24390-cef0-4fa3-b44e-e70c476dccf6 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:19.376604 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 269/541] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:19.382041 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447e515-4e5e-4f93-8960-7db6dace19da None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:19.382526 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447e515-4e5e-4f93-8960-7db6dace19da None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:19.382679 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447e515-4e5e-4f93-8960-7db6dace19da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:19.405621 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-1447e515-4e5e-4f93-8960-7db6dace19da None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:19.406800 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-1447e515-4e5e-4f93-8960-7db6dace19da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:19.415979 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 273/542] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:19.451022 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda24390-cef0-4fa3-b44e-e70c476dccf6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:19.462321 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305abbd6-6d25-4ca2-871b-9e3f04b2b6da None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:19.462588 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305abbd6-6d25-4ca2-871b-9e3f04b2b6da None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:19.462867 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305abbd6-6d25-4ca2-871b-9e3f04b2b6da None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:19.464653 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 274/543] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:19.467994 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda24390-cef0-4fa3-b44e-e70c476dccf6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:19.472298 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f798c-06ab-4cb7-834a-4636c6dd9581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:19.473104 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f798c-06ab-4cb7-834a-4636c6dd9581 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:19.473417 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f798c-06ab-4cb7-834a-4636c6dd9581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:19.473694 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f798c-06ab-4cb7-834a-4636c6dd9581 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:19.482933 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8116ef-62be-463d-a697-49189e910dcf None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:19.483213 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8116ef-62be-463d-a697-49189e910dcf None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:19.483475 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8116ef-62be-463d-a697-49189e910dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:19.484602 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f798c-06ab-4cb7-834a-4636c6dd9581 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:19.491537 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-834f798c-06ab-4cb7-834a-4636c6dd9581 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 20:46:19.492997 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 270/544] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:46:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:19.498742 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f798c-06ab-4cb7-834a-4636c6dd9581 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:19.510263 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f798c-06ab-4cb7-834a-4636c6dd9581 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:19.515633 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-eb8116ef-62be-463d-a697-49189e910dcf None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:19.516817 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-eb8116ef-62be-463d-a697-49189e910dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:19.518671 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0edec5-f77e-4aae-9989-094f4572f4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:19.519324 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0edec5-f77e-4aae-9989-094f4572f4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:19.519598 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0edec5-f77e-4aae-9989-094f4572f4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:19.519865 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0edec5-f77e-4aae-9989-094f4572f4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:19.520620 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0edec5-f77e-4aae-9989-094f4572f4b1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:19.520919 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0edec5-f77e-4aae-9989-094f4572f4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:19.522528 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0edec5-f77e-4aae-9989-094f4572f4b1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:19.536971 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 275/545] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:46:19.538964 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 271/546] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 10 20:46:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:19.544484 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8116ef-62be-463d-a697-49189e910dcf None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:19.554307 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8116ef-62be-463d-a697-49189e910dcf None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:19.558849 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae02ac-02b5-4c90-b9d3-58a04e80882c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:19.559645 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae02ac-02b5-4c90-b9d3-58a04e80882c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:19.559920 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae02ac-02b5-4c90-b9d3-58a04e80882c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:19.560189 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae02ac-02b5-4c90-b9d3-58a04e80882c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:19.575410 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae02ac-02b5-4c90-b9d3-58a04e80882c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:19.577314 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae02ac-02b5-4c90-b9d3-58a04e80882c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:19.578992 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0edec5-f77e-4aae-9989-094f4572f4b1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:19.595761 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0edec5-f77e-4aae-9989-094f4572f4b1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:19.596362 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-a4ae02ac-02b5-4c90-b9d3-58a04e80882c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:19.598001 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 276/547] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:19.608260 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae02ac-02b5-4c90-b9d3-58a04e80882c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:19.608726 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6453-845b-4394-a4b4-0c3d1b74caea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:19.609591 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6453-845b-4394-a4b4-0c3d1b74caea admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:19.609879 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6453-845b-4394-a4b4-0c3d1b74caea admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:19.610136 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6453-845b-4394-a4b4-0c3d1b74caea admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:19.621198 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b6453-845b-4394-a4b4-0c3d1b74caea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:19.622721 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae02ac-02b5-4c90-b9d3-58a04e80882c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:19.628336 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-863b6453-845b-4394-a4b4-0c3d1b74caea admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 20:46:19.629822 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 272/548] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:46:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:19.639018 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6453-845b-4394-a4b4-0c3d1b74caea admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:19.641334 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214f342-d2e6-4e3c-89d2-e8b6c7dbbd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:19.642476 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214f342-d2e6-4e3c-89d2-e8b6c7dbbd25 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:19.643188 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214f342-d2e6-4e3c-89d2-e8b6c7dbbd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:19.645069 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214f342-d2e6-4e3c-89d2-e8b6c7dbbd25 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:19.645856 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214f342-d2e6-4e3c-89d2-e8b6c7dbbd25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:19.646162 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214f342-d2e6-4e3c-89d2-e8b6c7dbbd25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:19.650199 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214f342-d2e6-4e3c-89d2-e8b6c7dbbd25 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:19.662512 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6453-845b-4394-a4b4-0c3d1b74caea admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:19.670320 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 277/549] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:19.674357 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177c48a-7637-4866-bfc2-d02754e7e549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:19.675033 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177c48a-7637-4866-bfc2-d02754e7e549 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:19.675309 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177c48a-7637-4866-bfc2-d02754e7e549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:19.675580 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177c48a-7637-4866-bfc2-d02754e7e549 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:19.676304 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214f342-d2e6-4e3c-89d2-e8b6c7dbbd25 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:19.676406 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177c48a-7637-4866-bfc2-d02754e7e549 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:19.676623 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177c48a-7637-4866-bfc2-d02754e7e549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:19.678233 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177c48a-7637-4866-bfc2-d02754e7e549 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:19.687070 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214f342-d2e6-4e3c-89d2-e8b6c7dbbd25 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:19.692046 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db344a-1d1e-4050-9d0c-8216952c43e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:19.693069 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db344a-1d1e-4050-9d0c-8216952c43e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:19.693536 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db344a-1d1e-4050-9d0c-8216952c43e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:19.693996 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db344a-1d1e-4050-9d0c-8216952c43e3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:19.696618 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 273/550] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 10 20:46:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:19.707012 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db344a-1d1e-4050-9d0c-8216952c43e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:19.709330 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db344a-1d1e-4050-9d0c-8216952c43e3 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:19.713176 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177c48a-7637-4866-bfc2-d02754e7e549 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:19.724394 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-a7db344a-1d1e-4050-9d0c-8216952c43e3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 20:46:19.726110 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 278/551] 10.222.0.31 () {56 vars in 1114 bytes} [Thu Feb 10 20:46:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:19.734784 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db344a-1d1e-4050-9d0c-8216952c43e3 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:19.734925 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177c48a-7637-4866-bfc2-d02754e7e549 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:19.746155 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e3403-6025-459a-91e1-772b2649fa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:19.747209 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e3403-6025-459a-91e1-772b2649fa8c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:19.747625 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e3403-6025-459a-91e1-772b2649fa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:19.748275 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e3403-6025-459a-91e1-772b2649fa8c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:19.751527 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db344a-1d1e-4050-9d0c-8216952c43e3 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:19.762083 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b15807-132e-42b9-8518-828ae3af691c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:19.763542 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b15807-132e-42b9-8518-828ae3af691c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:19.765627 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b15807-132e-42b9-8518-828ae3af691c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:19.766083 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b15807-132e-42b9-8518-828ae3af691c admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:19.768841 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b15807-132e-42b9-8518-828ae3af691c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:19.769312 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b15807-132e-42b9-8518-828ae3af691c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:19.772366 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e3403-6025-459a-91e1-772b2649fa8c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:19.774023 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b15807-132e-42b9-8518-828ae3af691c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:19.777489 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e3403-6025-459a-91e1-772b2649fa8c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:19.816632 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 279/552] 10.222.0.31 () {56 vars in 1154 bytes} [Thu Feb 10 20:46:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:19.817137 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-243e3403-6025-459a-91e1-772b2649fa8c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:19.823285 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 274/553] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:19.825060 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b15807-132e-42b9-8518-828ae3af691c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:19.829639 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e3403-6025-459a-91e1-772b2649fa8c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:19.843490 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b15807-132e-42b9-8518-828ae3af691c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:19.847763 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e3403-6025-459a-91e1-772b2649fa8c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:19.853796 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eff2d3-b8c6-4d75-8553-0c1bac52f4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:19.855706 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eff2d3-b8c6-4d75-8553-0c1bac52f4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:19.856477 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eff2d3-b8c6-4d75-8553-0c1bac52f4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:19.857371 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eff2d3-b8c6-4d75-8553-0c1bac52f4f2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:19.858610 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499c99d-f6b7-4a10-8c9e-d44f9597617a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:19.859618 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499c99d-f6b7-4a10-8c9e-d44f9597617a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:19.861344 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499c99d-f6b7-4a10-8c9e-d44f9597617a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:19.861780 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499c99d-f6b7-4a10-8c9e-d44f9597617a admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:19.862977 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499c99d-f6b7-4a10-8c9e-d44f9597617a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:19.864606 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499c99d-f6b7-4a10-8c9e-d44f9597617a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:19.869848 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499c99d-f6b7-4a10-8c9e-d44f9597617a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:19.880592 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eff2d3-b8c6-4d75-8553-0c1bac52f4f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:19.882649 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eff2d3-b8c6-4d75-8553-0c1bac52f4f2 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:19.892893 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 275/554] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:19.898433 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499c99d-f6b7-4a10-8c9e-d44f9597617a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:19.921650 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499c99d-f6b7-4a10-8c9e-d44f9597617a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:19.923513 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-66eff2d3-b8c6-4d75-8553-0c1bac52f4f2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:19.929185 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e529ee-d592-487e-98ea-7d0db0fe1c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:19.934330 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e529ee-d592-487e-98ea-7d0db0fe1c2a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:19.934834 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e529ee-d592-487e-98ea-7d0db0fe1c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:19.935280 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e529ee-d592-487e-98ea-7d0db0fe1c2a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:19.935432 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 280/555] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:19.937638 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eff2d3-b8c6-4d75-8553-0c1bac52f4f2 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:19.953677 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e529ee-d592-487e-98ea-7d0db0fe1c2a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:19.957981 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eff2d3-b8c6-4d75-8553-0c1bac52f4f2 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:19.958423 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e529ee-d592-487e-98ea-7d0db0fe1c2a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:19.974428 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-46e529ee-d592-487e-98ea-7d0db0fe1c2a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 10 20:46:19.974577 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1d675-f78c-4d70-8877-5f932b10f8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:19.975161 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1d675-f78c-4d70-8877-5f932b10f8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:19.975440 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1d675-f78c-4d70-8877-5f932b10f8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:19.975710 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1d675-f78c-4d70-8877-5f932b10f8f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:19.976451 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1d675-f78c-4d70-8877-5f932b10f8f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:19.976750 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1d675-f78c-4d70-8877-5f932b10f8f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:19.977130 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 276/556] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:19.980256 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1d675-f78c-4d70-8877-5f932b10f8f7 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:19.986390 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e529ee-d592-487e-98ea-7d0db0fe1c2a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:19.991799 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 281/557] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:19.997297 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e529ee-d592-487e-98ea-7d0db0fe1c2a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.001719 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1d675-f78c-4d70-8877-5f932b10f8f7 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.009908 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd50a57-ffec-4af6-a9da-f54ff34e3594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.010652 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd50a57-ffec-4af6-a9da-f54ff34e3594 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.010997 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd50a57-ffec-4af6-a9da-f54ff34e3594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.011332 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd50a57-ffec-4af6-a9da-f54ff34e3594 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.012256 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd50a57-ffec-4af6-a9da-f54ff34e3594 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:20.012630 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd50a57-ffec-4af6-a9da-f54ff34e3594 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.014557 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd50a57-ffec-4af6-a9da-f54ff34e3594 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.021226 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1d675-f78c-4d70-8877-5f932b10f8f7 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.031956 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1002a6-e52b-4423-b448-a205e9475a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.033785 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1002a6-e52b-4423-b448-a205e9475a5f admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.034145 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1002a6-e52b-4423-b448-a205e9475a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.034478 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1002a6-e52b-4423-b448-a205e9475a5f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.042932 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1002a6-e52b-4423-b448-a205e9475a5f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.046726 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1002a6-e52b-4423-b448-a205e9475a5f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.047083 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 277/558] 10.222.0.31 () {56 vars in 1158 bytes} [Thu Feb 10 20:46:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:20.049318 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd50a57-ffec-4af6-a9da-f54ff34e3594 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.060228 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd50a57-ffec-4af6-a9da-f54ff34e3594 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.061229 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-5f1002a6-e52b-4423-b448-a205e9475a5f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:20.062914 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 282/559] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:20.073030 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1002a6-e52b-4423-b448-a205e9475a5f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.078088 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c56998-d6a4-4711-b5b2-ec990cdac7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.078412 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1002a6-e52b-4423-b448-a205e9475a5f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.079273 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c56998-d6a4-4711-b5b2-ec990cdac7ba admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.079552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c56998-d6a4-4711-b5b2-ec990cdac7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.079825 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c56998-d6a4-4711-b5b2-ec990cdac7ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.089551 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab1cba-1f50-4f11-bcb8-44d4d4107d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.090488 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab1cba-1f50-4f11-bcb8-44d4d4107d88 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.091443 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab1cba-1f50-4f11-bcb8-44d4d4107d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.092677 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab1cba-1f50-4f11-bcb8-44d4d4107d88 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.093690 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab1cba-1f50-4f11-bcb8-44d4d4107d88 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:20.094871 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab1cba-1f50-4f11-bcb8-44d4d4107d88 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.098143 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab1cba-1f50-4f11-bcb8-44d4d4107d88 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.101137 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c56998-d6a4-4711-b5b2-ec990cdac7ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.103098 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c56998-d6a4-4711-b5b2-ec990cdac7ba admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.113713 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 283/560] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:20.119906 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba2d26-5cc6-40cc-8b29-f51fd37e1fa7 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.120257 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-46c56998-d6a4-4711-b5b2-ec990cdac7ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:20.120603 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba2d26-5cc6-40cc-8b29-f51fd37e1fa7 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.121082 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba2d26-5cc6-40cc-8b29-f51fd37e1fa7 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.121908 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 278/561] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:20.122755 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c56998-d6a4-4711-b5b2-ec990cdac7ba admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.123560 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 284/562] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:20.130957 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba2d26-5cc6-40cc-8b29-f51fd37e1fa7 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.132648 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c56998-d6a4-4711-b5b2-ec990cdac7ba admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.137145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ef3be-b8a6-4e46-8d87-fc97428ceaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.138053 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ef3be-b8a6-4e46-8d87-fc97428ceaab admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.138325 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ef3be-b8a6-4e46-8d87-fc97428ceaab admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.138594 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ef3be-b8a6-4e46-8d87-fc97428ceaab admin admin] PATH_INFO: `/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/c0d84b0d7e3d423aa972e58be27c772c/roles/67325e5669ca4296b3b2c0eb443fda3e` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.148161 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba2d26-5cc6-40cc-8b29-f51fd37e1fa7 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.153880 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ef3be-b8a6-4e46-8d87-fc97428ceaab admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f35ac6d668442a9ea0347f99eb2881, user_id=c0d84b0d7e3d423aa972e58be27c772c, role_id=67325e5669ca4296b3b2c0eb443fda3e)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.154436 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7d005-3114-4161-9699-6bbbe3c77742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.155295 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7d005-3114-4161-9699-6bbbe3c77742 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.155759 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7d005-3114-4161-9699-6bbbe3c77742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.156213 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7d005-3114-4161-9699-6bbbe3c77742 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.156781 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ef3be-b8a6-4e46-8d87-fc97428ceaab admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.157349 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7d005-3114-4161-9699-6bbbe3c77742 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:20.157858 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7d005-3114-4161-9699-6bbbe3c77742 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.160195 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7d005-3114-4161-9699-6bbbe3c77742 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.172843 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 279/563] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:46:20 2022] PUT /identity/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/c0d84b0d7e3d423aa972e58be27c772c/roles/67325e5669ca4296b3b2c0eb443fda3e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:46:20.174459 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e95e7-2b71-46a5-9059-020a244aa6c1 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.174742 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e95e7-2b71-46a5-9059-020a244aa6c1 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.175013 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e95e7-2b71-46a5-9059-020a244aa6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.175627 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 285/564] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:20.182225 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7d005-3114-4161-9699-6bbbe3c77742 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.205422 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-715e95e7-2b71-46a5-9059-020a244aa6c1 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:20.206742 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-715e95e7-2b71-46a5-9059-020a244aa6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:20.209127 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7d005-3114-4161-9699-6bbbe3c77742 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.280131 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 280/565] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:20.289619 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ab81f-2c3f-481e-bcee-98be3219858c None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.289619 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ab81f-2c3f-481e-bcee-98be3219858c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.289619 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ab81f-2c3f-481e-bcee-98be3219858c None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.289619 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 281/566] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:20.294292 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a002b6-47fa-4857-9dc8-7a68a8073f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.295230 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a002b6-47fa-4857-9dc8-7a68a8073f48 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.295655 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a002b6-47fa-4857-9dc8-7a68a8073f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.296021 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a002b6-47fa-4857-9dc8-7a68a8073f48 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.307251 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1b90d-1b8b-4c9b-a450-dbd6884de438 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.307896 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1b90d-1b8b-4c9b-a450-dbd6884de438 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.307896 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1b90d-1b8b-4c9b-a450-dbd6884de438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.312016 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a002b6-47fa-4857-9dc8-7a68a8073f48 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.314427 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a002b6-47fa-4857-9dc8-7a68a8073f48 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.329037 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-cdc1b90d-1b8b-4c9b-a450-dbd6884de438 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:20.330535 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-cdc1b90d-1b8b-4c9b-a450-dbd6884de438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:20.331093 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-e5a002b6-47fa-4857-9dc8-7a68a8073f48 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:20.333187 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 286/567] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:20.334400 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a002b6-47fa-4857-9dc8-7a68a8073f48 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.344821 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 282/568] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:46:20.346731 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a002b6-47fa-4857-9dc8-7a68a8073f48 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.350126 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1b90d-1b8b-4c9b-a450-dbd6884de438 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.353823 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069303b8-2482-4470-8c16-987bd915e0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.354929 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069303b8-2482-4470-8c16-987bd915e0cd admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.355470 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069303b8-2482-4470-8c16-987bd915e0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.355919 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069303b8-2482-4470-8c16-987bd915e0cd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.366670 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1b90d-1b8b-4c9b-a450-dbd6884de438 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.371665 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077b5e9-77ef-4049-94f1-96e091bfa553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.372693 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077b5e9-77ef-4049-94f1-96e091bfa553 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.373033 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069303b8-2482-4470-8c16-987bd915e0cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:20.373716 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077b5e9-77ef-4049-94f1-96e091bfa553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.374221 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077b5e9-77ef-4049-94f1-96e091bfa553 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.375203 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077b5e9-77ef-4049-94f1-96e091bfa553 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:20.376202 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077b5e9-77ef-4049-94f1-96e091bfa553 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.378534 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077b5e9-77ef-4049-94f1-96e091bfa553 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.381215 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-069303b8-2482-4470-8c16-987bd915e0cd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 20:46:20.382728 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 287/569] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:20.383537 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069303b8-2482-4470-8c16-987bd915e0cd admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.393913 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069303b8-2482-4470-8c16-987bd915e0cd admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.395664 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 283/570] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:20.396459 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077b5e9-77ef-4049-94f1-96e091bfa553 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.398430 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee7cb6-33f4-4b0f-a65b-9c06acd2f42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.399208 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee7cb6-33f4-4b0f-a65b-9c06acd2f42e admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.399489 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee7cb6-33f4-4b0f-a65b-9c06acd2f42e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.399749 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee7cb6-33f4-4b0f-a65b-9c06acd2f42e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.410764 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077b5e9-77ef-4049-94f1-96e091bfa553 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.412143 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee7cb6-33f4-4b0f-a65b-9c06acd2f42e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:20.415072 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760e7dc-1e74-4eef-bf0f-2f81ce7c46cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.415732 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760e7dc-1e74-4eef-bf0f-2f81ce7c46cd admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.416100 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760e7dc-1e74-4eef-bf0f-2f81ce7c46cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.416444 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760e7dc-1e74-4eef-bf0f-2f81ce7c46cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.417205 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760e7dc-1e74-4eef-bf0f-2f81ce7c46cd admin admin] RBAC: Adding query filter params (name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:20.417568 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760e7dc-1e74-4eef-bf0f-2f81ce7c46cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.419153 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760e7dc-1e74-4eef-bf0f-2f81ce7c46cd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.419244 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-d3ee7cb6-33f4-4b0f-a65b-9c06acd2f42e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 20:46:20.420531 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 288/571] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:20.421453 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee7cb6-33f4-4b0f-a65b-9c06acd2f42e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.428094 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 284/572] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:20.428912 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760e7dc-1e74-4eef-bf0f-2f81ce7c46cd admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.435309 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee7cb6-33f4-4b0f-a65b-9c06acd2f42e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.438317 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760e7dc-1e74-4eef-bf0f-2f81ce7c46cd admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.439981 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49e898-ea27-4b5e-ac6a-562021aab4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.440938 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49e898-ea27-4b5e-ac6a-562021aab4c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.441321 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49e898-ea27-4b5e-ac6a-562021aab4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.441752 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49e898-ea27-4b5e-ac6a-562021aab4c1 admin admin] PATH_INFO: `/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/ce66e520f6f84eab9e85c81022a0c743/roles/67325e5669ca4296b3b2c0eb443fda3e` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.442989 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c8ebc-5e3f-437a-9072-13b7d8221629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.443806 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c8ebc-5e3f-437a-9072-13b7d8221629 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.444238 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c8ebc-5e3f-437a-9072-13b7d8221629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.444646 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c8ebc-5e3f-437a-9072-13b7d8221629 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.445570 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c8ebc-5e3f-437a-9072-13b7d8221629 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:20.446001 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c8ebc-5e3f-437a-9072-13b7d8221629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.447821 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c8ebc-5e3f-437a-9072-13b7d8221629 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.457234 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 285/573] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:20.458064 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49e898-ea27-4b5e-ac6a-562021aab4c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f35ac6d668442a9ea0347f99eb2881, user_id=ce66e520f6f84eab9e85c81022a0c743, role_id=67325e5669ca4296b3b2c0eb443fda3e)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.458503 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c8ebc-5e3f-437a-9072-13b7d8221629 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.460982 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49e898-ea27-4b5e-ac6a-562021aab4c1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.469263 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c8ebc-5e3f-437a-9072-13b7d8221629 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.474385 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac845fc2-6504-43db-a655-5daf3091c8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.475443 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac845fc2-6504-43db-a655-5daf3091c8ea admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.475864 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac845fc2-6504-43db-a655-5daf3091c8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.476320 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac845fc2-6504-43db-a655-5daf3091c8ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.481392 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 289/574] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:46:20 2022] PUT /identity/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/ce66e520f6f84eab9e85c81022a0c743/roles/67325e5669ca4296b3b2c0eb443fda3e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:46:20.481392 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49e898-ea27-4b5e-ac6a-562021aab4c1 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.507289 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac845fc2-6504-43db-a655-5daf3091c8ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.514674 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac845fc2-6504-43db-a655-5daf3091c8ea admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.557752 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-ac845fc2-6504-43db-a655-5daf3091c8ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:20.562241 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 286/575] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:20.567605 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac845fc2-6504-43db-a655-5daf3091c8ea admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.585053 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac845fc2-6504-43db-a655-5daf3091c8ea admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.601009 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49e898-ea27-4b5e-ac6a-562021aab4c1 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.606753 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc3c77-f624-424d-85f4-fe2babfb629e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.607871 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc3c77-f624-424d-85f4-fe2babfb629e admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.608401 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc3c77-f624-424d-85f4-fe2babfb629e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.608771 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc3c77-f624-424d-85f4-fe2babfb629e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.621161 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc3c77-f624-424d-85f4-fe2babfb629e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.623725 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc3c77-f624-424d-85f4-fe2babfb629e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.643331 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-b5cc3c77-f624-424d-85f4-fe2babfb629e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:20.644645 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 290/576] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:20.650291 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc3c77-f624-424d-85f4-fe2babfb629e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.680409 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc3c77-f624-424d-85f4-fe2babfb629e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.683638 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec4fdd-2f52-4676-971a-3499ed8d8b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.684576 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec4fdd-2f52-4676-971a-3499ed8d8b8d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.684994 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec4fdd-2f52-4676-971a-3499ed8d8b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.685441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec4fdd-2f52-4676-971a-3499ed8d8b8d admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.686430 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec4fdd-2f52-4676-971a-3499ed8d8b8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:20.686922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec4fdd-2f52-4676-971a-3499ed8d8b8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.688817 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec4fdd-2f52-4676-971a-3499ed8d8b8d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.702048 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 287/577] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:20.707877 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9a139-09b7-4ab7-9137-aee44c1e5b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.708428 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec4fdd-2f52-4676-971a-3499ed8d8b8d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.708568 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9a139-09b7-4ab7-9137-aee44c1e5b54 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.708850 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9a139-09b7-4ab7-9137-aee44c1e5b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.709117 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9a139-09b7-4ab7-9137-aee44c1e5b54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.709897 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9a139-09b7-4ab7-9137-aee44c1e5b54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:20.710199 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9a139-09b7-4ab7-9137-aee44c1e5b54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.711832 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9a139-09b7-4ab7-9137-aee44c1e5b54 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.719470 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec4fdd-2f52-4676-971a-3499ed8d8b8d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.724941 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54665e06-98ce-4089-9221-de6ef1c95561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.725647 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 291/578] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:20.726234 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54665e06-98ce-4089-9221-de6ef1c95561 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.726514 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54665e06-98ce-4089-9221-de6ef1c95561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.726783 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54665e06-98ce-4089-9221-de6ef1c95561 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.734527 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9a139-09b7-4ab7-9137-aee44c1e5b54 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.739567 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54665e06-98ce-4089-9221-de6ef1c95561 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.741690 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54665e06-98ce-4089-9221-de6ef1c95561 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.752080 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9a139-09b7-4ab7-9137-aee44c1e5b54 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.756087 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-54665e06-98ce-4089-9221-de6ef1c95561 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 10 20:46:20.757583 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 288/579] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:20.762691 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54665e06-98ce-4089-9221-de6ef1c95561 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.772244 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54665e06-98ce-4089-9221-de6ef1c95561 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.773965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b05cbf-613c-4fcd-8082-c281a28cc6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.774818 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b05cbf-613c-4fcd-8082-c281a28cc6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.775055 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b05cbf-613c-4fcd-8082-c281a28cc6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.775320 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b05cbf-613c-4fcd-8082-c281a28cc6b9 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.777078 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7903b-23f6-40ae-b237-f45d8eb2e4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.777752 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7903b-23f6-40ae-b237-f45d8eb2e4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.778031 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7903b-23f6-40ae-b237-f45d8eb2e4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.778301 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7903b-23f6-40ae-b237-f45d8eb2e4e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.779146 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7903b-23f6-40ae-b237-f45d8eb2e4e9 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:20.779449 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7903b-23f6-40ae-b237-f45d8eb2e4e9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.781269 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7903b-23f6-40ae-b237-f45d8eb2e4e9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.794604 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b05cbf-613c-4fcd-8082-c281a28cc6b9 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.796619 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b05cbf-613c-4fcd-8082-c281a28cc6b9 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.799755 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 289/580] 10.222.0.31 () {56 vars in 1158 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:20.805266 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7903b-23f6-40ae-b237-f45d8eb2e4e9 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.815093 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7903b-23f6-40ae-b237-f45d8eb2e4e9 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.819610 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb406d-802f-4a68-a253-000c68919576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.820385 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb406d-802f-4a68-a253-000c68919576 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.820659 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb406d-802f-4a68-a253-000c68919576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.820929 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb406d-802f-4a68-a253-000c68919576 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.821040 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-21b05cbf-613c-4fcd-8082-c281a28cc6b9 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 10 20:46:20.829497 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 292/581] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:20.831049 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34336b6a-72d7-458c-a15f-b4cbc1fe2d8b None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.831308 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb406d-802f-4a68-a253-000c68919576 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.831412 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34336b6a-72d7-458c-a15f-b4cbc1fe2d8b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.831595 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34336b6a-72d7-458c-a15f-b4cbc1fe2d8b None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.833141 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb406d-802f-4a68-a253-000c68919576 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.833637 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 293/582] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:20.838232 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34336b6a-72d7-458c-a15f-b4cbc1fe2d8b None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.850633 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34336b6a-72d7-458c-a15f-b4cbc1fe2d8b None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.851654 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-bccb406d-802f-4a68-a253-000c68919576 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:20.852849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 290/583] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:20.854102 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59d89d-ccfc-43ec-9b07-130143a874af None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.854380 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59d89d-ccfc-43ec-9b07-130143a874af None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.854738 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59d89d-ccfc-43ec-9b07-130143a874af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.856210 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c9e43-68b1-430a-9d78-a3921604c803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.857386 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c9e43-68b1-430a-9d78-a3921604c803 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.857788 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c9e43-68b1-430a-9d78-a3921604c803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.858187 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c9e43-68b1-430a-9d78-a3921604c803 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.859097 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c9e43-68b1-430a-9d78-a3921604c803 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:20.859658 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c9e43-68b1-430a-9d78-a3921604c803 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.861848 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c9e43-68b1-430a-9d78-a3921604c803 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.874991 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-6e59d89d-ccfc-43ec-9b07-130143a874af None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:20.876219 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6e59d89d-ccfc-43ec-9b07-130143a874af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:20.882208 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 294/584] 10.222.0.31 () {56 vars in 1160 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:20.883120 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c9e43-68b1-430a-9d78-a3921604c803 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.885407 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 291/585] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:20.888188 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59d89d-ccfc-43ec-9b07-130143a874af None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.897961 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59d89d-ccfc-43ec-9b07-130143a874af None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.902115 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c9e43-68b1-430a-9d78-a3921604c803 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.903531 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3d38e-6baa-49d6-abeb-e76f2ea3a336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.904409 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3d38e-6baa-49d6-abeb-e76f2ea3a336 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.904780 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3d38e-6baa-49d6-abeb-e76f2ea3a336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.905115 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3d38e-6baa-49d6-abeb-e76f2ea3a336 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.912756 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da34c28-a416-4cc2-8967-3ba42e960090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.915013 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da34c28-a416-4cc2-8967-3ba42e960090 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.915339 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da34c28-a416-4cc2-8967-3ba42e960090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.916419 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da34c28-a416-4cc2-8967-3ba42e960090 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.918406 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da34c28-a416-4cc2-8967-3ba42e960090 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:20.918721 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da34c28-a416-4cc2-8967-3ba42e960090 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.922060 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da34c28-a416-4cc2-8967-3ba42e960090 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.924116 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3d38e-6baa-49d6-abeb-e76f2ea3a336 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.926519 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3d38e-6baa-49d6-abeb-e76f2ea3a336 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.936451 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 295/586] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:20.937310 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da34c28-a416-4cc2-8967-3ba42e960090 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.944128 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-dbd3d38e-6baa-49d6-abeb-e76f2ea3a336 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:20.945535 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 292/587] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:20.946411 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3d38e-6baa-49d6-abeb-e76f2ea3a336 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.946893 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da34c28-a416-4cc2-8967-3ba42e960090 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.952039 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc2dc1-f2cb-4221-bf9e-be51c0ea6576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.953428 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc2dc1-f2cb-4221-bf9e-be51c0ea6576 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.953767 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc2dc1-f2cb-4221-bf9e-be51c0ea6576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.954043 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc2dc1-f2cb-4221-bf9e-be51c0ea6576 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.956787 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3d38e-6baa-49d6-abeb-e76f2ea3a336 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.961630 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7c8ca-5941-49f7-8b45-70e377d4abd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.962824 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7c8ca-5941-49f7-8b45-70e377d4abd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.963307 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7c8ca-5941-49f7-8b45-70e377d4abd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.963716 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7c8ca-5941-49f7-8b45-70e377d4abd4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.965146 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc2dc1-f2cb-4221-bf9e-be51c0ea6576 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:20.971290 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7c8ca-5941-49f7-8b45-70e377d4abd4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.973051 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-3cdc2dc1-f2cb-4221-bf9e-be51c0ea6576 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 20:46:20.973590 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7c8ca-5941-49f7-8b45-70e377d4abd4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.974453 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 296/588] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:20.979207 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc2dc1-f2cb-4221-bf9e-be51c0ea6576 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:20.986276 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc2dc1-f2cb-4221-bf9e-be51c0ea6576 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:20.990940 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e2768-ba10-4f0d-b43d-3c4c10f04477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:20.991578 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e2768-ba10-4f0d-b43d-3c4c10f04477 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:20.991900 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e2768-ba10-4f0d-b43d-3c4c10f04477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:20.992172 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e2768-ba10-4f0d-b43d-3c4c10f04477 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:20.992953 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e2768-ba10-4f0d-b43d-3c4c10f04477 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:20.993299 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e2768-ba10-4f0d-b43d-3c4c10f04477 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:20.994347 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-00b7c8ca-5941-49f7-8b45-70e377d4abd4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:20.995057 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e2768-ba10-4f0d-b43d-3c4c10f04477 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:20.996179 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 293/589] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:20.997902 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7c8ca-5941-49f7-8b45-70e377d4abd4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:21.008522 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 297/590] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:21.009453 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e2768-ba10-4f0d-b43d-3c4c10f04477 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:21.010289 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7c8ca-5941-49f7-8b45-70e377d4abd4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:21.015054 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d041d2-3df8-4a61-b7e4-4e9ae0952f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:21.016232 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d041d2-3df8-4a61-b7e4-4e9ae0952f38 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:21.016521 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d041d2-3df8-4a61-b7e4-4e9ae0952f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:21.016790 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d041d2-3df8-4a61-b7e4-4e9ae0952f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:21.017991 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d041d2-3df8-4a61-b7e4-4e9ae0952f38 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:21.018296 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d041d2-3df8-4a61-b7e4-4e9ae0952f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:21.019887 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d041d2-3df8-4a61-b7e4-4e9ae0952f38 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:21.020438 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e2768-ba10-4f0d-b43d-3c4c10f04477 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:21.026392 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a3c2d-f08e-4e1b-9f0a-dd5573259963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:21.027351 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a3c2d-f08e-4e1b-9f0a-dd5573259963 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:21.027858 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a3c2d-f08e-4e1b-9f0a-dd5573259963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:21.028266 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a3c2d-f08e-4e1b-9f0a-dd5573259963 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:21.028667 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 294/591] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 10 20:46:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:21.029515 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a3c2d-f08e-4e1b-9f0a-dd5573259963 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:21.029624 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d041d2-3df8-4a61-b7e4-4e9ae0952f38 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:21.030031 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a3c2d-f08e-4e1b-9f0a-dd5573259963 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:21.032177 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a3c2d-f08e-4e1b-9f0a-dd5573259963 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:21.046487 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d041d2-3df8-4a61-b7e4-4e9ae0952f38 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:21.047189 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 298/592] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:21.048201 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a3c2d-f08e-4e1b-9f0a-dd5573259963 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:21.054174 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604f436-68bf-4064-825f-f4c269a314c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:21.055070 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604f436-68bf-4064-825f-f4c269a314c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:21.055937 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604f436-68bf-4064-825f-f4c269a314c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:21.056214 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604f436-68bf-4064-825f-f4c269a314c7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:21.060986 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a3c2d-f08e-4e1b-9f0a-dd5573259963 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:21.065163 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604f436-68bf-4064-825f-f4c269a314c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:21.067135 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604f436-68bf-4064-825f-f4c269a314c7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:21.067594 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0881d-b003-4f06-8a44-7a44833aa21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:21.068635 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0881d-b003-4f06-8a44-7a44833aa21c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:21.069280 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0881d-b003-4f06-8a44-7a44833aa21c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:21.070142 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0881d-b003-4f06-8a44-7a44833aa21c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:21.082108 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-1604f436-68bf-4064-825f-f4c269a314c7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:21.083397 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0881d-b003-4f06-8a44-7a44833aa21c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:21.084051 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 295/593] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:21.084853 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604f436-68bf-4064-825f-f4c269a314c7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:21.085891 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0881d-b003-4f06-8a44-7a44833aa21c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:21.096109 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604f436-68bf-4064-825f-f4c269a314c7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:21.100883 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b0845-eab8-46da-9f5a-e3cb67baef41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:21.101848 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b0845-eab8-46da-9f5a-e3cb67baef41 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:21.102195 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b0845-eab8-46da-9f5a-e3cb67baef41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:21.102532 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b0845-eab8-46da-9f5a-e3cb67baef41 admin admin] PATH_INFO: `/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/256860d94eb142c6b2175ae89f977e4a/roles/67325e5669ca4296b3b2c0eb443fda3e` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:21.105078 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-80a0881d-b003-4f06-8a44-7a44833aa21c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:21.107671 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 299/594] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:21.108637 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0881d-b003-4f06-8a44-7a44833aa21c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:21.119296 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0881d-b003-4f06-8a44-7a44833aa21c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:21.123328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b0845-eab8-46da-9f5a-e3cb67baef41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f35ac6d668442a9ea0347f99eb2881, user_id=256860d94eb142c6b2175ae89f977e4a, role_id=67325e5669ca4296b3b2c0eb443fda3e)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:21.124989 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccda856-94aa-4c98-9824-e0c3641ae7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:21.125828 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccda856-94aa-4c98-9824-e0c3641ae7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:21.126215 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b0845-eab8-46da-9f5a-e3cb67baef41 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:21.126455 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccda856-94aa-4c98-9824-e0c3641ae7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:21.126860 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccda856-94aa-4c98-9824-e0c3641ae7d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:21.127845 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccda856-94aa-4c98-9824-e0c3641ae7d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:21.128295 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccda856-94aa-4c98-9824-e0c3641ae7d5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:21.131447 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccda856-94aa-4c98-9824-e0c3641ae7d5 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:21.146107 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 296/595] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:46:21 2022] PUT /identity/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/256860d94eb142c6b2175ae89f977e4a/roles/67325e5669ca4296b3b2c0eb443fda3e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:46:21.146316 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 300/596] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:21.147174 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b0845-eab8-46da-9f5a-e3cb67baef41 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:21.152479 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccda856-94aa-4c98-9824-e0c3641ae7d5 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:21.169856 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccda856-94aa-4c98-9824-e0c3641ae7d5 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:21.271459 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b0845-eab8-46da-9f5a-e3cb67baef41 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:21.282044 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf029d-6a50-4407-9ae4-fe67ffec1ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:21.284014 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf029d-6a50-4407-9ae4-fe67ffec1ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:21.284535 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf029d-6a50-4407-9ae4-fe67ffec1ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:21.285632 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf029d-6a50-4407-9ae4-fe67ffec1ec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:21.286741 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf029d-6a50-4407-9ae4-fe67ffec1ec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:21.287796 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf029d-6a50-4407-9ae4-fe67ffec1ec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:21.290085 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf029d-6a50-4407-9ae4-fe67ffec1ec1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:21.303383 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c98a5b-2bb1-422a-a7a0-67f6a4716e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:21.304595 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c98a5b-2bb1-422a-a7a0-67f6a4716e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:21.305011 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c98a5b-2bb1-422a-a7a0-67f6a4716e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:21.305469 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c98a5b-2bb1-422a-a7a0-67f6a4716e1e admin admin] PATH_INFO: `/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/b07a9ae7262b44ce88e1338c83360356/roles/67325e5669ca4296b3b2c0eb443fda3e` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:21.320103 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 297/597] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:21.325649 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf029d-6a50-4407-9ae4-fe67ffec1ec1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:21.333218 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c98a5b-2bb1-422a-a7a0-67f6a4716e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f35ac6d668442a9ea0347f99eb2881, user_id=b07a9ae7262b44ce88e1338c83360356, role_id=67325e5669ca4296b3b2c0eb443fda3e)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:21.336433 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c98a5b-2bb1-422a-a7a0-67f6a4716e1e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:21.336557 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf029d-6a50-4407-9ae4-fe67ffec1ec1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:21.343008 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e8679-8947-4b22-936b-71be1add33da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:21.343872 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e8679-8947-4b22-936b-71be1add33da admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:21.344214 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e8679-8947-4b22-936b-71be1add33da admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:21.344370 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e8679-8947-4b22-936b-71be1add33da admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:21.354458 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e8679-8947-4b22-936b-71be1add33da admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:21.356607 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e8679-8947-4b22-936b-71be1add33da admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:21.356776 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 301/598] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:46:21 2022] PUT /identity/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/b07a9ae7262b44ce88e1338c83360356/roles/67325e5669ca4296b3b2c0eb443fda3e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:46:21.375429 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-aa3e8679-8947-4b22-936b-71be1add33da admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 10 20:46:21.379128 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 298/599] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:46:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:21.383319 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c98a5b-2bb1-422a-a7a0-67f6a4716e1e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:21.453968 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c98a5b-2bb1-422a-a7a0-67f6a4716e1e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:21.459217 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0625da-8515-441e-8f43-a4f8bc521711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:21.460206 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0625da-8515-441e-8f43-a4f8bc521711 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:21.460678 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0625da-8515-441e-8f43-a4f8bc521711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:21.461140 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0625da-8515-441e-8f43-a4f8bc521711 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:21.462224 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0625da-8515-441e-8f43-a4f8bc521711 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:21.462698 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0625da-8515-441e-8f43-a4f8bc521711 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:21.464988 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0625da-8515-441e-8f43-a4f8bc521711 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:21.489372 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 302/600] 10.222.0.31 () {56 vars in 1156 bytes} [Thu Feb 10 20:46:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:21.495330 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e8679-8947-4b22-936b-71be1add33da admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:21.505814 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e8679-8947-4b22-936b-71be1add33da admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:21.510869 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c3698-1cec-4946-be67-28c8a7778a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:21.511840 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c3698-1cec-4946-be67-28c8a7778a01 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:21.512345 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c3698-1cec-4946-be67-28c8a7778a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:21.512784 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c3698-1cec-4946-be67-28c8a7778a01 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:21.522241 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c3698-1cec-4946-be67-28c8a7778a01 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:21.524812 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c3698-1cec-4946-be67-28c8a7778a01 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:21.539770 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 299/601] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:46:21.541457 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0625da-8515-441e-8f43-a4f8bc521711 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:21.554281 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0625da-8515-441e-8f43-a4f8bc521711 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:21.561539 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83de65-52d2-47e7-a0a3-80e67cc6370c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:21.562643 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83de65-52d2-47e7-a0a3-80e67cc6370c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:21.563088 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83de65-52d2-47e7-a0a3-80e67cc6370c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:21.563522 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83de65-52d2-47e7-a0a3-80e67cc6370c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:21.575040 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83de65-52d2-47e7-a0a3-80e67cc6370c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:21.577204 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83de65-52d2-47e7-a0a3-80e67cc6370c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:21.600880 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-0a83de65-52d2-47e7-a0a3-80e67cc6370c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:21.602422 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 303/602] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:21.608254 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c3698-1cec-4946-be67-28c8a7778a01 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:21.617714 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c3698-1cec-4946-be67-28c8a7778a01 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:21.622744 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c2c40-2012-42d0-8e3a-b4b3eaae569a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:21.623708 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c2c40-2012-42d0-8e3a-b4b3eaae569a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:21.624151 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c2c40-2012-42d0-8e3a-b4b3eaae569a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:21.624631 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c2c40-2012-42d0-8e3a-b4b3eaae569a admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:21.625632 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c2c40-2012-42d0-8e3a-b4b3eaae569a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:21.626096 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c2c40-2012-42d0-8e3a-b4b3eaae569a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:21.627837 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c2c40-2012-42d0-8e3a-b4b3eaae569a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:21.640968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 300/603] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:21.646887 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83de65-52d2-47e7-a0a3-80e67cc6370c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:21.658062 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83de65-52d2-47e7-a0a3-80e67cc6370c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:21.662859 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307a401-5a96-4a7c-bc46-6aac12942709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:21.663885 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307a401-5a96-4a7c-bc46-6aac12942709 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:21.664414 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307a401-5a96-4a7c-bc46-6aac12942709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:21.664852 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307a401-5a96-4a7c-bc46-6aac12942709 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:21.672596 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307a401-5a96-4a7c-bc46-6aac12942709 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:21.674851 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307a401-5a96-4a7c-bc46-6aac12942709 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:21.688446 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-d307a401-5a96-4a7c-bc46-6aac12942709 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:21.693460 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 304/604] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:21.696260 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c2c40-2012-42d0-8e3a-b4b3eaae569a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:21.706779 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c2c40-2012-42d0-8e3a-b4b3eaae569a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:21.711638 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba74a23-0b65-411b-8727-8342de8c8b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:21.712512 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba74a23-0b65-411b-8727-8342de8c8b30 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:21.712994 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba74a23-0b65-411b-8727-8342de8c8b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:21.713459 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba74a23-0b65-411b-8727-8342de8c8b30 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:21.714497 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba74a23-0b65-411b-8727-8342de8c8b30 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:21.715006 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba74a23-0b65-411b-8727-8342de8c8b30 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:21.716997 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba74a23-0b65-411b-8727-8342de8c8b30 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:21.730438 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 301/605] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:21.735612 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307a401-5a96-4a7c-bc46-6aac12942709 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:21.746548 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307a401-5a96-4a7c-bc46-6aac12942709 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:21.751162 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4ce34-bd07-49a2-98dc-bc32421da085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:21.752028 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4ce34-bd07-49a2-98dc-bc32421da085 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:21.752511 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4ce34-bd07-49a2-98dc-bc32421da085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:21.752965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4ce34-bd07-49a2-98dc-bc32421da085 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:21.753994 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4ce34-bd07-49a2-98dc-bc32421da085 admin admin] RBAC: Adding query filter params (role.id=67325e5669ca4296b3b2c0eb443fda3e, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=6f09689635e54a4e85c0ef0e3539d911) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:21.754491 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4ce34-bd07-49a2-98dc-bc32421da085 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:21.756580 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4ce34-bd07-49a2-98dc-bc32421da085 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:21.769519 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 305/606] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:46:21 2022] GET /identity/v3/role_assignments?user.id=6f09689635e54a4e85c0ef0e3539d911&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=67325e5669ca4296b3b2c0eb443fda3e => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:22.786166 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0067121-d391-477a-a2df-ba1ade8436fd None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:22.786711 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0067121-d391-477a-a2df-ba1ade8436fd None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:22.786711 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0067121-d391-477a-a2df-ba1ade8436fd None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:22.788726 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 302/607] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:22.794271 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907c8e9-c8c2-49e1-bd80-6ad028ff9a99 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:22.794729 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907c8e9-c8c2-49e1-bd80-6ad028ff9a99 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:22.794729 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907c8e9-c8c2-49e1-bd80-6ad028ff9a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:22.814294 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-b907c8e9-c8c2-49e1-bd80-6ad028ff9a99 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:22.815468 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b907c8e9-c8c2-49e1-bd80-6ad028ff9a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:22.828630 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 306/608] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:22.851978 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0067121-d391-477a-a2df-ba1ade8436fd None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:22.865130 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0067121-d391-477a-a2df-ba1ade8436fd None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:22.876801 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cdd6a-4dfe-4b53-b5e5-e35e9b5719a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:22.877710 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cdd6a-4dfe-4b53-b5e5-e35e9b5719a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:22.877990 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cdd6a-4dfe-4b53-b5e5-e35e9b5719a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:22.878254 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cdd6a-4dfe-4b53-b5e5-e35e9b5719a3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:22.898843 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cdd6a-4dfe-4b53-b5e5-e35e9b5719a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:22.905893 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-ea5cdd6a-4dfe-4b53-b5e5-e35e9b5719a3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 20:46:22.912287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 303/609] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:46:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:22.913505 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907c8e9-c8c2-49e1-bd80-6ad028ff9a99 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:22.927267 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907c8e9-c8c2-49e1-bd80-6ad028ff9a99 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:22.942102 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3f823-3cdf-4e31-aafa-e67336f9d8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:22.942806 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3f823-3cdf-4e31-aafa-e67336f9d8df admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:22.943074 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3f823-3cdf-4e31-aafa-e67336f9d8df admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:22.943337 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3f823-3cdf-4e31-aafa-e67336f9d8df admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:22.944107 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3f823-3cdf-4e31-aafa-e67336f9d8df admin admin] RBAC: Adding query filter params (name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:22.944402 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3f823-3cdf-4e31-aafa-e67336f9d8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:22.946053 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3f823-3cdf-4e31-aafa-e67336f9d8df admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:22.960633 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 307/610] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 10 20:46:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:22.965982 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cdd6a-4dfe-4b53-b5e5-e35e9b5719a3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:22.982497 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cdd6a-4dfe-4b53-b5e5-e35e9b5719a3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:22.995177 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711142cf-1db0-4757-9b66-6066072c20c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:22.995973 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711142cf-1db0-4757-9b66-6066072c20c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:22.996307 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711142cf-1db0-4757-9b66-6066072c20c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:22.996578 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711142cf-1db0-4757-9b66-6066072c20c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.016915 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711142cf-1db0-4757-9b66-6066072c20c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:23.018795 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711142cf-1db0-4757-9b66-6066072c20c2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:23.048906 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-711142cf-1db0-4757-9b66-6066072c20c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:23.050347 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 304/611] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:23.057142 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3f823-3cdf-4e31-aafa-e67336f9d8df admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:23.079737 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3f823-3cdf-4e31-aafa-e67336f9d8df admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:23.089493 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca6f24-eb2b-47fe-833e-d00cbe256d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:23.090272 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca6f24-eb2b-47fe-833e-d00cbe256d91 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.090549 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca6f24-eb2b-47fe-833e-d00cbe256d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.090818 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca6f24-eb2b-47fe-833e-d00cbe256d91 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.091552 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca6f24-eb2b-47fe-833e-d00cbe256d91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:23.091848 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca6f24-eb2b-47fe-833e-d00cbe256d91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:23.093466 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca6f24-eb2b-47fe-833e-d00cbe256d91 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:23.111787 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 308/612] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:23.116921 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711142cf-1db0-4757-9b66-6066072c20c2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:23.130758 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711142cf-1db0-4757-9b66-6066072c20c2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:23.145982 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8448d0-fefd-44a0-aa1b-ea0613d1f0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:23.146786 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8448d0-fefd-44a0-aa1b-ea0613d1f0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.147064 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8448d0-fefd-44a0-aa1b-ea0613d1f0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.147330 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8448d0-fefd-44a0-aa1b-ea0613d1f0c5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.157307 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8448d0-fefd-44a0-aa1b-ea0613d1f0c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:23.159330 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8448d0-fefd-44a0-aa1b-ea0613d1f0c5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:23.184969 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-4e8448d0-fefd-44a0-aa1b-ea0613d1f0c5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 20:46:23.186487 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 305/613] 10.222.0.31 () {56 vars in 1114 bytes} [Thu Feb 10 20:46:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:23.191980 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca6f24-eb2b-47fe-833e-d00cbe256d91 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:23.206288 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca6f24-eb2b-47fe-833e-d00cbe256d91 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:23.219039 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bba372-88ab-4426-9f9e-eb01be2ab23b None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.219039 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bba372-88ab-4426-9f9e-eb01be2ab23b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.219408 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5ce6b-3463-41b6-abc6-e7efc97864f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:23.219612 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bba372-88ab-4426-9f9e-eb01be2ab23b None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.219753 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5ce6b-3463-41b6-abc6-e7efc97864f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.219753 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5ce6b-3463-41b6-abc6-e7efc97864f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.219753 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5ce6b-3463-41b6-abc6-e7efc97864f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.220532 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5ce6b-3463-41b6-abc6-e7efc97864f2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:23.220831 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5ce6b-3463-41b6-abc6-e7efc97864f2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:23.223501 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5ce6b-3463-41b6-abc6-e7efc97864f2 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:23.223719 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 306/614] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:46:23.228220 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b01300-fd97-478f-9cbc-5f6b6c36b2c5 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.228750 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b01300-fd97-478f-9cbc-5f6b6c36b2c5 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.229206 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b01300-fd97-478f-9cbc-5f6b6c36b2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.249275 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-95b01300-fd97-478f-9cbc-5f6b6c36b2c5 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:23.250931 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-95b01300-fd97-478f-9cbc-5f6b6c36b2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:23.265282 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 309/616] 10.222.0.31 () {56 vars in 1154 bytes} [Thu Feb 10 20:46:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:23.265679 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 307/616] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:46:23.266497 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5ce6b-3463-41b6-abc6-e7efc97864f2 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:23.285741 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b01300-fd97-478f-9cbc-5f6b6c36b2c5 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:23.287504 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5ce6b-3463-41b6-abc6-e7efc97864f2 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:23.295241 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d8588-353f-420a-bbff-1e550b2a3b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:23.295880 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d8588-353f-420a-bbff-1e550b2a3b70 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.296158 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d8588-353f-420a-bbff-1e550b2a3b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.296423 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d8588-353f-420a-bbff-1e550b2a3b70 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.296886 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b01300-fd97-478f-9cbc-5f6b6c36b2c5 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:23.302212 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d027ade-94f7-4a27-ba1e-f0f808c22bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:23.303222 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d027ade-94f7-4a27-ba1e-f0f808c22bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.303731 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d027ade-94f7-4a27-ba1e-f0f808c22bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.304240 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d027ade-94f7-4a27-ba1e-f0f808c22bf7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.315707 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d027ade-94f7-4a27-ba1e-f0f808c22bf7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:23.318211 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d8588-353f-420a-bbff-1e550b2a3b70 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:23.319979 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d8588-353f-420a-bbff-1e550b2a3b70 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:23.323553 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-6d027ade-94f7-4a27-ba1e-f0f808c22bf7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 20:46:23.329234 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 310/618] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 20:46:23.329581 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 308/618] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:46:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:23.331432 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d8588-353f-420a-bbff-1e550b2a3b70 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:23.335035 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d027ade-94f7-4a27-ba1e-f0f808c22bf7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:23.342804 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d8588-353f-420a-bbff-1e550b2a3b70 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:23.347811 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320b896-90d8-41c0-8d87-fa672b437191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:23.348709 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320b896-90d8-41c0-8d87-fa672b437191 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.349213 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320b896-90d8-41c0-8d87-fa672b437191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.349706 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320b896-90d8-41c0-8d87-fa672b437191 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.351237 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320b896-90d8-41c0-8d87-fa672b437191 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:23.351774 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320b896-90d8-41c0-8d87-fa672b437191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:23.353810 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320b896-90d8-41c0-8d87-fa672b437191 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:23.359114 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d027ade-94f7-4a27-ba1e-f0f808c22bf7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:23.367586 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 311/619] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 10 20:46:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:23.369093 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320b896-90d8-41c0-8d87-fa672b437191 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:23.371179 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02769e-ed43-4e62-bf8b-696e8ec66a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:23.372015 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02769e-ed43-4e62-bf8b-696e8ec66a6f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.372291 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02769e-ed43-4e62-bf8b-696e8ec66a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.372555 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02769e-ed43-4e62-bf8b-696e8ec66a6f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.379984 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320b896-90d8-41c0-8d87-fa672b437191 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:23.385208 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e552e-b050-4710-8b2d-708d4fac039d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:23.386311 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e552e-b050-4710-8b2d-708d4fac039d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.387274 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e552e-b050-4710-8b2d-708d4fac039d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.387778 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e552e-b050-4710-8b2d-708d4fac039d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.395355 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02769e-ed43-4e62-bf8b-696e8ec66a6f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:23.397182 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02769e-ed43-4e62-bf8b-696e8ec66a6f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:23.400148 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e552e-b050-4710-8b2d-708d4fac039d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:23.402243 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e552e-b050-4710-8b2d-708d4fac039d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:23.422728 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-b88e552e-b050-4710-8b2d-708d4fac039d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:23.429150 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-ea02769e-ed43-4e62-bf8b-696e8ec66a6f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:23.429477 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 312/620] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:23.430923 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e552e-b050-4710-8b2d-708d4fac039d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:23.433485 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 309/621] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:23.439430 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02769e-ed43-4e62-bf8b-696e8ec66a6f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:23.453536 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02769e-ed43-4e62-bf8b-696e8ec66a6f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:23.459189 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e552e-b050-4710-8b2d-708d4fac039d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:23.463713 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1075f9-6d35-4a72-8e86-15e6ebc92769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:23.464386 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1075f9-6d35-4a72-8e86-15e6ebc92769 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.464664 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1075f9-6d35-4a72-8e86-15e6ebc92769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.464933 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1075f9-6d35-4a72-8e86-15e6ebc92769 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.465824 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1075f9-6d35-4a72-8e86-15e6ebc92769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:23.466126 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1075f9-6d35-4a72-8e86-15e6ebc92769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:23.467836 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1075f9-6d35-4a72-8e86-15e6ebc92769 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:23.468869 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf3ec3-324f-4e9f-80df-b12e9fc768b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:23.469787 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf3ec3-324f-4e9f-80df-b12e9fc768b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.470295 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf3ec3-324f-4e9f-80df-b12e9fc768b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.470745 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf3ec3-324f-4e9f-80df-b12e9fc768b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.471756 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf3ec3-324f-4e9f-80df-b12e9fc768b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:23.472293 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf3ec3-324f-4e9f-80df-b12e9fc768b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:23.474145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf3ec3-324f-4e9f-80df-b12e9fc768b5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:23.487635 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 310/622] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:23.494014 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf3ec3-324f-4e9f-80df-b12e9fc768b5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:23.496195 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 313/623] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:23.502223 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1075f9-6d35-4a72-8e86-15e6ebc92769 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:23.511764 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf3ec3-324f-4e9f-80df-b12e9fc768b5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:23.516257 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1075f9-6d35-4a72-8e86-15e6ebc92769 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:23.520540 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aaa8f4-06c3-4383-ac46-8850eaf6a1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:23.521334 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaa8f4-06c3-4383-ac46-8850eaf6a1ba admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.521642 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaa8f4-06c3-4383-ac46-8850eaf6a1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.521908 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaa8f4-06c3-4383-ac46-8850eaf6a1ba admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.530654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4666bdb-c19d-42a3-8593-7e76857bf9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:23.531458 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4666bdb-c19d-42a3-8593-7e76857bf9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.531731 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4666bdb-c19d-42a3-8593-7e76857bf9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.532000 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4666bdb-c19d-42a3-8593-7e76857bf9a2 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.533683 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aaa8f4-06c3-4383-ac46-8850eaf6a1ba admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:23.535652 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aaa8f4-06c3-4383-ac46-8850eaf6a1ba admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:23.544451 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4666bdb-c19d-42a3-8593-7e76857bf9a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:23.546484 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4666bdb-c19d-42a3-8593-7e76857bf9a2 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:23.564595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-b4aaa8f4-06c3-4383-ac46-8850eaf6a1ba admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:23.566953 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 311/624] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:23.575377 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aaa8f4-06c3-4383-ac46-8850eaf6a1ba admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:23.575499 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-b4666bdb-c19d-42a3-8593-7e76857bf9a2 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 10 20:46:23.575499 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 314/625] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:23.585545 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4666bdb-c19d-42a3-8593-7e76857bf9a2 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:23.596980 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aaa8f4-06c3-4383-ac46-8850eaf6a1ba admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:23.599972 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4666bdb-c19d-42a3-8593-7e76857bf9a2 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:23.611595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db60ed8-a47f-43ae-825a-56eeacb46889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:23.612536 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e89da6-98ef-4437-9d64-35f97c4dcfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:23.613539 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db60ed8-a47f-43ae-825a-56eeacb46889 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.613818 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db60ed8-a47f-43ae-825a-56eeacb46889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.614085 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db60ed8-a47f-43ae-825a-56eeacb46889 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.614585 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e89da6-98ef-4437-9d64-35f97c4dcfa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.614858 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e89da6-98ef-4437-9d64-35f97c4dcfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.615122 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e89da6-98ef-4437-9d64-35f97c4dcfa7 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.615960 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e89da6-98ef-4437-9d64-35f97c4dcfa7 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:23.616432 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db60ed8-a47f-43ae-825a-56eeacb46889 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:23.616729 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db60ed8-a47f-43ae-825a-56eeacb46889 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:23.617296 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e89da6-98ef-4437-9d64-35f97c4dcfa7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:23.619309 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db60ed8-a47f-43ae-825a-56eeacb46889 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:23.621050 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e89da6-98ef-4437-9d64-35f97c4dcfa7 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:23.645448 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 312/626] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:23.648957 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 315/627] 10.222.0.31 () {56 vars in 1158 bytes} [Thu Feb 10 20:46:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:23.654149 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db60ed8-a47f-43ae-825a-56eeacb46889 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:23.659588 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e89da6-98ef-4437-9d64-35f97c4dcfa7 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:23.668796 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db60ed8-a47f-43ae-825a-56eeacb46889 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:23.676524 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e89da6-98ef-4437-9d64-35f97c4dcfa7 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:23.678666 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb2cda-1457-46f6-a9c9-b798f91679e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:23.679333 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb2cda-1457-46f6-a9c9-b798f91679e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.679660 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb2cda-1457-46f6-a9c9-b798f91679e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.679927 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb2cda-1457-46f6-a9c9-b798f91679e4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.681271 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb2cda-1457-46f6-a9c9-b798f91679e4 admin admin] RBAC: Adding query filter params (role.id=67325e5669ca4296b3b2c0eb443fda3e, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=c0d84b0d7e3d423aa972e58be27c772c) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:23.681616 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb2cda-1457-46f6-a9c9-b798f91679e4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:23.685579 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb2cda-1457-46f6-a9c9-b798f91679e4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:23.689677 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1433e4-90e1-4051-a861-465b1068f184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:23.690343 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1433e4-90e1-4051-a861-465b1068f184 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.690673 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1433e4-90e1-4051-a861-465b1068f184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.691317 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1433e4-90e1-4051-a861-465b1068f184 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.699329 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 313/628] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:46:23 2022] GET /identity/v3/role_assignments?user.id=c0d84b0d7e3d423aa972e58be27c772c&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=67325e5669ca4296b3b2c0eb443fda3e => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:23.704869 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1433e4-90e1-4051-a861-465b1068f184 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:23.706833 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1433e4-90e1-4051-a861-465b1068f184 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:23.721838 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 316/629] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:46:23.723483 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb2cda-1457-46f6-a9c9-b798f91679e4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:23.733368 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb2cda-1457-46f6-a9c9-b798f91679e4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:23.738078 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a269e7-c11b-4628-9db8-8c34d6de18c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:23.738998 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a269e7-c11b-4628-9db8-8c34d6de18c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.739281 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a269e7-c11b-4628-9db8-8c34d6de18c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.739591 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a269e7-c11b-4628-9db8-8c34d6de18c8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.751929 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a269e7-c11b-4628-9db8-8c34d6de18c8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:23.753833 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a269e7-c11b-4628-9db8-8c34d6de18c8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:23.770976 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-43a269e7-c11b-4628-9db8-8c34d6de18c8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:23.772582 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 314/630] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:23.778212 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1433e4-90e1-4051-a861-465b1068f184 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:23.787403 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1433e4-90e1-4051-a861-465b1068f184 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:23.791925 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69c0bf-67b9-448e-a7cb-c60995ddd724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:23.792639 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69c0bf-67b9-448e-a7cb-c60995ddd724 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.792908 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69c0bf-67b9-448e-a7cb-c60995ddd724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.793207 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69c0bf-67b9-448e-a7cb-c60995ddd724 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.793994 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69c0bf-67b9-448e-a7cb-c60995ddd724 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:23.794289 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69c0bf-67b9-448e-a7cb-c60995ddd724 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:23.795893 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69c0bf-67b9-448e-a7cb-c60995ddd724 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:23.817193 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 317/631] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:23.823746 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a269e7-c11b-4628-9db8-8c34d6de18c8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:23.838976 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a269e7-c11b-4628-9db8-8c34d6de18c8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:23.849262 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35675910-dc46-4abf-8318-92f9af2ae90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:23.850116 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35675910-dc46-4abf-8318-92f9af2ae90a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.850390 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35675910-dc46-4abf-8318-92f9af2ae90a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.850656 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35675910-dc46-4abf-8318-92f9af2ae90a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.862770 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35675910-dc46-4abf-8318-92f9af2ae90a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:23.864761 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35675910-dc46-4abf-8318-92f9af2ae90a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:23.885089 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-35675910-dc46-4abf-8318-92f9af2ae90a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:23.886715 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 315/632] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:23.892365 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69c0bf-67b9-448e-a7cb-c60995ddd724 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:23.906969 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69c0bf-67b9-448e-a7cb-c60995ddd724 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:23.915775 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89b380-40ad-4ed2-b733-5b4b27c68878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:23.916507 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89b380-40ad-4ed2-b733-5b4b27c68878 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.916783 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89b380-40ad-4ed2-b733-5b4b27c68878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.917052 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89b380-40ad-4ed2-b733-5b4b27c68878 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.917924 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89b380-40ad-4ed2-b733-5b4b27c68878 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:23.918223 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89b380-40ad-4ed2-b733-5b4b27c68878 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:23.920195 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89b380-40ad-4ed2-b733-5b4b27c68878 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:23.936549 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 318/633] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:23.942987 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35675910-dc46-4abf-8318-92f9af2ae90a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:23.956037 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35675910-dc46-4abf-8318-92f9af2ae90a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:23.960719 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f8c51-6669-43bb-a42d-850294f1caae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:23.961437 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f8c51-6669-43bb-a42d-850294f1caae admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:23.961715 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f8c51-6669-43bb-a42d-850294f1caae admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:23.961988 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f8c51-6669-43bb-a42d-850294f1caae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:23.962884 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f8c51-6669-43bb-a42d-850294f1caae admin admin] RBAC: Adding query filter params (role.id=67325e5669ca4296b3b2c0eb443fda3e, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=ce66e520f6f84eab9e85c81022a0c743) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:23.963169 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f8c51-6669-43bb-a42d-850294f1caae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:23.965120 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f8c51-6669-43bb-a42d-850294f1caae admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:23.972615 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 316/634] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:46:23 2022] GET /identity/v3/role_assignments?user.id=ce66e520f6f84eab9e85c81022a0c743&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=67325e5669ca4296b3b2c0eb443fda3e => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:24.050004 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328c935-713b-45cc-8dd0-7e757ffbd707 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.050286 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328c935-713b-45cc-8dd0-7e757ffbd707 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.050559 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328c935-713b-45cc-8dd0-7e757ffbd707 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.053058 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 319/635] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:24.058897 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ace6c-afcb-4881-b967-faee4b6310d6 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.059268 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ace6c-afcb-4881-b967-faee4b6310d6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.059644 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ace6c-afcb-4881-b967-faee4b6310d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.080975 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-a39ace6c-afcb-4881-b967-faee4b6310d6 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:24.082322 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a39ace6c-afcb-4881-b967-faee4b6310d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:24.093236 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 317/636] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:46:24.116475 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328c935-713b-45cc-8dd0-7e757ffbd707 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.131002 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328c935-713b-45cc-8dd0-7e757ffbd707 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.135690 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613948b-d801-47b9-8734-444c69bd8960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.136671 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613948b-d801-47b9-8734-444c69bd8960 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.137033 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613948b-d801-47b9-8734-444c69bd8960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.137385 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613948b-d801-47b9-8734-444c69bd8960 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.149741 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613948b-d801-47b9-8734-444c69bd8960 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:24.158547 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-a613948b-d801-47b9-8734-444c69bd8960 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 20:46:24.158844 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 320/637] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:24.164726 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ace6c-afcb-4881-b967-faee4b6310d6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.175300 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ace6c-afcb-4881-b967-faee4b6310d6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.180310 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe372293-aa7f-4ec6-8f3b-a99d4ff233ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.181056 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe372293-aa7f-4ec6-8f3b-a99d4ff233ab admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.181408 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe372293-aa7f-4ec6-8f3b-a99d4ff233ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.181746 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe372293-aa7f-4ec6-8f3b-a99d4ff233ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.182622 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe372293-aa7f-4ec6-8f3b-a99d4ff233ab admin admin] RBAC: Adding query filter params (name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:24.183000 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe372293-aa7f-4ec6-8f3b-a99d4ff233ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.184753 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe372293-aa7f-4ec6-8f3b-a99d4ff233ab admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.193969 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 318/638] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:24.199542 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613948b-d801-47b9-8734-444c69bd8960 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.210107 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613948b-d801-47b9-8734-444c69bd8960 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.214684 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b9786-a5a6-45b4-833c-d8c4c9b09d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.215594 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b9786-a5a6-45b4-833c-d8c4c9b09d91 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.215984 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b9786-a5a6-45b4-833c-d8c4c9b09d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.216325 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b9786-a5a6-45b4-833c-d8c4c9b09d91 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.229149 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b9786-a5a6-45b4-833c-d8c4c9b09d91 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.231682 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b9786-a5a6-45b4-833c-d8c4c9b09d91 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.251465 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-227b9786-a5a6-45b4-833c-d8c4c9b09d91 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:24.253173 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 321/639] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:24.258678 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe372293-aa7f-4ec6-8f3b-a99d4ff233ab admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.268852 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe372293-aa7f-4ec6-8f3b-a99d4ff233ab admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.271445 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df5127-22d4-444c-91b7-4db01a656241 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.271959 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df5127-22d4-444c-91b7-4db01a656241 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.272458 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df5127-22d4-444c-91b7-4db01a656241 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.274954 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 322/640] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:24.277872 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f307513-f3a0-42f0-824a-5e731400e233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.278575 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f307513-f3a0-42f0-824a-5e731400e233 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.278850 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f307513-f3a0-42f0-824a-5e731400e233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.279373 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f307513-f3a0-42f0-824a-5e731400e233 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.280118 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f307513-f3a0-42f0-824a-5e731400e233 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:24.280415 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f307513-f3a0-42f0-824a-5e731400e233 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.281080 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d516b7-a95d-4c2a-acc3-f163cbdf9442 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.281548 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d516b7-a95d-4c2a-acc3-f163cbdf9442 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.281999 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d516b7-a95d-4c2a-acc3-f163cbdf9442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.286218 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f307513-f3a0-42f0-824a-5e731400e233 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.302957 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 319/641] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:24.303528 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-d8d516b7-a95d-4c2a-acc3-f163cbdf9442 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:24.304919 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d8d516b7-a95d-4c2a-acc3-f163cbdf9442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:24.308353 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f307513-f3a0-42f0-824a-5e731400e233 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.314016 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 323/642] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:46:24.322572 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f307513-f3a0-42f0-824a-5e731400e233 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.327533 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62fbc9-42ed-4a4b-bd60-b8b001ea01de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.328546 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62fbc9-42ed-4a4b-bd60-b8b001ea01de admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.329073 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62fbc9-42ed-4a4b-bd60-b8b001ea01de admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.329552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62fbc9-42ed-4a4b-bd60-b8b001ea01de admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.337165 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d516b7-a95d-4c2a-acc3-f163cbdf9442 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.338236 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62fbc9-42ed-4a4b-bd60-b8b001ea01de admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.340456 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62fbc9-42ed-4a4b-bd60-b8b001ea01de admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.346192 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d516b7-a95d-4c2a-acc3-f163cbdf9442 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.350804 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7fd9d-028d-4c5c-a707-66c1c650dc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.351642 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7fd9d-028d-4c5c-a707-66c1c650dc92 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.351917 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7fd9d-028d-4c5c-a707-66c1c650dc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.352187 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7fd9d-028d-4c5c-a707-66c1c650dc92 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.356785 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-0d62fbc9-42ed-4a4b-bd60-b8b001ea01de admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 10 20:46:24.358569 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 320/643] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:24.365385 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7fd9d-028d-4c5c-a707-66c1c650dc92 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:24.366549 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62fbc9-42ed-4a4b-bd60-b8b001ea01de admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.370853 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-c2d7fd9d-028d-4c5c-a707-66c1c650dc92 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 20:46:24.372480 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 324/644] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:24.377384 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62fbc9-42ed-4a4b-bd60-b8b001ea01de admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.378085 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7fd9d-028d-4c5c-a707-66c1c650dc92 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.388849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a75cc-2bba-452f-8a69-09cf5ec98623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.389600 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a75cc-2bba-452f-8a69-09cf5ec98623 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.389880 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a75cc-2bba-452f-8a69-09cf5ec98623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.390148 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a75cc-2bba-452f-8a69-09cf5ec98623 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.391056 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a75cc-2bba-452f-8a69-09cf5ec98623 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:24.391357 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a75cc-2bba-452f-8a69-09cf5ec98623 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.395070 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7fd9d-028d-4c5c-a707-66c1c650dc92 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.397675 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a75cc-2bba-452f-8a69-09cf5ec98623 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.399685 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f345fc-883f-44b6-89af-2ffe474af01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.400432 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f345fc-883f-44b6-89af-2ffe474af01d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.400707 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f345fc-883f-44b6-89af-2ffe474af01d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.400977 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f345fc-883f-44b6-89af-2ffe474af01d admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.401830 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f345fc-883f-44b6-89af-2ffe474af01d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:24.402125 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f345fc-883f-44b6-89af-2ffe474af01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.403962 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f345fc-883f-44b6-89af-2ffe474af01d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.413636 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 325/645] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:24.419302 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f345fc-883f-44b6-89af-2ffe474af01d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.429561 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f345fc-883f-44b6-89af-2ffe474af01d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.434205 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a07bf5-cc9e-4454-a4fc-dca48bd298d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.435105 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a07bf5-cc9e-4454-a4fc-dca48bd298d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.435384 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a07bf5-cc9e-4454-a4fc-dca48bd298d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.435740 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a07bf5-cc9e-4454-a4fc-dca48bd298d5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.440977 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 321/646] 10.222.0.31 () {56 vars in 1158 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:24.446337 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a75cc-2bba-452f-8a69-09cf5ec98623 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.446904 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a07bf5-cc9e-4454-a4fc-dca48bd298d5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.448801 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a07bf5-cc9e-4454-a4fc-dca48bd298d5 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.466502 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-c8a07bf5-cc9e-4454-a4fc-dca48bd298d5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:24.467852 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a75cc-2bba-452f-8a69-09cf5ec98623 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.468027 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 326/647] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:24.473397 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a07bf5-cc9e-4454-a4fc-dca48bd298d5 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.483008 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347382ef-bfd7-41a9-9837-c30f5c5304ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.483691 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347382ef-bfd7-41a9-9837-c30f5c5304ca admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.483882 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a07bf5-cc9e-4454-a4fc-dca48bd298d5 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.484129 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347382ef-bfd7-41a9-9837-c30f5c5304ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.484327 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347382ef-bfd7-41a9-9837-c30f5c5304ca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.498125 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5685db9-adaf-45fd-8998-9678decd63d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.498855 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5685db9-adaf-45fd-8998-9678decd63d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.499138 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5685db9-adaf-45fd-8998-9678decd63d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.499412 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5685db9-adaf-45fd-8998-9678decd63d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.501380 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5685db9-adaf-45fd-8998-9678decd63d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:24.502844 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5685db9-adaf-45fd-8998-9678decd63d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.504711 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5685db9-adaf-45fd-8998-9678decd63d5 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.505573 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347382ef-bfd7-41a9-9837-c30f5c5304ca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.509125 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347382ef-bfd7-41a9-9837-c30f5c5304ca admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.529779 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 327/648] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:24.534687 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5685db9-adaf-45fd-8998-9678decd63d5 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.536684 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 322/649] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 20:46:24.546461 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5685db9-adaf-45fd-8998-9678decd63d5 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.546843 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347382ef-bfd7-41a9-9837-c30f5c5304ca admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.558026 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347382ef-bfd7-41a9-9837-c30f5c5304ca admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.559975 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3a711-cc15-4efa-9fa2-cc5ec0951103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.560804 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3a711-cc15-4efa-9fa2-cc5ec0951103 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.561076 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3a711-cc15-4efa-9fa2-cc5ec0951103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.561338 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3a711-cc15-4efa-9fa2-cc5ec0951103 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.570923 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3a711-cc15-4efa-9fa2-cc5ec0951103 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.571314 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438e44c-1167-4502-9ab9-41acba3ebfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.572336 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438e44c-1167-4502-9ab9-41acba3ebfbc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.572851 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438e44c-1167-4502-9ab9-41acba3ebfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.572952 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3a711-cc15-4efa-9fa2-cc5ec0951103 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.573407 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438e44c-1167-4502-9ab9-41acba3ebfbc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.584066 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438e44c-1167-4502-9ab9-41acba3ebfbc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.586228 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438e44c-1167-4502-9ab9-41acba3ebfbc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.588612 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-21d3a711-cc15-4efa-9fa2-cc5ec0951103 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 10 20:46:24.590452 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 328/650] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:24.591855 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457f6df-89bd-4304-813d-e11dc5c0b825 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.592195 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457f6df-89bd-4304-813d-e11dc5c0b825 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.592525 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457f6df-89bd-4304-813d-e11dc5c0b825 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.594502 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 329/651] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:24.597471 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457f6df-89bd-4304-813d-e11dc5c0b825 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.610839 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457f6df-89bd-4304-813d-e11dc5c0b825 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.611287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-9438e44c-1167-4502-9ab9-41acba3ebfbc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:24.613130 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 323/652] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:24.617498 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a532bc9-e7af-432f-b130-a6b5c09e01ea None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.617498 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a532bc9-e7af-432f-b130-a6b5c09e01ea None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.617498 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a532bc9-e7af-432f-b130-a6b5c09e01ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.621806 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855fe13-a6cd-4380-aba2-c53c9fad5873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.623162 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855fe13-a6cd-4380-aba2-c53c9fad5873 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.624307 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855fe13-a6cd-4380-aba2-c53c9fad5873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.625511 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855fe13-a6cd-4380-aba2-c53c9fad5873 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.627049 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855fe13-a6cd-4380-aba2-c53c9fad5873 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:24.627935 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855fe13-a6cd-4380-aba2-c53c9fad5873 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.630343 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855fe13-a6cd-4380-aba2-c53c9fad5873 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.640292 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-0a532bc9-e7af-432f-b130-a6b5c09e01ea None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:24.641660 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0a532bc9-e7af-432f-b130-a6b5c09e01ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:24.649263 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 330/653] 10.222.0.31 () {56 vars in 1160 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:24.649863 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 324/654] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:24.653768 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855fe13-a6cd-4380-aba2-c53c9fad5873 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.654766 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a532bc9-e7af-432f-b130-a6b5c09e01ea None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.668169 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a532bc9-e7af-432f-b130-a6b5c09e01ea None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.671061 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855fe13-a6cd-4380-aba2-c53c9fad5873 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.677289 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44add46-2edc-4369-946b-0e8277d7c98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.678278 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770edbc2-2580-4b13-9c46-5272ca16fb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.678926 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770edbc2-2580-4b13-9c46-5272ca16fb96 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.679205 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770edbc2-2580-4b13-9c46-5272ca16fb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.679472 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770edbc2-2580-4b13-9c46-5272ca16fb96 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.680199 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770edbc2-2580-4b13-9c46-5272ca16fb96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:24.680496 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770edbc2-2580-4b13-9c46-5272ca16fb96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.682010 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44add46-2edc-4369-946b-0e8277d7c98e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.682178 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770edbc2-2580-4b13-9c46-5272ca16fb96 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.682627 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44add46-2edc-4369-946b-0e8277d7c98e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.683158 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44add46-2edc-4369-946b-0e8277d7c98e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.691865 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44add46-2edc-4369-946b-0e8277d7c98e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.693891 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44add46-2edc-4369-946b-0e8277d7c98e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.693997 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 331/655] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:24.694794 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770edbc2-2580-4b13-9c46-5272ca16fb96 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.704233 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 325/656] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:46:24.705266 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44add46-2edc-4369-946b-0e8277d7c98e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.712348 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770edbc2-2580-4b13-9c46-5272ca16fb96 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.714870 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44add46-2edc-4369-946b-0e8277d7c98e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.716859 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c57fe-500e-468c-9146-893897fdf52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.717652 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c57fe-500e-468c-9146-893897fdf52e admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.717942 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c57fe-500e-468c-9146-893897fdf52e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.718197 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c57fe-500e-468c-9146-893897fdf52e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.722431 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1ceef-59d8-42a8-b1c8-85e00ddf4efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.723184 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1ceef-59d8-42a8-b1c8-85e00ddf4efd admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.723454 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1ceef-59d8-42a8-b1c8-85e00ddf4efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.723712 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1ceef-59d8-42a8-b1c8-85e00ddf4efd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.730246 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c57fe-500e-468c-9146-893897fdf52e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:24.730590 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1ceef-59d8-42a8-b1c8-85e00ddf4efd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.732818 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1ceef-59d8-42a8-b1c8-85e00ddf4efd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.738405 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-2a7c57fe-500e-468c-9146-893897fdf52e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 20:46:24.744672 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 332/657] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:24.745724 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c57fe-500e-468c-9146-893897fdf52e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.745992 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-bbd1ceef-59d8-42a8-b1c8-85e00ddf4efd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:24.747365 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 326/658] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:24.752609 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1ceef-59d8-42a8-b1c8-85e00ddf4efd admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.757935 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c57fe-500e-468c-9146-893897fdf52e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.762261 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1ceef-59d8-42a8-b1c8-85e00ddf4efd admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.762889 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeb94e-e7c1-4a37-b53c-bbd8ccdb6b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.764129 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeb94e-e7c1-4a37-b53c-bbd8ccdb6b1c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.764716 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeb94e-e7c1-4a37-b53c-bbd8ccdb6b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.765272 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeb94e-e7c1-4a37-b53c-bbd8ccdb6b1c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.768341 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62adbca-3086-42b4-a7af-5e4af8b28e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.768957 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62adbca-3086-42b4-a7af-5e4af8b28e87 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.769229 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62adbca-3086-42b4-a7af-5e4af8b28e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.769533 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62adbca-3086-42b4-a7af-5e4af8b28e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.770269 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62adbca-3086-42b4-a7af-5e4af8b28e87 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:24.770563 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62adbca-3086-42b4-a7af-5e4af8b28e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.772115 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62adbca-3086-42b4-a7af-5e4af8b28e87 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.784540 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 327/659] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:24.784540 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62adbca-3086-42b4-a7af-5e4af8b28e87 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.787387 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaeb94e-e7c1-4a37-b53c-bbd8ccdb6b1c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.789893 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaeb94e-e7c1-4a37-b53c-bbd8ccdb6b1c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.793976 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62adbca-3086-42b4-a7af-5e4af8b28e87 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.798586 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834be81-a799-4171-9212-7798f5e4657f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.799253 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834be81-a799-4171-9212-7798f5e4657f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.799528 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834be81-a799-4171-9212-7798f5e4657f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.799804 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834be81-a799-4171-9212-7798f5e4657f admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.800560 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834be81-a799-4171-9212-7798f5e4657f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:24.800859 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834be81-a799-4171-9212-7798f5e4657f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.803128 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834be81-a799-4171-9212-7798f5e4657f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.813150 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-caaeb94e-e7c1-4a37-b53c-bbd8ccdb6b1c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:24.815253 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 333/661] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:24.816300 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeb94e-e7c1-4a37-b53c-bbd8ccdb6b1c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.821536 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 328/661] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:24.822584 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834be81-a799-4171-9212-7798f5e4657f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.827637 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeb94e-e7c1-4a37-b53c-bbd8ccdb6b1c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.835094 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834be81-a799-4171-9212-7798f5e4657f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.836982 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c9557-1ec1-4fb3-aa09-e514f6961eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.837796 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c9557-1ec1-4fb3-aa09-e514f6961eab admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.838072 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c9557-1ec1-4fb3-aa09-e514f6961eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.838337 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c9557-1ec1-4fb3-aa09-e514f6961eab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.843592 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470169d4-a074-4e0d-984c-8ea665b6a566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.844182 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470169d4-a074-4e0d-984c-8ea665b6a566 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.844455 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470169d4-a074-4e0d-984c-8ea665b6a566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.844720 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470169d4-a074-4e0d-984c-8ea665b6a566 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.845461 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470169d4-a074-4e0d-984c-8ea665b6a566 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:24.845767 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470169d4-a074-4e0d-984c-8ea665b6a566 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.847332 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470169d4-a074-4e0d-984c-8ea665b6a566 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.852964 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c9557-1ec1-4fb3-aa09-e514f6961eab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.855668 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c9557-1ec1-4fb3-aa09-e514f6961eab admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.863276 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 329/662] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:24.863276 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470169d4-a074-4e0d-984c-8ea665b6a566 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.879740 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470169d4-a074-4e0d-984c-8ea665b6a566 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.880554 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-691c9557-1ec1-4fb3-aa09-e514f6961eab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:24.881767 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 334/663] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:24.882530 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c9557-1ec1-4fb3-aa09-e514f6961eab admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.885486 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef8fa2-1d6d-43b3-9774-b98790f2427f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.886388 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef8fa2-1d6d-43b3-9774-b98790f2427f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.886902 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef8fa2-1d6d-43b3-9774-b98790f2427f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.887592 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef8fa2-1d6d-43b3-9774-b98790f2427f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.889803 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef8fa2-1d6d-43b3-9774-b98790f2427f admin admin] RBAC: Adding query filter params (role.id=67325e5669ca4296b3b2c0eb443fda3e, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=256860d94eb142c6b2175ae89f977e4a) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:24.890882 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef8fa2-1d6d-43b3-9774-b98790f2427f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.893019 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c9557-1ec1-4fb3-aa09-e514f6961eab admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.893606 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef8fa2-1d6d-43b3-9774-b98790f2427f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.899554 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0a35d-7c8d-4b8d-b832-41e633174e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.900761 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0a35d-7c8d-4b8d-b832-41e633174e78 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.901102 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0a35d-7c8d-4b8d-b832-41e633174e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.901565 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0a35d-7c8d-4b8d-b832-41e633174e78 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.903587 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 330/664] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/role_assignments?user.id=256860d94eb142c6b2175ae89f977e4a&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=67325e5669ca4296b3b2c0eb443fda3e => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:24.904775 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef8fa2-1d6d-43b3-9774-b98790f2427f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.915299 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef8fa2-1d6d-43b3-9774-b98790f2427f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.918421 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0a35d-7c8d-4b8d-b832-41e633174e78 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.920567 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4b151-298f-4f3b-95cf-91ed8a0808f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.920690 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0a35d-7c8d-4b8d-b832-41e633174e78 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.921693 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b151-298f-4f3b-95cf-91ed8a0808f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.922175 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b151-298f-4f3b-95cf-91ed8a0808f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.922642 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b151-298f-4f3b-95cf-91ed8a0808f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.923596 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4b151-298f-4f3b-95cf-91ed8a0808f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:24.924098 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4b151-298f-4f3b-95cf-91ed8a0808f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.926228 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4b151-298f-4f3b-95cf-91ed8a0808f0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.940383 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 331/665] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:24.947200 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-1ca0a35d-7c8d-4b8d-b832-41e633174e78 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:24.947200 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 335/666] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:24.948631 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4b151-298f-4f3b-95cf-91ed8a0808f0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.952764 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0a35d-7c8d-4b8d-b832-41e633174e78 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:24.969375 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4b151-298f-4f3b-95cf-91ed8a0808f0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.974066 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0a35d-7c8d-4b8d-b832-41e633174e78 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:24.978029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf07848-bb4b-415d-959b-130366becf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.978896 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf07848-bb4b-415d-959b-130366becf03 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.979172 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf07848-bb4b-415d-959b-130366becf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.980006 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf07848-bb4b-415d-959b-130366becf03 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.985331 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345962f-a947-431a-878f-620f22c39869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:24.986087 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345962f-a947-431a-878f-620f22c39869 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:24.986359 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345962f-a947-431a-878f-620f22c39869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:24.986624 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345962f-a947-431a-878f-620f22c39869 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:24.989249 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345962f-a947-431a-878f-620f22c39869 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:24.989579 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345962f-a947-431a-878f-620f22c39869 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:24.993742 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345962f-a947-431a-878f-620f22c39869 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:24.997658 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf07848-bb4b-415d-959b-130366becf03 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:25.000593 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf07848-bb4b-415d-959b-130366becf03 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:25.024282 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-2cf07848-bb4b-415d-959b-130366becf03 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 10 20:46:25.025636 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 332/667] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:25.025929 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 336/668] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:25.030553 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf07848-bb4b-415d-959b-130366becf03 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:25.034426 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345962f-a947-431a-878f-620f22c39869 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:25.040656 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf07848-bb4b-415d-959b-130366becf03 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:25.045440 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8466a-9802-4c61-ae02-f5c6bea5018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:25.046156 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8466a-9802-4c61-ae02-f5c6bea5018e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:25.046431 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8466a-9802-4c61-ae02-f5c6bea5018e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:25.046694 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8466a-9802-4c61-ae02-f5c6bea5018e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:25.047583 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8466a-9802-4c61-ae02-f5c6bea5018e admin admin] RBAC: Adding query filter params (role.id=67325e5669ca4296b3b2c0eb443fda3e, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=b07a9ae7262b44ce88e1338c83360356) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:25.047891 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8466a-9802-4c61-ae02-f5c6bea5018e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:25.049841 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8466a-9802-4c61-ae02-f5c6bea5018e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:25.055906 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345962f-a947-431a-878f-620f22c39869 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:25.057165 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 333/669] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:46:25 2022] GET /identity/v3/role_assignments?user.id=b07a9ae7262b44ce88e1338c83360356&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=67325e5669ca4296b3b2c0eb443fda3e => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:25.072432 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f318d-ffab-4518-aacb-201de101f7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:25.073146 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f318d-ffab-4518-aacb-201de101f7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:25.073451 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f318d-ffab-4518-aacb-201de101f7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:25.073728 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f318d-ffab-4518-aacb-201de101f7f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:25.074622 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f318d-ffab-4518-aacb-201de101f7f4 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:25.074931 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f318d-ffab-4518-aacb-201de101f7f4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:25.076945 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f318d-ffab-4518-aacb-201de101f7f4 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:25.113455 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 337/670] 10.222.0.31 () {56 vars in 1156 bytes} [Thu Feb 10 20:46:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:25.119084 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8466a-9802-4c61-ae02-f5c6bea5018e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:25.136207 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8466a-9802-4c61-ae02-f5c6bea5018e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:25.144699 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d97fb-ba5e-402d-9251-5e47c4e87364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:25.145899 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d97fb-ba5e-402d-9251-5e47c4e87364 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:25.146374 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d97fb-ba5e-402d-9251-5e47c4e87364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:25.146830 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d97fb-ba5e-402d-9251-5e47c4e87364 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:25.162359 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d97fb-ba5e-402d-9251-5e47c4e87364 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:25.164590 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d97fb-ba5e-402d-9251-5e47c4e87364 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:25.183945 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-dd8d97fb-ba5e-402d-9251-5e47c4e87364 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:25.186016 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 334/671] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:25.191488 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f318d-ffab-4518-aacb-201de101f7f4 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:25.201585 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f318d-ffab-4518-aacb-201de101f7f4 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:25.206066 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1601e87-4f41-4e50-85ac-301c5e9e7ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:25.206745 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1601e87-4f41-4e50-85ac-301c5e9e7ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:25.207016 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1601e87-4f41-4e50-85ac-301c5e9e7ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:25.207278 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1601e87-4f41-4e50-85ac-301c5e9e7ba4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:25.208017 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1601e87-4f41-4e50-85ac-301c5e9e7ba4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:25.208310 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1601e87-4f41-4e50-85ac-301c5e9e7ba4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:25.209985 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1601e87-4f41-4e50-85ac-301c5e9e7ba4 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:25.227422 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 338/672] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:25.228842 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d97fb-ba5e-402d-9251-5e47c4e87364 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:25.242970 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d97fb-ba5e-402d-9251-5e47c4e87364 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:25.247814 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b030c-0f0c-4000-9f50-f2b377a40c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:25.248829 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b030c-0f0c-4000-9f50-f2b377a40c43 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:25.249197 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b030c-0f0c-4000-9f50-f2b377a40c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:25.249606 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b030c-0f0c-4000-9f50-f2b377a40c43 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:25.257759 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b030c-0f0c-4000-9f50-f2b377a40c43 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:25.259869 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b030c-0f0c-4000-9f50-f2b377a40c43 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:25.275128 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-a59b030c-0f0c-4000-9f50-f2b377a40c43 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:25.276773 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 335/673] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:25.282452 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1601e87-4f41-4e50-85ac-301c5e9e7ba4 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:25.294787 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1601e87-4f41-4e50-85ac-301c5e9e7ba4 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:25.301558 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6eff7b-3009-4366-ab8f-e14ea27dcadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:25.302250 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6eff7b-3009-4366-ab8f-e14ea27dcadf admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:25.302574 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6eff7b-3009-4366-ab8f-e14ea27dcadf admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:25.302846 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6eff7b-3009-4366-ab8f-e14ea27dcadf admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:25.304114 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6eff7b-3009-4366-ab8f-e14ea27dcadf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:25.304418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6eff7b-3009-4366-ab8f-e14ea27dcadf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:25.306688 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6eff7b-3009-4366-ab8f-e14ea27dcadf admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:25.321649 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 339/674] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:25.327624 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b030c-0f0c-4000-9f50-f2b377a40c43 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:25.339538 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b030c-0f0c-4000-9f50-f2b377a40c43 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:25.348959 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd61b0-bfc8-450c-b7ec-36303607f345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:25.350058 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd61b0-bfc8-450c-b7ec-36303607f345 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:25.350470 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd61b0-bfc8-450c-b7ec-36303607f345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:25.350894 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd61b0-bfc8-450c-b7ec-36303607f345 admin admin] PATH_INFO: `/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/6f09689635e54a4e85c0ef0e3539d911/roles/67325e5669ca4296b3b2c0eb443fda3e` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:25.370454 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd61b0-bfc8-450c-b7ec-36303607f345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f35ac6d668442a9ea0347f99eb2881, user_id=6f09689635e54a4e85c0ef0e3539d911, role_id=67325e5669ca4296b3b2c0eb443fda3e)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:25.373390 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd61b0-bfc8-450c-b7ec-36303607f345 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:25.392451 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 336/675] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:46:25 2022] PUT /identity/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/6f09689635e54a4e85c0ef0e3539d911/roles/67325e5669ca4296b3b2c0eb443fda3e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:46:26.584765 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef40f53-55d6-417c-893f-f2eabfb2fcf7 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:26.585305 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef40f53-55d6-417c-893f-f2eabfb2fcf7 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:26.585305 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef40f53-55d6-417c-893f-f2eabfb2fcf7 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:26.587277 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 340/676] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:26.592845 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9eb3a-ee05-460f-88a2-7c1635b15525 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:26.593278 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9eb3a-ee05-460f-88a2-7c1635b15525 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:26.593461 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9eb3a-ee05-460f-88a2-7c1635b15525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:26.622414 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-d7f9eb3a-ee05-460f-88a2-7c1635b15525 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:26.623641 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d7f9eb3a-ee05-460f-88a2-7c1635b15525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:26.695576 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 337/677] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:26.726888 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef40f53-55d6-417c-893f-f2eabfb2fcf7 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:26.744092 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef40f53-55d6-417c-893f-f2eabfb2fcf7 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:26.751700 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f4872-dea4-4412-b336-124169d0f6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:26.752564 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f4872-dea4-4412-b336-124169d0f6ce admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:26.752843 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f4872-dea4-4412-b336-124169d0f6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:26.753109 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f4872-dea4-4412-b336-124169d0f6ce admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:26.753792 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f4872-dea4-4412-b336-124169d0f6ce admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:26.754859 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING py.warnings [None req-e11f4872-dea4-4412-b336-124169d0f6ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:46:26.754859 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: warnings.warn(msg) Feb 10 20:46:26.754859 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: Feb 10 20:46:26.755718 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f4872-dea4-4412-b336-124169d0f6ce admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:26.761521 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91898c52-ec80-4481-9a8d-095701e4b7d9 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:26.762031 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91898c52-ec80-4481-9a8d-095701e4b7d9 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:26.762489 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91898c52-ec80-4481-9a8d-095701e4b7d9 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:26.764736 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 338/678] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:46:26.769527 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d409c-a62d-45e8-bbba-4cc632e75ba7 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:26.769809 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d409c-a62d-45e8-bbba-4cc632e75ba7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:26.770087 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d409c-a62d-45e8-bbba-4cc632e75ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:26.770591 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-e11f4872-dea4-4412-b336-124169d0f6ce admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 10 20:46:26.772010 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 341/679] 10.222.0.31 () {56 vars in 1150 bytes} [Thu Feb 10 20:46:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:26.777503 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f4872-dea4-4412-b336-124169d0f6ce admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:26.790275 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f4872-dea4-4412-b336-124169d0f6ce admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:26.794920 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f1af6-cf5d-4fe4-9957-77729adebc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:26.795604 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f1af6-cf5d-4fe4-9957-77729adebc8e admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:26.795975 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f1af6-cf5d-4fe4-9957-77729adebc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:26.796400 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f1af6-cf5d-4fe4-9957-77729adebc8e admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:26.797211 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f1af6-cf5d-4fe4-9957-77729adebc8e admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:26.797680 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f1af6-cf5d-4fe4-9957-77729adebc8e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:26.798332 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ac9d409c-a62d-45e8-bbba-4cc632e75ba7 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:26.798863 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING py.warnings [None req-1d6f1af6-cf5d-4fe4-9957-77729adebc8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:46:26.798863 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: warnings.warn(msg) Feb 10 20:46:26.798863 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: Feb 10 20:46:26.799522 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ac9d409c-a62d-45e8-bbba-4cc632e75ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:26.800107 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f1af6-cf5d-4fe4-9957-77729adebc8e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:26.805583 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 342/680] 10.222.0.31 () {56 vars in 1145 bytes} [Thu Feb 10 20:46:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:26.810708 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f1af6-cf5d-4fe4-9957-77729adebc8e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:26.819874 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 339/681] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:46:26.831170 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f1af6-cf5d-4fe4-9957-77729adebc8e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:26.841792 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1d2a5-1e02-46b1-8dc6-46ed64562752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:26.842611 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1d2a5-1e02-46b1-8dc6-46ed64562752 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:26.843166 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1d2a5-1e02-46b1-8dc6-46ed64562752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:26.843548 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1d2a5-1e02-46b1-8dc6-46ed64562752 admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:26.844366 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1d2a5-1e02-46b1-8dc6-46ed64562752 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:26.844786 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1d2a5-1e02-46b1-8dc6-46ed64562752 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:26.846568 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1d2a5-1e02-46b1-8dc6-46ed64562752 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:26.853170 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 343/682] 10.222.0.31 () {56 vars in 1145 bytes} [Thu Feb 10 20:46:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:26.863304 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d409c-a62d-45e8-bbba-4cc632e75ba7 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:26.880315 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d409c-a62d-45e8-bbba-4cc632e75ba7 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:26.889924 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74793282-6135-42a7-b90b-f7ed51bb76df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:26.890921 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74793282-6135-42a7-b90b-f7ed51bb76df admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:26.891289 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74793282-6135-42a7-b90b-f7ed51bb76df admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:26.891646 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74793282-6135-42a7-b90b-f7ed51bb76df admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:26.914657 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74793282-6135-42a7-b90b-f7ed51bb76df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:26.922849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-74793282-6135-42a7-b90b-f7ed51bb76df admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:46:26.924650 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 340/683] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:46:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:26.931211 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1d2a5-1e02-46b1-8dc6-46ed64562752 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:26.942527 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1d2a5-1e02-46b1-8dc6-46ed64562752 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:26.951088 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7db969-e877-4248-b8f0-a2e8d6304ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:26.951777 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7db969-e877-4248-b8f0-a2e8d6304ccd admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:26.952099 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7db969-e877-4248-b8f0-a2e8d6304ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:26.952367 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7db969-e877-4248-b8f0-a2e8d6304ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:26.953326 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7db969-e877-4248-b8f0-a2e8d6304ccd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:26.953693 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7db969-e877-4248-b8f0-a2e8d6304ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:26.955376 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7db969-e877-4248-b8f0-a2e8d6304ccd admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:26.970151 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 344/684] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:26.975808 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74793282-6135-42a7-b90b-f7ed51bb76df admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:26.990637 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74793282-6135-42a7-b90b-f7ed51bb76df admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:27.001711 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261df0b-e155-4164-9471-5fb490d58c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:27.002676 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261df0b-e155-4164-9471-5fb490d58c02 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:27.003044 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261df0b-e155-4164-9471-5fb490d58c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:27.003405 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261df0b-e155-4164-9471-5fb490d58c02 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:27.019055 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261df0b-e155-4164-9471-5fb490d58c02 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:27.021076 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261df0b-e155-4164-9471-5fb490d58c02 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:27.046114 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-a261df0b-e155-4164-9471-5fb490d58c02 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:27.047839 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 341/685] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:27.053380 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7db969-e877-4248-b8f0-a2e8d6304ccd admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:27.066982 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7db969-e877-4248-b8f0-a2e8d6304ccd admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:27.073555 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69057fff-bba6-401f-8eff-0f22ca19169d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:27.074322 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69057fff-bba6-401f-8eff-0f22ca19169d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:27.074691 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69057fff-bba6-401f-8eff-0f22ca19169d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:27.075049 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69057fff-bba6-401f-8eff-0f22ca19169d admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:27.075882 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69057fff-bba6-401f-8eff-0f22ca19169d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:27.076273 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69057fff-bba6-401f-8eff-0f22ca19169d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:27.078118 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69057fff-bba6-401f-8eff-0f22ca19169d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:27.090380 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 345/686] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:27.095902 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261df0b-e155-4164-9471-5fb490d58c02 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:27.106406 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261df0b-e155-4164-9471-5fb490d58c02 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:27.112317 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643b2c0-a4f5-4444-97d4-f44c474e9f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:27.113215 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643b2c0-a4f5-4444-97d4-f44c474e9f81 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:27.113664 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643b2c0-a4f5-4444-97d4-f44c474e9f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:27.114029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643b2c0-a4f5-4444-97d4-f44c474e9f81 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:27.125789 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643b2c0-a4f5-4444-97d4-f44c474e9f81 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:27.127894 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643b2c0-a4f5-4444-97d4-f44c474e9f81 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:27.143304 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-4643b2c0-a4f5-4444-97d4-f44c474e9f81 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 20:46:27.144824 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 342/687] 10.222.0.31 () {56 vars in 1114 bytes} [Thu Feb 10 20:46:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:27.150180 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69057fff-bba6-401f-8eff-0f22ca19169d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:27.162393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69057fff-bba6-401f-8eff-0f22ca19169d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:27.173973 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c01f0-f5a4-4b05-b49b-8ea906cc1a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:27.174743 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c01f0-f5a4-4b05-b49b-8ea906cc1a1c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:27.175115 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c01f0-f5a4-4b05-b49b-8ea906cc1a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:27.175479 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c01f0-f5a4-4b05-b49b-8ea906cc1a1c admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:27.176425 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c01f0-f5a4-4b05-b49b-8ea906cc1a1c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:27.176842 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c01f0-f5a4-4b05-b49b-8ea906cc1a1c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:27.178786 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c01f0-f5a4-4b05-b49b-8ea906cc1a1c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:27.197792 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 346/688] 10.222.0.31 () {56 vars in 1154 bytes} [Thu Feb 10 20:46:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:27.204263 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643b2c0-a4f5-4444-97d4-f44c474e9f81 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:27.213347 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643b2c0-a4f5-4444-97d4-f44c474e9f81 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:27.230032 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04442340-2fe2-41ae-b6b4-f32e3eae83e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:27.230903 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04442340-2fe2-41ae-b6b4-f32e3eae83e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:27.231317 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04442340-2fe2-41ae-b6b4-f32e3eae83e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:27.231720 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04442340-2fe2-41ae-b6b4-f32e3eae83e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:27.240499 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04442340-2fe2-41ae-b6b4-f32e3eae83e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:27.242463 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04442340-2fe2-41ae-b6b4-f32e3eae83e2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:27.256311 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 343/689] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:46:27.262135 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c01f0-f5a4-4b05-b49b-8ea906cc1a1c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:27.274338 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c01f0-f5a4-4b05-b49b-8ea906cc1a1c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:27.282880 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d72fda-14db-40dc-b528-6ae7f07f425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:27.283840 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d72fda-14db-40dc-b528-6ae7f07f425f admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:27.284252 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d72fda-14db-40dc-b528-6ae7f07f425f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:27.284652 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d72fda-14db-40dc-b528-6ae7f07f425f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:27.301084 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d72fda-14db-40dc-b528-6ae7f07f425f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:27.303142 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d72fda-14db-40dc-b528-6ae7f07f425f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:27.324771 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-c3d72fda-14db-40dc-b528-6ae7f07f425f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:27.326223 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 347/690] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:27.331790 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04442340-2fe2-41ae-b6b4-f32e3eae83e2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:27.340829 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04442340-2fe2-41ae-b6b4-f32e3eae83e2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:27.349006 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0639d-d3b5-4a72-b126-c3c73bdabd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:27.349845 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0639d-d3b5-4a72-b126-c3c73bdabd6e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:27.350256 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0639d-d3b5-4a72-b126-c3c73bdabd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:27.350659 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0639d-d3b5-4a72-b126-c3c73bdabd6e admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:27.351514 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0639d-d3b5-4a72-b126-c3c73bdabd6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:27.351965 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0639d-d3b5-4a72-b126-c3c73bdabd6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:27.353722 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0639d-d3b5-4a72-b126-c3c73bdabd6e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:27.366234 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 344/691] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:27.371681 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d72fda-14db-40dc-b528-6ae7f07f425f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:27.386717 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d72fda-14db-40dc-b528-6ae7f07f425f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:27.397283 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa959942-cfe5-441d-8e75-f6f69845f1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:27.398255 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa959942-cfe5-441d-8e75-f6f69845f1ac admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:27.398663 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa959942-cfe5-441d-8e75-f6f69845f1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:27.399065 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa959942-cfe5-441d-8e75-f6f69845f1ac admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:27.410760 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa959942-cfe5-441d-8e75-f6f69845f1ac admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:27.412890 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa959942-cfe5-441d-8e75-f6f69845f1ac admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:27.428809 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-aa959942-cfe5-441d-8e75-f6f69845f1ac admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:27.430947 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 348/692] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:27.436239 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0639d-d3b5-4a72-b126-c3c73bdabd6e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:27.446219 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0639d-d3b5-4a72-b126-c3c73bdabd6e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:27.456208 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87f4d2-e4a0-4029-be15-8b08591ef933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:27.457028 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87f4d2-e4a0-4029-be15-8b08591ef933 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:27.457483 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87f4d2-e4a0-4029-be15-8b08591ef933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:27.457898 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87f4d2-e4a0-4029-be15-8b08591ef933 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:27.458836 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87f4d2-e4a0-4029-be15-8b08591ef933 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:27.459273 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87f4d2-e4a0-4029-be15-8b08591ef933 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:27.461215 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87f4d2-e4a0-4029-be15-8b08591ef933 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:27.473795 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 345/693] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:27.479322 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa959942-cfe5-441d-8e75-f6f69845f1ac admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:27.494981 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa959942-cfe5-441d-8e75-f6f69845f1ac admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:27.503118 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d1cd8-55aa-4883-a4d4-4a0577d9222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:27.504038 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d1cd8-55aa-4883-a4d4-4a0577d9222a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:27.504452 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d1cd8-55aa-4883-a4d4-4a0577d9222a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:27.504853 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d1cd8-55aa-4883-a4d4-4a0577d9222a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:27.505918 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d1cd8-55aa-4883-a4d4-4a0577d9222a admin admin] RBAC: Adding query filter params (role.id=e06447c1c62d465c9f9c58168be71ed8, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=c0d84b0d7e3d423aa972e58be27c772c) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:27.506365 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d1cd8-55aa-4883-a4d4-4a0577d9222a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:27.508385 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d1cd8-55aa-4883-a4d4-4a0577d9222a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:27.517975 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 349/694] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:46:27 2022] GET /identity/v3/role_assignments?user.id=c0d84b0d7e3d423aa972e58be27c772c&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=e06447c1c62d465c9f9c58168be71ed8 => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:27.845231 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f454ce-3bef-4c36-9542-8e9a0373e37b None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:27.845784 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f454ce-3bef-4c36-9542-8e9a0373e37b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:27.845784 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f454ce-3bef-4c36-9542-8e9a0373e37b None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:27.847856 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 346/695] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:27.853497 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b496da0-f1d5-4c99-8a19-dac1113f0fb8 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:27.853933 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b496da0-f1d5-4c99-8a19-dac1113f0fb8 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:27.854073 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b496da0-f1d5-4c99-8a19-dac1113f0fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:27.873482 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-9b496da0-f1d5-4c99-8a19-dac1113f0fb8 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:27.874673 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-9b496da0-f1d5-4c99-8a19-dac1113f0fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:27.882658 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 350/696] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:27.907508 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f454ce-3bef-4c36-9542-8e9a0373e37b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:27.919717 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f454ce-3bef-4c36-9542-8e9a0373e37b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:27.928288 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a66f4-63b7-4103-999c-2c7d455ba952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:27.929092 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a66f4-63b7-4103-999c-2c7d455ba952 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:27.929402 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a66f4-63b7-4103-999c-2c7d455ba952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:27.929703 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a66f4-63b7-4103-999c-2c7d455ba952 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:27.944082 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a66f4-63b7-4103-999c-2c7d455ba952 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:27.945935 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a66f4-63b7-4103-999c-2c7d455ba952 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:27.965851 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-be1a66f4-63b7-4103-999c-2c7d455ba952 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:27.967128 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 347/697] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:27.973240 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b496da0-f1d5-4c99-8a19-dac1113f0fb8 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:27.982662 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b496da0-f1d5-4c99-8a19-dac1113f0fb8 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:27.987300 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150c43a-d674-4651-862c-4bf7c81477eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:27.987983 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150c43a-d674-4651-862c-4bf7c81477eb admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:27.988262 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150c43a-d674-4651-862c-4bf7c81477eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:27.988535 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150c43a-d674-4651-862c-4bf7c81477eb admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:27.989286 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150c43a-d674-4651-862c-4bf7c81477eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:27.989625 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150c43a-d674-4651-862c-4bf7c81477eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:27.991242 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150c43a-d674-4651-862c-4bf7c81477eb admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:28.004111 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 351/698] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:28.009781 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a66f4-63b7-4103-999c-2c7d455ba952 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:28.019718 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a66f4-63b7-4103-999c-2c7d455ba952 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:28.024270 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759b30b-93b9-4cd5-ad73-9cc6869c31e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:28.024938 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759b30b-93b9-4cd5-ad73-9cc6869c31e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:28.025216 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759b30b-93b9-4cd5-ad73-9cc6869c31e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:28.025543 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759b30b-93b9-4cd5-ad73-9cc6869c31e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:28.026289 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759b30b-93b9-4cd5-ad73-9cc6869c31e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:28.028195 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759b30b-93b9-4cd5-ad73-9cc6869c31e2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:28.034110 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5deb1b3-582a-47b8-951d-b2f02223c53e None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:28.034581 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5deb1b3-582a-47b8-951d-b2f02223c53e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:28.035008 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5deb1b3-582a-47b8-951d-b2f02223c53e None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:28.038347 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 352/699] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:46:28.043618 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481cc4a-e56c-4b24-a7e5-94f5621e428e None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:28.043899 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481cc4a-e56c-4b24-a7e5-94f5621e428e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:28.044173 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481cc4a-e56c-4b24-a7e5-94f5621e428e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:28.060437 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 348/700] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 10 20:46:28 2022] POST /identity/v3/users => generated 254 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:46:28.065597 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-1481cc4a-e56c-4b24-a7e5-94f5621e428e None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:28.066870 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-1481cc4a-e56c-4b24-a7e5-94f5621e428e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:28.076016 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 353/701] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:28.100564 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759b30b-93b9-4cd5-ad73-9cc6869c31e2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:28.111683 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759b30b-93b9-4cd5-ad73-9cc6869c31e2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:28.116658 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff33cba-83a4-494c-af57-47ed51eddda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:28.117634 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff33cba-83a4-494c-af57-47ed51eddda3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:28.117959 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff33cba-83a4-494c-af57-47ed51eddda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:28.118267 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff33cba-83a4-494c-af57-47ed51eddda3 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:28.118954 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff33cba-83a4-494c-af57-47ed51eddda3 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:28.120151 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-4ff33cba-83a4-494c-af57-47ed51eddda3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:46:28.120151 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Feb 10 20:46:28.120151 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: Feb 10 20:46:28.121100 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff33cba-83a4-494c-af57-47ed51eddda3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:28.135484 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-4ff33cba-83a4-494c-af57-47ed51eddda3 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 10 20:46:28.137161 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 349/702] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:28 2022] GET /identity/v3/services/network => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:28.143516 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481cc4a-e56c-4b24-a7e5-94f5621e428e None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:28.155933 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481cc4a-e56c-4b24-a7e5-94f5621e428e None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:28.161780 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24478101-9825-4c9d-bcf5-d825f28a9e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:28.162475 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24478101-9825-4c9d-bcf5-d825f28a9e61 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:28.162748 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24478101-9825-4c9d-bcf5-d825f28a9e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:28.163016 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24478101-9825-4c9d-bcf5-d825f28a9e61 admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:28.163813 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24478101-9825-4c9d-bcf5-d825f28a9e61 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:28.164120 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24478101-9825-4c9d-bcf5-d825f28a9e61 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:28.165922 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24478101-9825-4c9d-bcf5-d825f28a9e61 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:28.171551 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 354/703] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 10 20:46:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:28.177336 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff33cba-83a4-494c-af57-47ed51eddda3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:28.189548 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff33cba-83a4-494c-af57-47ed51eddda3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:28.194417 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83419907-a90f-476a-b5e1-95603ec028f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:28.195164 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83419907-a90f-476a-b5e1-95603ec028f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:28.195441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83419907-a90f-476a-b5e1-95603ec028f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:28.195710 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83419907-a90f-476a-b5e1-95603ec028f0 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:28.196560 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83419907-a90f-476a-b5e1-95603ec028f0 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:28.196864 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83419907-a90f-476a-b5e1-95603ec028f0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:28.198092 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-83419907-a90f-476a-b5e1-95603ec028f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:46:28.198092 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Feb 10 20:46:28.198092 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: Feb 10 20:46:28.198987 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83419907-a90f-476a-b5e1-95603ec028f0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:28.206401 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 350/704] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 10 20:46:28 2022] GET /identity/v3/services?type=network => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:28.404539 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6ce76-48cf-474a-b7c3-cd0efbfdd8d0 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:28.404742 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6ce76-48cf-474a-b7c3-cd0efbfdd8d0 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:28.405016 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6ce76-48cf-474a-b7c3-cd0efbfdd8d0 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:28.407272 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 355/705] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:28.412333 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac184d8-1455-4550-8951-c03067823890 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:28.412726 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac184d8-1455-4550-8951-c03067823890 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:28.413096 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac184d8-1455-4550-8951-c03067823890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:28.435207 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-8ac184d8-1455-4550-8951-c03067823890 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:28.436572 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8ac184d8-1455-4550-8951-c03067823890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:28.448954 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 351/706] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 20:46:28.472934 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6ce76-48cf-474a-b7c3-cd0efbfdd8d0 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:28.487609 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6ce76-48cf-474a-b7c3-cd0efbfdd8d0 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:28.492441 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f21ffb-6f41-4c0c-b971-61b5f855d9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:28.493448 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f21ffb-6f41-4c0c-b971-61b5f855d9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:28.493830 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f21ffb-6f41-4c0c-b971-61b5f855d9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:28.494231 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f21ffb-6f41-4c0c-b971-61b5f855d9a3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:28.505528 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f21ffb-6f41-4c0c-b971-61b5f855d9a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:28.512832 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-e7f21ffb-6f41-4c0c-b971-61b5f855d9a3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 20:46:28.514455 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 356/707] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:46:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:28.521286 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac184d8-1455-4550-8951-c03067823890 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:28.531633 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac184d8-1455-4550-8951-c03067823890 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:28.536471 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdac685-256a-4f30-b926-52edd9d0f1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:28.537244 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdac685-256a-4f30-b926-52edd9d0f1ef admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:28.537726 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdac685-256a-4f30-b926-52edd9d0f1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:28.538122 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdac685-256a-4f30-b926-52edd9d0f1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:28.538995 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdac685-256a-4f30-b926-52edd9d0f1ef admin admin] RBAC: Adding query filter params (name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:28.539443 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdac685-256a-4f30-b926-52edd9d0f1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:28.541131 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdac685-256a-4f30-b926-52edd9d0f1ef admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:28.550818 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 352/708] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 10 20:46:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:28.556631 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f21ffb-6f41-4c0c-b971-61b5f855d9a3 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:28.566605 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f21ffb-6f41-4c0c-b971-61b5f855d9a3 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:28.571285 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd343bd-6f85-4bb0-8ed1-4605802c1e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:28.572124 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd343bd-6f85-4bb0-8ed1-4605802c1e88 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:28.572401 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd343bd-6f85-4bb0-8ed1-4605802c1e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:28.572712 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd343bd-6f85-4bb0-8ed1-4605802c1e88 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:28.584422 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd343bd-6f85-4bb0-8ed1-4605802c1e88 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:28.586345 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd343bd-6f85-4bb0-8ed1-4605802c1e88 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:28.604232 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-7dd343bd-6f85-4bb0-8ed1-4605802c1e88 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:28.605487 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 357/709] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:28.611288 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdac685-256a-4f30-b926-52edd9d0f1ef admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:28.622190 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdac685-256a-4f30-b926-52edd9d0f1ef admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:28.634363 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d2e60-cc1c-456e-9f38-10ff55d4c2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:28.635100 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d2e60-cc1c-456e-9f38-10ff55d4c2db admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:28.635380 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d2e60-cc1c-456e-9f38-10ff55d4c2db admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:28.635658 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d2e60-cc1c-456e-9f38-10ff55d4c2db admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:28.636438 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d2e60-cc1c-456e-9f38-10ff55d4c2db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:28.636743 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d2e60-cc1c-456e-9f38-10ff55d4c2db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:28.638404 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d2e60-cc1c-456e-9f38-10ff55d4c2db admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:28.658734 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 353/710] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:28.664217 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd343bd-6f85-4bb0-8ed1-4605802c1e88 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:28.682854 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd343bd-6f85-4bb0-8ed1-4605802c1e88 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:28.693481 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75a1c4-59fd-4215-b803-9cc8f0e15473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:28.694279 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75a1c4-59fd-4215-b803-9cc8f0e15473 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:28.694554 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75a1c4-59fd-4215-b803-9cc8f0e15473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:28.694820 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75a1c4-59fd-4215-b803-9cc8f0e15473 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:28.710530 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75a1c4-59fd-4215-b803-9cc8f0e15473 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:28.712570 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75a1c4-59fd-4215-b803-9cc8f0e15473 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:28.729752 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-0e75a1c4-59fd-4215-b803-9cc8f0e15473 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 10 20:46:28.731262 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 358/711] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:46:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:28.736651 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d2e60-cc1c-456e-9f38-10ff55d4c2db admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:28.750270 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d2e60-cc1c-456e-9f38-10ff55d4c2db admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:28.762860 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eeb2f3-ad9c-4392-be04-a65d1fbf57ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:28.763533 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eeb2f3-ad9c-4392-be04-a65d1fbf57ce admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:28.763810 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eeb2f3-ad9c-4392-be04-a65d1fbf57ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:28.764075 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eeb2f3-ad9c-4392-be04-a65d1fbf57ce admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:28.764924 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eeb2f3-ad9c-4392-be04-a65d1fbf57ce admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:28.765213 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eeb2f3-ad9c-4392-be04-a65d1fbf57ce admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:28.767128 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eeb2f3-ad9c-4392-be04-a65d1fbf57ce admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:28.796873 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 354/712] 10.222.0.31 () {56 vars in 1156 bytes} [Thu Feb 10 20:46:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:28.802563 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75a1c4-59fd-4215-b803-9cc8f0e15473 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:28.818510 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75a1c4-59fd-4215-b803-9cc8f0e15473 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:28.829997 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d92b5-2f6c-4956-96f8-0542ad52da6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:28.830670 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d92b5-2f6c-4956-96f8-0542ad52da6f admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:28.830947 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d92b5-2f6c-4956-96f8-0542ad52da6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:28.831218 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d92b5-2f6c-4956-96f8-0542ad52da6f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:28.842363 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d92b5-2f6c-4956-96f8-0542ad52da6f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:28.844105 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d92b5-2f6c-4956-96f8-0542ad52da6f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:28.859208 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 359/713] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:46:28.864384 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eeb2f3-ad9c-4392-be04-a65d1fbf57ce admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:28.878227 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eeb2f3-ad9c-4392-be04-a65d1fbf57ce admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:28.890410 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfdd7f-8f7b-4596-a6b7-a2b874529422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:28.891199 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfdd7f-8f7b-4596-a6b7-a2b874529422 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:28.891500 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfdd7f-8f7b-4596-a6b7-a2b874529422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:28.891769 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfdd7f-8f7b-4596-a6b7-a2b874529422 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:28.904809 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfdd7f-8f7b-4596-a6b7-a2b874529422 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:28.906643 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfdd7f-8f7b-4596-a6b7-a2b874529422 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:28.934484 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-11bfdd7f-8f7b-4596-a6b7-a2b874529422 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:28.941380 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d92b5-2f6c-4956-96f8-0542ad52da6f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:28.941671 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 355/714] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:28.955162 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d92b5-2f6c-4956-96f8-0542ad52da6f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:28.964231 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11dd7d-6494-4164-b638-9f7851035a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:28.964990 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11dd7d-6494-4164-b638-9f7851035a94 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:28.965272 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11dd7d-6494-4164-b638-9f7851035a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:28.965564 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11dd7d-6494-4164-b638-9f7851035a94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:28.966355 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11dd7d-6494-4164-b638-9f7851035a94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:28.966655 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11dd7d-6494-4164-b638-9f7851035a94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:28.968307 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11dd7d-6494-4164-b638-9f7851035a94 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:28.991333 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 360/715] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:28.996695 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfdd7f-8f7b-4596-a6b7-a2b874529422 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:29.010364 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfdd7f-8f7b-4596-a6b7-a2b874529422 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:29.022500 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90d95d-6b1e-49ae-a78b-28261a75e0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:29.023313 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90d95d-6b1e-49ae-a78b-28261a75e0ee admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:29.023590 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90d95d-6b1e-49ae-a78b-28261a75e0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:29.023862 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90d95d-6b1e-49ae-a78b-28261a75e0ee admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:29.034454 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90d95d-6b1e-49ae-a78b-28261a75e0ee admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:29.036405 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90d95d-6b1e-49ae-a78b-28261a75e0ee admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:29.057200 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-9c90d95d-6b1e-49ae-a78b-28261a75e0ee admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:29.058435 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 356/716] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:29.064531 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11dd7d-6494-4164-b638-9f7851035a94 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:29.078334 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11dd7d-6494-4164-b638-9f7851035a94 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:29.089770 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9642cb-f573-4fbd-aaf0-99bf1bf51e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:29.090878 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9642cb-f573-4fbd-aaf0-99bf1bf51e10 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:29.091353 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9642cb-f573-4fbd-aaf0-99bf1bf51e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:29.091828 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9642cb-f573-4fbd-aaf0-99bf1bf51e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:29.092849 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9642cb-f573-4fbd-aaf0-99bf1bf51e10 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:29.093384 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9642cb-f573-4fbd-aaf0-99bf1bf51e10 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:29.095670 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9642cb-f573-4fbd-aaf0-99bf1bf51e10 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:29.114853 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 361/717] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:29.120294 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90d95d-6b1e-49ae-a78b-28261a75e0ee admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:29.134398 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90d95d-6b1e-49ae-a78b-28261a75e0ee admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:29.141218 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6f56e-cbb2-4aea-a116-dfe2b32a2e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:29.141954 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6f56e-cbb2-4aea-a116-dfe2b32a2e2c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:29.142227 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6f56e-cbb2-4aea-a116-dfe2b32a2e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:29.142490 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6f56e-cbb2-4aea-a116-dfe2b32a2e2c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:29.143341 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6f56e-cbb2-4aea-a116-dfe2b32a2e2c admin admin] RBAC: Adding query filter params (role.id=67325e5669ca4296b3b2c0eb443fda3e, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=6f09689635e54a4e85c0ef0e3539d911) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:29.143643 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6f56e-cbb2-4aea-a116-dfe2b32a2e2c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:29.145500 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6f56e-cbb2-4aea-a116-dfe2b32a2e2c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:29.158101 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 357/718] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:46:29 2022] GET /identity/v3/role_assignments?user.id=6f09689635e54a4e85c0ef0e3539d911&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=67325e5669ca4296b3b2c0eb443fda3e => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:29.567034 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c233d2f-c5dc-4fc5-86d6-c0fc330ab4b8 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:29.567406 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c233d2f-c5dc-4fc5-86d6-c0fc330ab4b8 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:29.567575 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c233d2f-c5dc-4fc5-86d6-c0fc330ab4b8 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:29.569635 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 362/719] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:29.574839 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da7dcf-3bcb-4dac-8f97-bfa63921f6bb None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:29.575118 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da7dcf-3bcb-4dac-8f97-bfa63921f6bb None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:29.575394 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da7dcf-3bcb-4dac-8f97-bfa63921f6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:29.596255 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-a5da7dcf-3bcb-4dac-8f97-bfa63921f6bb None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:29.597439 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a5da7dcf-3bcb-4dac-8f97-bfa63921f6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:29.610525 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 358/720] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 20:46:29.635061 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c233d2f-c5dc-4fc5-86d6-c0fc330ab4b8 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:29.649882 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c233d2f-c5dc-4fc5-86d6-c0fc330ab4b8 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:29.656449 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe9fc7-24a4-436b-ad47-e0f5708eaf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:29.657141 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe9fc7-24a4-436b-ad47-e0f5708eaf6a admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:29.657442 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe9fc7-24a4-436b-ad47-e0f5708eaf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:29.657869 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe9fc7-24a4-436b-ad47-e0f5708eaf6a admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:29.658618 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe9fc7-24a4-436b-ad47-e0f5708eaf6a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:29.659654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING py.warnings [None req-abbe9fc7-24a4-436b-ad47-e0f5708eaf6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:46:29.659654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: warnings.warn(msg) Feb 10 20:46:29.659654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: Feb 10 20:46:29.660519 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe9fc7-24a4-436b-ad47-e0f5708eaf6a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:29.695188 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 363/721] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 10 20:46:29 2022] POST /identity/v3/services => generated 251 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:46:30.405970 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf718b-6935-403c-b24a-7329e8a194d5 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:30.406690 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf718b-6935-403c-b24a-7329e8a194d5 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:30.406690 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf718b-6935-403c-b24a-7329e8a194d5 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:30.408638 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 359/722] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:30.414396 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3980d3c-faca-4784-bf15-b444ed9ed7d8 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:30.414946 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3980d3c-faca-4784-bf15-b444ed9ed7d8 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:30.414946 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3980d3c-faca-4784-bf15-b444ed9ed7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:30.442465 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-a3980d3c-faca-4784-bf15-b444ed9ed7d8 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:30.443695 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-a3980d3c-faca-4784-bf15-b444ed9ed7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:30.463418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 364/723] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:30 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:30.496712 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf718b-6935-403c-b24a-7329e8a194d5 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:30.516500 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf718b-6935-403c-b24a-7329e8a194d5 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:30.522857 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc20526-99aa-4e82-94f0-5c32dac480cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:30.523728 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc20526-99aa-4e82-94f0-5c32dac480cb admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:30.524010 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc20526-99aa-4e82-94f0-5c32dac480cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:30.524275 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc20526-99aa-4e82-94f0-5c32dac480cb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:30.539559 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc20526-99aa-4e82-94f0-5c32dac480cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:30.546625 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-2dc20526-99aa-4e82-94f0-5c32dac480cb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:46:30.548294 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 360/724] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:46:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:30.553964 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3980d3c-faca-4784-bf15-b444ed9ed7d8 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:30.568132 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3980d3c-faca-4784-bf15-b444ed9ed7d8 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:30.575647 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18b1d2-861c-4eed-ab16-2dbc16a48210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:30.576337 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18b1d2-861c-4eed-ab16-2dbc16a48210 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:30.576616 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18b1d2-861c-4eed-ab16-2dbc16a48210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:30.576885 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18b1d2-861c-4eed-ab16-2dbc16a48210 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:30.577701 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18b1d2-861c-4eed-ab16-2dbc16a48210 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:30.578003 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18b1d2-861c-4eed-ab16-2dbc16a48210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:30.579667 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18b1d2-861c-4eed-ab16-2dbc16a48210 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:30.592970 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 365/725] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:30.598487 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc20526-99aa-4e82-94f0-5c32dac480cb admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:30.608615 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc20526-99aa-4e82-94f0-5c32dac480cb admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:30.617059 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58d0d9-b0d4-4238-9bad-ad1049b710da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:30.617917 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58d0d9-b0d4-4238-9bad-ad1049b710da admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:30.618240 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58d0d9-b0d4-4238-9bad-ad1049b710da admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:30.618514 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58d0d9-b0d4-4238-9bad-ad1049b710da admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:30.629791 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58d0d9-b0d4-4238-9bad-ad1049b710da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:30.631843 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58d0d9-b0d4-4238-9bad-ad1049b710da admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:30.653659 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-2e58d0d9-b0d4-4238-9bad-ad1049b710da admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:30.655169 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 361/726] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:30.660583 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18b1d2-861c-4eed-ab16-2dbc16a48210 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:30.672898 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18b1d2-861c-4eed-ab16-2dbc16a48210 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:30.677577 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e20fc-97e7-4775-ba01-826e1f694c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:30.678229 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e20fc-97e7-4775-ba01-826e1f694c26 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:30.678597 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e20fc-97e7-4775-ba01-826e1f694c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:30.678872 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e20fc-97e7-4775-ba01-826e1f694c26 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:30.679603 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e20fc-97e7-4775-ba01-826e1f694c26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:30.679900 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e20fc-97e7-4775-ba01-826e1f694c26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:30.681583 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e20fc-97e7-4775-ba01-826e1f694c26 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:30.699320 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 366/727] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:30.704419 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58d0d9-b0d4-4238-9bad-ad1049b710da admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:30.714824 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58d0d9-b0d4-4238-9bad-ad1049b710da admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:30.723395 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3921ba-5aec-4620-b732-0d2897a37e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:30.724259 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3921ba-5aec-4620-b732-0d2897a37e3c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:30.724543 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3921ba-5aec-4620-b732-0d2897a37e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:30.724813 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3921ba-5aec-4620-b732-0d2897a37e3c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:30.733906 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3921ba-5aec-4620-b732-0d2897a37e3c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:30.735948 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3921ba-5aec-4620-b732-0d2897a37e3c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:30.755125 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-ed3921ba-5aec-4620-b732-0d2897a37e3c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 20:46:30.756677 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 362/728] 10.222.0.31 () {56 vars in 1114 bytes} [Thu Feb 10 20:46:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:30.761917 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e20fc-97e7-4775-ba01-826e1f694c26 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:30.772102 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e20fc-97e7-4775-ba01-826e1f694c26 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:30.778544 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63da839-d1fc-4333-9865-714e724a7a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:30.779216 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63da839-d1fc-4333-9865-714e724a7a84 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:30.779543 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63da839-d1fc-4333-9865-714e724a7a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:30.779815 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63da839-d1fc-4333-9865-714e724a7a84 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:30.780716 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63da839-d1fc-4333-9865-714e724a7a84 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:30.781022 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63da839-d1fc-4333-9865-714e724a7a84 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:30.782959 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63da839-d1fc-4333-9865-714e724a7a84 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:30.806957 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 367/729] 10.222.0.31 () {56 vars in 1154 bytes} [Thu Feb 10 20:46:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:30.812548 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3921ba-5aec-4620-b732-0d2897a37e3c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:30.822825 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3921ba-5aec-4620-b732-0d2897a37e3c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:30.834339 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f50f5-4a19-42b6-8c77-d1ad11f17bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:30.835239 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f50f5-4a19-42b6-8c77-d1ad11f17bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:30.835567 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f50f5-4a19-42b6-8c77-d1ad11f17bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:30.835839 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f50f5-4a19-42b6-8c77-d1ad11f17bb4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:30.849217 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f50f5-4a19-42b6-8c77-d1ad11f17bb4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:30.851132 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f50f5-4a19-42b6-8c77-d1ad11f17bb4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:30.878253 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-fa4f50f5-4a19-42b6-8c77-d1ad11f17bb4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:30.879783 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 363/730] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:30.885196 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63da839-d1fc-4333-9865-714e724a7a84 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:30.886874 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980809bb-cbbd-43e8-95e3-9c00a270b1b7 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:30.887358 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980809bb-cbbd-43e8-95e3-9c00a270b1b7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:30.887820 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980809bb-cbbd-43e8-95e3-9c00a270b1b7 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:30.889769 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 364/731] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:30.891020 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8562f6-d8d4-40c2-8b50-79b2a8151888 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:30.891496 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8562f6-d8d4-40c2-8b50-79b2a8151888 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:30.891955 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8562f6-d8d4-40c2-8b50-79b2a8151888 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:30.894056 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 365/732] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:30.895253 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba460ccc-645b-47ae-a859-0a274be756c3 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:30.895769 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba460ccc-645b-47ae-a859-0a274be756c3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:30.896240 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba460ccc-645b-47ae-a859-0a274be756c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:30.899029 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63da839-d1fc-4333-9865-714e724a7a84 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:30.904693 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb9f3c-979c-4f3c-9bd4-988ebcef9adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:30.905482 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb9f3c-979c-4f3c-9bd4-988ebcef9adf admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:30.905778 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb9f3c-979c-4f3c-9bd4-988ebcef9adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:30.906049 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb9f3c-979c-4f3c-9bd4-988ebcef9adf admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:30.906835 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb9f3c-979c-4f3c-9bd4-988ebcef9adf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:30.907140 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb9f3c-979c-4f3c-9bd4-988ebcef9adf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:30.908896 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb9f3c-979c-4f3c-9bd4-988ebcef9adf admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:30.917673 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ba460ccc-645b-47ae-a859-0a274be756c3 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:30.918792 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ba460ccc-645b-47ae-a859-0a274be756c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:30.921979 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 368/733] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:30.923574 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b862c6-d947-4e55-b5b2-21c2a93b91a1 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:30.924061 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b862c6-d947-4e55-b5b2-21c2a93b91a1 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:30.924686 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b862c6-d947-4e55-b5b2-21c2a93b91a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:30.927343 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 366/734] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:30 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:30.928334 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba460ccc-645b-47ae-a859-0a274be756c3 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:30.938487 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba460ccc-645b-47ae-a859-0a274be756c3 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:30.943278 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-c2b862c6-d947-4e55-b5b2-21c2a93b91a1 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:30.944775 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1454b-24ef-431b-bb0a-7c7013f75839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:30.945386 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-c2b862c6-d947-4e55-b5b2-21c2a93b91a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:30.946175 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1454b-24ef-431b-bb0a-7c7013f75839 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:30.946594 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1454b-24ef-431b-bb0a-7c7013f75839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:30.947094 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1454b-24ef-431b-bb0a-7c7013f75839 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:30.955305 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 369/735] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:30 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:30.956349 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1454b-24ef-431b-bb0a-7c7013f75839 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:30.958590 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1454b-24ef-431b-bb0a-7c7013f75839 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:30.974899 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-c5f1454b-24ef-431b-bb0a-7c7013f75839 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:30.976287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 367/736] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:30.982784 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b862c6-d947-4e55-b5b2-21c2a93b91a1 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:30.983033 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1454b-24ef-431b-bb0a-7c7013f75839 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:30.992023 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b862c6-d947-4e55-b5b2-21c2a93b91a1 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:30.992527 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1454b-24ef-431b-bb0a-7c7013f75839 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:30.996423 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dae91-53f5-438b-a192-c69b7e069b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:30.997218 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d15f17-e71d-4dfd-b969-14c085664359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:30.997410 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dae91-53f5-438b-a192-c69b7e069b49 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:30.997718 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dae91-53f5-438b-a192-c69b7e069b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:30.997933 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d15f17-e71d-4dfd-b969-14c085664359 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:30.998092 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dae91-53f5-438b-a192-c69b7e069b49 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:30.998236 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d15f17-e71d-4dfd-b969-14c085664359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:30.998483 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d15f17-e71d-4dfd-b969-14c085664359 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:30.999319 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d15f17-e71d-4dfd-b969-14c085664359 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:30.999625 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d15f17-e71d-4dfd-b969-14c085664359 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:31.001529 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d15f17-e71d-4dfd-b969-14c085664359 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:31.008676 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9dae91-53f5-438b-a192-c69b7e069b49 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:31.013828 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 368/737] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:31.014607 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d15f17-e71d-4dfd-b969-14c085664359 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:31.015694 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-bb9dae91-53f5-438b-a192-c69b7e069b49 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 20:46:31.017152 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 370/738] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:46:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:31.020552 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dae91-53f5-438b-a192-c69b7e069b49 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:31.028898 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d15f17-e71d-4dfd-b969-14c085664359 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:31.030306 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dae91-53f5-438b-a192-c69b7e069b49 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:31.033377 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409aabf-c26c-4857-96de-98a36a991083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:31.034071 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409aabf-c26c-4857-96de-98a36a991083 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:31.034354 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409aabf-c26c-4857-96de-98a36a991083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:31.034685 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409aabf-c26c-4857-96de-98a36a991083 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:31.035196 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e271662-fd5f-4524-b98e-e903458c0d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:31.035412 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409aabf-c26c-4857-96de-98a36a991083 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:31.036211 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e271662-fd5f-4524-b98e-e903458c0d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:31.036477 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-e409aabf-c26c-4857-96de-98a36a991083 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:46:31.036477 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Feb 10 20:46:31.036477 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: Feb 10 20:46:31.036763 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e271662-fd5f-4524-b98e-e903458c0d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:31.037123 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e271662-fd5f-4524-b98e-e903458c0d5a admin admin] PATH_INFO: `/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/c0d84b0d7e3d423aa972e58be27c772c/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:31.037427 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409aabf-c26c-4857-96de-98a36a991083 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:31.039296 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e271662-fd5f-4524-b98e-e903458c0d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f35ac6d668442a9ea0347f99eb2881, user_id=c0d84b0d7e3d423aa972e58be27c772c, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:31.042012 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e271662-fd5f-4524-b98e-e903458c0d5a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:31.054452 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 369/739] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 10 20:46:31 2022] POST /identity/v3/services => generated 240 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:46:31.055386 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409aabf-c26c-4857-96de-98a36a991083 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:31.058502 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 371/740] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:46:31 2022] PUT /identity/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/c0d84b0d7e3d423aa972e58be27c772c/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:46:31.089828 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409aabf-c26c-4857-96de-98a36a991083 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:31.153521 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b8520-3598-471a-b5a9-0353a8a6c29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:31.154365 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b8520-3598-471a-b5a9-0353a8a6c29c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:31.154638 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b8520-3598-471a-b5a9-0353a8a6c29c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:31.154904 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b8520-3598-471a-b5a9-0353a8a6c29c admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:31.155733 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b8520-3598-471a-b5a9-0353a8a6c29c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:31.156032 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b8520-3598-471a-b5a9-0353a8a6c29c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:31.157717 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b8520-3598-471a-b5a9-0353a8a6c29c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:31.168197 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 370/741] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 10 20:46:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:31.174086 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e271662-fd5f-4524-b98e-e903458c0d5a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:31.193825 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e271662-fd5f-4524-b98e-e903458c0d5a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:31.207380 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f6611-6c23-43cc-8073-5af40c50bf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:31.208205 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f6611-6c23-43cc-8073-5af40c50bf3e admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:31.208543 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f6611-6c23-43cc-8073-5af40c50bf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:31.208732 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f6611-6c23-43cc-8073-5af40c50bf3e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:31.227623 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f6611-6c23-43cc-8073-5af40c50bf3e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:31.229508 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f6611-6c23-43cc-8073-5af40c50bf3e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:31.254599 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-253f6611-6c23-43cc-8073-5af40c50bf3e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:31.256264 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 372/742] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:31.262283 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b8520-3598-471a-b5a9-0353a8a6c29c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:31.273041 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b8520-3598-471a-b5a9-0353a8a6c29c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:31.288786 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb2153-df8a-4d30-8b06-860d883f5386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:31.289507 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb2153-df8a-4d30-8b06-860d883f5386 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:31.289785 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb2153-df8a-4d30-8b06-860d883f5386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:31.290106 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb2153-df8a-4d30-8b06-860d883f5386 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:31.290852 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb2153-df8a-4d30-8b06-860d883f5386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:31.291196 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb2153-df8a-4d30-8b06-860d883f5386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:31.292886 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb2153-df8a-4d30-8b06-860d883f5386 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:31.310155 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 371/743] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:31.315980 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f6611-6c23-43cc-8073-5af40c50bf3e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:31.330652 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f6611-6c23-43cc-8073-5af40c50bf3e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:31.335292 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be3e6c-824f-4814-a6b6-a0b5f9433823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:31.336174 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be3e6c-824f-4814-a6b6-a0b5f9433823 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:31.336511 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be3e6c-824f-4814-a6b6-a0b5f9433823 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:31.336843 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be3e6c-824f-4814-a6b6-a0b5f9433823 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:31.345112 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be3e6c-824f-4814-a6b6-a0b5f9433823 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:31.347324 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be3e6c-824f-4814-a6b6-a0b5f9433823 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:31.361315 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-e1be3e6c-824f-4814-a6b6-a0b5f9433823 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 10 20:46:31.367164 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 373/744] 10.222.0.31 () {56 vars in 1138 bytes} [Thu Feb 10 20:46:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:31.368517 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb2153-df8a-4d30-8b06-860d883f5386 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:31.378274 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb2153-df8a-4d30-8b06-860d883f5386 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:31.382695 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c818fb-5857-4ba1-b14c-5658c81b232b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:31.383348 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c818fb-5857-4ba1-b14c-5658c81b232b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:31.383621 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c818fb-5857-4ba1-b14c-5658c81b232b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:31.383887 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c818fb-5857-4ba1-b14c-5658c81b232b admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:31.384725 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c818fb-5857-4ba1-b14c-5658c81b232b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:31.385022 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c818fb-5857-4ba1-b14c-5658c81b232b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:31.386900 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c818fb-5857-4ba1-b14c-5658c81b232b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:31.408558 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 372/745] 10.222.0.31 () {56 vars in 1170 bytes} [Thu Feb 10 20:46:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:31.411619 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be3e6c-824f-4814-a6b6-a0b5f9433823 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:31.421668 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be3e6c-824f-4814-a6b6-a0b5f9433823 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:31.426407 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae513b2c-85d1-431e-95e0-cc5b6212a558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:31.427098 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae513b2c-85d1-431e-95e0-cc5b6212a558 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:31.427372 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae513b2c-85d1-431e-95e0-cc5b6212a558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:31.427637 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae513b2c-85d1-431e-95e0-cc5b6212a558 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:31.436520 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae513b2c-85d1-431e-95e0-cc5b6212a558 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:31.438362 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae513b2c-85d1-431e-95e0-cc5b6212a558 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:31.448902 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 374/746] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:31 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:46:31.453544 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c818fb-5857-4ba1-b14c-5658c81b232b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:31.464216 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c818fb-5857-4ba1-b14c-5658c81b232b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:31.468902 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddd18d-d7f8-4597-82b1-dbdaf9225824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:31.469734 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddd18d-d7f8-4597-82b1-dbdaf9225824 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:31.470012 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddd18d-d7f8-4597-82b1-dbdaf9225824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:31.470324 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddd18d-d7f8-4597-82b1-dbdaf9225824 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:31.481883 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddd18d-d7f8-4597-82b1-dbdaf9225824 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:31.483800 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddd18d-d7f8-4597-82b1-dbdaf9225824 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:31.501060 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-57ddd18d-d7f8-4597-82b1-dbdaf9225824 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:31.506866 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 373/747] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:31.508227 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae513b2c-85d1-431e-95e0-cc5b6212a558 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:31.517301 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae513b2c-85d1-431e-95e0-cc5b6212a558 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:31.521919 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f104ac-d0d3-4b0a-a18d-11c6f3971a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:31.522621 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f104ac-d0d3-4b0a-a18d-11c6f3971a72 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:31.522896 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f104ac-d0d3-4b0a-a18d-11c6f3971a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:31.523161 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f104ac-d0d3-4b0a-a18d-11c6f3971a72 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:31.526329 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f104ac-d0d3-4b0a-a18d-11c6f3971a72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:31.526329 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f104ac-d0d3-4b0a-a18d-11c6f3971a72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:31.526660 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f104ac-d0d3-4b0a-a18d-11c6f3971a72 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:31.549786 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 375/748] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:31.555224 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddd18d-d7f8-4597-82b1-dbdaf9225824 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:31.571879 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddd18d-d7f8-4597-82b1-dbdaf9225824 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:31.579172 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b95120-59c2-4b55-a3d9-697ea88f32b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:31.580041 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b95120-59c2-4b55-a3d9-697ea88f32b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:31.580317 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b95120-59c2-4b55-a3d9-697ea88f32b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:31.580584 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b95120-59c2-4b55-a3d9-697ea88f32b5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:31.592665 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b95120-59c2-4b55-a3d9-697ea88f32b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:31.594691 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b95120-59c2-4b55-a3d9-697ea88f32b5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:31.610944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-d2b95120-59c2-4b55-a3d9-697ea88f32b5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:31.613533 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 374/749] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:31.618326 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f104ac-d0d3-4b0a-a18d-11c6f3971a72 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:31.628674 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f104ac-d0d3-4b0a-a18d-11c6f3971a72 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:31.633208 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e06ce-0346-4023-89d3-9abb03402a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:31.633956 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e06ce-0346-4023-89d3-9abb03402a84 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:31.634231 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e06ce-0346-4023-89d3-9abb03402a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:31.634503 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e06ce-0346-4023-89d3-9abb03402a84 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:31.635350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e06ce-0346-4023-89d3-9abb03402a84 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:31.635640 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e06ce-0346-4023-89d3-9abb03402a84 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:31.637590 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e06ce-0346-4023-89d3-9abb03402a84 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:31.654892 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 376/750] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:31.656199 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b95120-59c2-4b55-a3d9-697ea88f32b5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:31.666638 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b95120-59c2-4b55-a3d9-697ea88f32b5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:31.671154 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7e238-f36f-4ccd-8113-7c37bec1b8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:31.671884 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7e238-f36f-4ccd-8113-7c37bec1b8aa admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:31.672104 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7e238-f36f-4ccd-8113-7c37bec1b8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:31.672369 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7e238-f36f-4ccd-8113-7c37bec1b8aa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:31.673254 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7e238-f36f-4ccd-8113-7c37bec1b8aa admin admin] RBAC: Adding query filter params (role.id=67325e5669ca4296b3b2c0eb443fda3e, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=de790a1a69994f7498834ded10480e7c) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:31.673593 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7e238-f36f-4ccd-8113-7c37bec1b8aa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:31.675610 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7e238-f36f-4ccd-8113-7c37bec1b8aa admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:31.686328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 375/751] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:46:31 2022] GET /identity/v3/role_assignments?user.id=de790a1a69994f7498834ded10480e7c&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=67325e5669ca4296b3b2c0eb443fda3e => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:32.017638 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ee1b9-11ec-498c-867a-c8d06ecab311 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:32.018023 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ee1b9-11ec-498c-867a-c8d06ecab311 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:32.018192 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ee1b9-11ec-498c-867a-c8d06ecab311 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:32.020214 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 377/752] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:32.025772 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cc802-2f0c-45da-b401-866a12468099 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:32.026108 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cc802-2f0c-45da-b401-866a12468099 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:32.026387 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cc802-2f0c-45da-b401-866a12468099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:32.050360 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-8a2cc802-2f0c-45da-b401-866a12468099 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:32.051532 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8a2cc802-2f0c-45da-b401-866a12468099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:32.059710 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 376/753] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:32 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:32.098374 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ee1b9-11ec-498c-867a-c8d06ecab311 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:32.111365 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ee1b9-11ec-498c-867a-c8d06ecab311 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:32.122319 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac93e2f-3e5e-49ea-a76c-15fece82730f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:32.122319 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac93e2f-3e5e-49ea-a76c-15fece82730f admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:32.122540 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac93e2f-3e5e-49ea-a76c-15fece82730f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:32.122830 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac93e2f-3e5e-49ea-a76c-15fece82730f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:32.137004 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac93e2f-3e5e-49ea-a76c-15fece82730f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:32.143896 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-4ac93e2f-3e5e-49ea-a76c-15fece82730f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:46:32.147708 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 378/754] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:46:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:32.151261 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cc802-2f0c-45da-b401-866a12468099 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:32.160534 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cc802-2f0c-45da-b401-866a12468099 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:32.167390 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6da1b-f343-4502-851e-f542a4ada598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:32.168058 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6da1b-f343-4502-851e-f542a4ada598 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:32.168376 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6da1b-f343-4502-851e-f542a4ada598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:32.168647 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6da1b-f343-4502-851e-f542a4ada598 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:32.169427 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6da1b-f343-4502-851e-f542a4ada598 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:32.169726 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6da1b-f343-4502-851e-f542a4ada598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:32.171320 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6da1b-f343-4502-851e-f542a4ada598 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:32.183327 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 377/755] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:32.189114 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac93e2f-3e5e-49ea-a76c-15fece82730f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:32.201196 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac93e2f-3e5e-49ea-a76c-15fece82730f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:32.210053 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14319e0d-684a-4d2a-821a-a93987b61dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:32.210915 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14319e0d-684a-4d2a-821a-a93987b61dcc admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:32.211192 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14319e0d-684a-4d2a-821a-a93987b61dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:32.211456 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14319e0d-684a-4d2a-821a-a93987b61dcc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:32.223424 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14319e0d-684a-4d2a-821a-a93987b61dcc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:32.225313 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14319e0d-684a-4d2a-821a-a93987b61dcc admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:32.249815 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-14319e0d-684a-4d2a-821a-a93987b61dcc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:32.251185 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 379/756] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:32.257114 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6da1b-f343-4502-851e-f542a4ada598 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:32.267123 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6da1b-f343-4502-851e-f542a4ada598 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:32.271692 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2723ad7-8461-4ed2-9263-4cb2d409dcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:32.272327 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2723ad7-8461-4ed2-9263-4cb2d409dcf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:32.272606 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2723ad7-8461-4ed2-9263-4cb2d409dcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:32.272873 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2723ad7-8461-4ed2-9263-4cb2d409dcf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:32.273632 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2723ad7-8461-4ed2-9263-4cb2d409dcf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:32.273987 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2723ad7-8461-4ed2-9263-4cb2d409dcf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:32.275623 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2723ad7-8461-4ed2-9263-4cb2d409dcf0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:32.288079 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 378/757] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:32.297635 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14319e0d-684a-4d2a-821a-a93987b61dcc admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:32.307678 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14319e0d-684a-4d2a-821a-a93987b61dcc admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:32.312610 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d25ac9-bbbf-4b17-b44d-e34808067c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:32.313444 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d25ac9-bbbf-4b17-b44d-e34808067c3a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:32.313722 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d25ac9-bbbf-4b17-b44d-e34808067c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:32.313985 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d25ac9-bbbf-4b17-b44d-e34808067c3a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:32.325233 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d25ac9-bbbf-4b17-b44d-e34808067c3a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:32.326711 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d25ac9-bbbf-4b17-b44d-e34808067c3a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:32.356988 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-91d25ac9-bbbf-4b17-b44d-e34808067c3a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 10 20:46:32.358297 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 380/758] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:46:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:32.364234 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2723ad7-8461-4ed2-9263-4cb2d409dcf0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:32.383149 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2723ad7-8461-4ed2-9263-4cb2d409dcf0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:32.394039 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2b544-e492-4749-889d-8fedc3476986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:32.394723 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2b544-e492-4749-889d-8fedc3476986 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:32.395005 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2b544-e492-4749-889d-8fedc3476986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:32.395274 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2b544-e492-4749-889d-8fedc3476986 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:32.396127 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2b544-e492-4749-889d-8fedc3476986 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:32.396429 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2b544-e492-4749-889d-8fedc3476986 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:32.398320 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2b544-e492-4749-889d-8fedc3476986 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:32.423864 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 379/759] 10.222.0.31 () {56 vars in 1156 bytes} [Thu Feb 10 20:46:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:32.430111 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d25ac9-bbbf-4b17-b44d-e34808067c3a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:32.442944 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d25ac9-bbbf-4b17-b44d-e34808067c3a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:32.453249 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7a8b9-643f-4bac-a042-eb3825ec0982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:32.453930 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7a8b9-643f-4bac-a042-eb3825ec0982 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:32.454196 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7a8b9-643f-4bac-a042-eb3825ec0982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:32.454465 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7a8b9-643f-4bac-a042-eb3825ec0982 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:32.465605 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7a8b9-643f-4bac-a042-eb3825ec0982 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:32.467425 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7a8b9-643f-4bac-a042-eb3825ec0982 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:32.477965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 381/760] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:32 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:46:32.483450 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2b544-e492-4749-889d-8fedc3476986 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:32.498361 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2b544-e492-4749-889d-8fedc3476986 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:32.503005 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e241c-7785-4f97-a609-c4764e23ed95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:32.503924 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e241c-7785-4f97-a609-c4764e23ed95 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:32.504201 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e241c-7785-4f97-a609-c4764e23ed95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:32.504469 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e241c-7785-4f97-a609-c4764e23ed95 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:32.521332 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e241c-7785-4f97-a609-c4764e23ed95 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:32.523327 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e241c-7785-4f97-a609-c4764e23ed95 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:32.548746 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-655e241c-7785-4f97-a609-c4764e23ed95 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:32.550019 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 380/761] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:32.555996 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7a8b9-643f-4bac-a042-eb3825ec0982 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:32.565535 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7a8b9-643f-4bac-a042-eb3825ec0982 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:32.578080 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471c0aa-b769-4b7f-b68e-4c0931246edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:32.578735 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471c0aa-b769-4b7f-b68e-4c0931246edb admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:32.579008 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471c0aa-b769-4b7f-b68e-4c0931246edb admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:32.579380 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471c0aa-b769-4b7f-b68e-4c0931246edb admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:32.580404 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471c0aa-b769-4b7f-b68e-4c0931246edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:32.580704 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471c0aa-b769-4b7f-b68e-4c0931246edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:32.582667 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471c0aa-b769-4b7f-b68e-4c0931246edb admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:32.596611 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 382/762] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:32.602203 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e241c-7785-4f97-a609-c4764e23ed95 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:32.615362 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e241c-7785-4f97-a609-c4764e23ed95 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:32.622340 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a652cd1-e502-4a7f-aa16-3552494bd42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:32.623195 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a652cd1-e502-4a7f-aa16-3552494bd42b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:32.623470 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a652cd1-e502-4a7f-aa16-3552494bd42b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:32.623789 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a652cd1-e502-4a7f-aa16-3552494bd42b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:32.642603 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a652cd1-e502-4a7f-aa16-3552494bd42b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:32.644662 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a652cd1-e502-4a7f-aa16-3552494bd42b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:32.659986 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-7a652cd1-e502-4a7f-aa16-3552494bd42b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:32.661282 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 381/763] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:32.666938 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471c0aa-b769-4b7f-b68e-4c0931246edb admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:32.682366 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471c0aa-b769-4b7f-b68e-4c0931246edb admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:32.690840 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63caac18-360e-4237-9626-7516f8c70f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:32.691556 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caac18-360e-4237-9626-7516f8c70f00 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:32.691829 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caac18-360e-4237-9626-7516f8c70f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:32.692096 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caac18-360e-4237-9626-7516f8c70f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:32.692884 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63caac18-360e-4237-9626-7516f8c70f00 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:32.693182 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63caac18-360e-4237-9626-7516f8c70f00 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:32.695030 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63caac18-360e-4237-9626-7516f8c70f00 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:32.714881 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 383/764] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:32.720822 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a652cd1-e502-4a7f-aa16-3552494bd42b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:32.735833 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a652cd1-e502-4a7f-aa16-3552494bd42b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:32.743613 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e11349-8c34-408d-8d8f-21dad9e0595a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:32.744348 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e11349-8c34-408d-8d8f-21dad9e0595a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:32.744625 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e11349-8c34-408d-8d8f-21dad9e0595a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:32.744894 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e11349-8c34-408d-8d8f-21dad9e0595a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:32.745839 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e11349-8c34-408d-8d8f-21dad9e0595a admin admin] RBAC: Adding query filter params (role.id=e06447c1c62d465c9f9c58168be71ed8, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=6f09689635e54a4e85c0ef0e3539d911) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:32.746144 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e11349-8c34-408d-8d8f-21dad9e0595a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:32.748221 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e11349-8c34-408d-8d8f-21dad9e0595a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:32.755385 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 382/765] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:46:32 2022] GET /identity/v3/role_assignments?user.id=6f09689635e54a4e85c0ef0e3539d911&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=e06447c1c62d465c9f9c58168be71ed8 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:33.017072 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e9a6e-b05b-4492-b2a0-ca6378cb506c None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:33.017522 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e9a6e-b05b-4492-b2a0-ca6378cb506c None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:33.017704 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e9a6e-b05b-4492-b2a0-ca6378cb506c None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:33.020009 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 384/766] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:33.025900 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e75d5-0ac6-42fd-8255-4ae18ceba7b6 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:33.026234 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e75d5-0ac6-42fd-8255-4ae18ceba7b6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:33.026444 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e75d5-0ac6-42fd-8255-4ae18ceba7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:33.045475 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-9c4e75d5-0ac6-42fd-8255-4ae18ceba7b6 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:33.046670 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9c4e75d5-0ac6-42fd-8255-4ae18ceba7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:33.061462 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 383/767] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:33 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:46:33.077818 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e9a6e-b05b-4492-b2a0-ca6378cb506c None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:33.090079 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e9a6e-b05b-4492-b2a0-ca6378cb506c None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:33.094345 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d9425-b513-42b4-9d31-8320b3dd9ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:33.095129 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d9425-b513-42b4-9d31-8320b3dd9ffb admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:33.095397 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d9425-b513-42b4-9d31-8320b3dd9ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:33.095666 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d9425-b513-42b4-9d31-8320b3dd9ffb admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:33.096371 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d9425-b513-42b4-9d31-8320b3dd9ffb admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:33.098078 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d9425-b513-42b4-9d31-8320b3dd9ffb admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:33.109568 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-e52d9425-b513-42b4-9d31-8320b3dd9ffb admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 10 20:46:33.114350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 385/768] 10.222.0.31 () {56 vars in 1150 bytes} [Thu Feb 10 20:46:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:33.117329 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e75d5-0ac6-42fd-8255-4ae18ceba7b6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:33.126897 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e75d5-0ac6-42fd-8255-4ae18ceba7b6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:33.131955 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19ef37-a61b-44c5-8633-8b9df6d7ff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:33.132672 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19ef37-a61b-44c5-8633-8b9df6d7ff90 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:33.132945 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19ef37-a61b-44c5-8633-8b9df6d7ff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:33.133213 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19ef37-a61b-44c5-8633-8b9df6d7ff90 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:33.133956 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19ef37-a61b-44c5-8633-8b9df6d7ff90 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:33.134251 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19ef37-a61b-44c5-8633-8b9df6d7ff90 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:33.135860 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19ef37-a61b-44c5-8633-8b9df6d7ff90 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:33.145493 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 384/769] 10.222.0.31 () {56 vars in 1145 bytes} [Thu Feb 10 20:46:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:33.147026 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d9425-b513-42b4-9d31-8320b3dd9ffb admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:33.157573 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d9425-b513-42b4-9d31-8320b3dd9ffb admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:33.162185 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb440c-1463-4d10-9866-ebbc4b4d5b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:33.162887 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb440c-1463-4d10-9866-ebbc4b4d5b33 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:33.163162 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb440c-1463-4d10-9866-ebbc4b4d5b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:33.163428 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb440c-1463-4d10-9866-ebbc4b4d5b33 admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:33.164194 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb440c-1463-4d10-9866-ebbc4b4d5b33 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:33.164489 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb440c-1463-4d10-9866-ebbc4b4d5b33 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:33.166164 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb440c-1463-4d10-9866-ebbc4b4d5b33 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:33.176154 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 386/770] 10.222.0.31 () {56 vars in 1145 bytes} [Thu Feb 10 20:46:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:33.177507 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19ef37-a61b-44c5-8633-8b9df6d7ff90 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:33.187839 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19ef37-a61b-44c5-8633-8b9df6d7ff90 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:33.192495 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9d425-9251-468a-aa42-d2d61476b28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:33.193147 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9d425-9251-468a-aa42-d2d61476b28a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:33.193476 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9d425-9251-468a-aa42-d2d61476b28a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:33.193747 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9d425-9251-468a-aa42-d2d61476b28a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:33.194633 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9d425-9251-468a-aa42-d2d61476b28a admin admin] RBAC: Adding query filter params (interface=public, service_id=1de950388c5b486b9930d4483fbea47a, region_id=RegionOne) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:33.194935 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9d425-9251-468a-aa42-d2d61476b28a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:33.195983 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-6ca9d425-9251-468a-aa42-d2d61476b28a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:46:33.195983 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Feb 10 20:46:33.195983 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: Feb 10 20:46:33.196829 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9d425-9251-468a-aa42-d2d61476b28a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:33.209407 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 385/771] 10.222.0.31 () {56 vars in 1272 bytes} [Thu Feb 10 20:46:33 2022] GET /identity/v3/endpoints?service_id=1de950388c5b486b9930d4483fbea47a&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:33.210762 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb440c-1463-4d10-9866-ebbc4b4d5b33 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:33.220651 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb440c-1463-4d10-9866-ebbc4b4d5b33 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:33.225273 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e8b80-400e-4961-9e3f-9302b6fdd418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:33.226001 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e8b80-400e-4961-9e3f-9302b6fdd418 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:33.226281 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e8b80-400e-4961-9e3f-9302b6fdd418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:33.226545 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e8b80-400e-4961-9e3f-9302b6fdd418 admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:33.227284 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e8b80-400e-4961-9e3f-9302b6fdd418 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:33.228920 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e8b80-400e-4961-9e3f-9302b6fdd418 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:33.238251 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 387/772] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 10 20:46:33 2022] GET /identity/v3/services => generated 772 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:33.781895 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53daae37-8462-400d-9ab9-31818fbbf395 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:33.782622 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53daae37-8462-400d-9ab9-31818fbbf395 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:33.782622 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53daae37-8462-400d-9ab9-31818fbbf395 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:33.784435 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 386/773] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:33.790080 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606cb84-fd35-49ad-9295-ccbb22701830 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:33.790589 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606cb84-fd35-49ad-9295-ccbb22701830 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:33.790589 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606cb84-fd35-49ad-9295-ccbb22701830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:33.816305 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-a606cb84-fd35-49ad-9295-ccbb22701830 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:33.817533 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-a606cb84-fd35-49ad-9295-ccbb22701830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:33.832018 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 388/774] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:33 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:33.866776 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53daae37-8462-400d-9ab9-31818fbbf395 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:33.879936 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53daae37-8462-400d-9ab9-31818fbbf395 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:33.885234 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd20229-77ea-4282-b387-e0f55a2280cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:33.886060 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd20229-77ea-4282-b387-e0f55a2280cd admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:33.886334 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd20229-77ea-4282-b387-e0f55a2280cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:33.886597 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd20229-77ea-4282-b387-e0f55a2280cd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:33.910061 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd20229-77ea-4282-b387-e0f55a2280cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:33.917030 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-0fd20229-77ea-4282-b387-e0f55a2280cd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:46:33.918506 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 387/775] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:46:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:33.924167 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606cb84-fd35-49ad-9295-ccbb22701830 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:33.933386 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606cb84-fd35-49ad-9295-ccbb22701830 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:33.940943 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4277c-c024-4897-b4dc-df1b6b80c9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:33.941631 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4277c-c024-4897-b4dc-df1b6b80c9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:33.941936 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4277c-c024-4897-b4dc-df1b6b80c9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:33.942211 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4277c-c024-4897-b4dc-df1b6b80c9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:33.943023 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4277c-c024-4897-b4dc-df1b6b80c9c2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:33.943321 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4277c-c024-4897-b4dc-df1b6b80c9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:33.944962 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4277c-c024-4897-b4dc-df1b6b80c9c2 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:33.957174 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 389/776] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:33.962597 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd20229-77ea-4282-b387-e0f55a2280cd admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:33.974294 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd20229-77ea-4282-b387-e0f55a2280cd admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:33.979396 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7d66b-9564-4da7-bb4c-e5f176da1fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:33.980220 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7d66b-9564-4da7-bb4c-e5f176da1fac admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:33.980494 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7d66b-9564-4da7-bb4c-e5f176da1fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:33.980757 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7d66b-9564-4da7-bb4c-e5f176da1fac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:33.993332 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7d66b-9564-4da7-bb4c-e5f176da1fac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:33.995216 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7d66b-9564-4da7-bb4c-e5f176da1fac admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:34.014589 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-faf7d66b-9564-4da7-bb4c-e5f176da1fac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:34.015961 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 388/777] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:34.021531 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4277c-c024-4897-b4dc-df1b6b80c9c2 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.033519 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4277c-c024-4897-b4dc-df1b6b80c9c2 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.038121 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74d537-f1f1-4411-a866-d93af395a8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.038865 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74d537-f1f1-4411-a866-d93af395a8cc admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.039143 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74d537-f1f1-4411-a866-d93af395a8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.039411 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74d537-f1f1-4411-a866-d93af395a8cc admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.040180 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74d537-f1f1-4411-a866-d93af395a8cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:34.040477 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74d537-f1f1-4411-a866-d93af395a8cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:34.042136 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74d537-f1f1-4411-a866-d93af395a8cc admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:34.060942 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 390/778] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:34.066019 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7d66b-9564-4da7-bb4c-e5f176da1fac admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.076166 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7d66b-9564-4da7-bb4c-e5f176da1fac admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.086893 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393cc1b-6621-4065-bc81-4ddeef9d4d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.087737 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393cc1b-6621-4065-bc81-4ddeef9d4d57 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.088012 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393cc1b-6621-4065-bc81-4ddeef9d4d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.088281 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393cc1b-6621-4065-bc81-4ddeef9d4d57 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.098618 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393cc1b-6621-4065-bc81-4ddeef9d4d57 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:34.100687 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393cc1b-6621-4065-bc81-4ddeef9d4d57 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:34.117045 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-5393cc1b-6621-4065-bc81-4ddeef9d4d57 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 20:46:34.118349 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 389/779] 10.222.0.31 () {56 vars in 1114 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:34.124332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74d537-f1f1-4411-a866-d93af395a8cc admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.134854 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74d537-f1f1-4411-a866-d93af395a8cc admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.141333 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b5682-3791-4598-9fb0-bbc3a85ca6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.142080 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b5682-3791-4598-9fb0-bbc3a85ca6ab admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.142456 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b5682-3791-4598-9fb0-bbc3a85ca6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.144072 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd550c-e6f0-4193-9182-d53c9c4a62d8 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.144360 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd550c-e6f0-4193-9182-d53c9c4a62d8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.144702 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd550c-e6f0-4193-9182-d53c9c4a62d8 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.146592 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 390/780] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:46:34.146980 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b5682-3791-4598-9fb0-bbc3a85ca6ab admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.147897 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b5682-3791-4598-9fb0-bbc3a85ca6ab admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:34.148206 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b5682-3791-4598-9fb0-bbc3a85ca6ab admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:34.150284 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b5682-3791-4598-9fb0-bbc3a85ca6ab admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:34.151665 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82b4b2-fcaa-4a4f-9758-9bb5fdc832d9 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.151981 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82b4b2-fcaa-4a4f-9758-9bb5fdc832d9 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.152249 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82b4b2-fcaa-4a4f-9758-9bb5fdc832d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.179350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 391/781] 10.222.0.31 () {56 vars in 1154 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:34.182397 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-4d82b4b2-fcaa-4a4f-9758-9bb5fdc832d9 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:34.183596 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4d82b4b2-fcaa-4a4f-9758-9bb5fdc832d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:34.184668 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b5682-3791-4598-9fb0-bbc3a85ca6ab admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.194926 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b5682-3791-4598-9fb0-bbc3a85ca6ab admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.199639 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a57df2-f87c-4018-becb-05ef740f8ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.200498 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a57df2-f87c-4018-becb-05ef740f8ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.200961 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a57df2-f87c-4018-becb-05ef740f8ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.201491 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a57df2-f87c-4018-becb-05ef740f8ae5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.207543 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 391/782] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:34 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:46:34.209982 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a57df2-f87c-4018-becb-05ef740f8ae5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:34.212038 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a57df2-f87c-4018-becb-05ef740f8ae5 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:34.221508 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 392/783] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:46:34.226659 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82b4b2-fcaa-4a4f-9758-9bb5fdc832d9 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.236138 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82b4b2-fcaa-4a4f-9758-9bb5fdc832d9 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.241777 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015e12d-e148-435a-8a4c-61b4af516396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.243209 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015e12d-e148-435a-8a4c-61b4af516396 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.243827 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015e12d-e148-435a-8a4c-61b4af516396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.244310 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015e12d-e148-435a-8a4c-61b4af516396 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.255934 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a57df2-f87c-4018-becb-05ef740f8ae5 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.265670 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a57df2-f87c-4018-becb-05ef740f8ae5 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.267822 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015e12d-e148-435a-8a4c-61b4af516396 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:34.270834 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015e12d-e148-435a-8a4c-61b4af516396 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:34.275555 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae6bcf-202e-4337-a4d9-7ed92771e8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.276846 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae6bcf-202e-4337-a4d9-7ed92771e8ab admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.278091 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae6bcf-202e-4337-a4d9-7ed92771e8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.280376 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae6bcf-202e-4337-a4d9-7ed92771e8ab admin admin] PATH_INFO: `/v3/services/network` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.281255 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae6bcf-202e-4337-a4d9-7ed92771e8ab admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:34.283850 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae6bcf-202e-4337-a4d9-7ed92771e8ab admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:34.299513 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-b015e12d-e148-435a-8a4c-61b4af516396 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:34.300720 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-10ae6bcf-202e-4337-a4d9-7ed92771e8ab admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 10 20:46:34.301622 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 392/784] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:34.306551 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015e12d-e148-435a-8a4c-61b4af516396 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.310665 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 393/785] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/services/network => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:34.316231 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae6bcf-202e-4337-a4d9-7ed92771e8ab admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.318489 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015e12d-e148-435a-8a4c-61b4af516396 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.330552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90d849-d60e-4410-92be-c7c2169eb296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.331563 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90d849-d60e-4410-92be-c7c2169eb296 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.332010 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90d849-d60e-4410-92be-c7c2169eb296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.332441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90d849-d60e-4410-92be-c7c2169eb296 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.333385 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90d849-d60e-4410-92be-c7c2169eb296 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:34.335407 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae6bcf-202e-4337-a4d9-7ed92771e8ab admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.335919 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90d849-d60e-4410-92be-c7c2169eb296 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:34.338376 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90d849-d60e-4410-92be-c7c2169eb296 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:34.346235 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffacae-5383-426a-8600-848c9325fa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.349055 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffacae-5383-426a-8600-848c9325fa85 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.349630 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffacae-5383-426a-8600-848c9325fa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.350853 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffacae-5383-426a-8600-848c9325fa85 admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.351800 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffacae-5383-426a-8600-848c9325fa85 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:34.352924 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffacae-5383-426a-8600-848c9325fa85 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:34.355830 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffacae-5383-426a-8600-848c9325fa85 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:34.365023 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 393/786] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:34.366347 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 394/787] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:34.369092 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90d849-d60e-4410-92be-c7c2169eb296 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.373447 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffacae-5383-426a-8600-848c9325fa85 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.387279 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffacae-5383-426a-8600-848c9325fa85 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.388957 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90d849-d60e-4410-92be-c7c2169eb296 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.397425 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65dcca-87f5-4ffe-8a72-357582382659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.398133 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a72604-bc0a-48ad-8191-760b01ab4d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.399461 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a72604-bc0a-48ad-8191-760b01ab4d9d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.400039 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65dcca-87f5-4ffe-8a72-357582382659 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.400642 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a72604-bc0a-48ad-8191-760b01ab4d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.400966 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65dcca-87f5-4ffe-8a72-357582382659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.401410 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65dcca-87f5-4ffe-8a72-357582382659 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.401834 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a72604-bc0a-48ad-8191-760b01ab4d9d admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.403338 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a72604-bc0a-48ad-8191-760b01ab4d9d admin admin] RBAC: Adding query filter params (type=network) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:34.404441 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a72604-bc0a-48ad-8191-760b01ab4d9d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:34.407195 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a72604-bc0a-48ad-8191-760b01ab4d9d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:34.415226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65dcca-87f5-4ffe-8a72-357582382659 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:34.419551 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 395/788] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:34.419797 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65dcca-87f5-4ffe-8a72-357582382659 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:34.421512 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb7f88-8dc2-44a5-8e8a-8a7f269503db None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.422030 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb7f88-8dc2-44a5-8e8a-8a7f269503db None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.422483 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb7f88-8dc2-44a5-8e8a-8a7f269503db None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.424449 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 396/789] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:34.425587 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb7f88-8dc2-44a5-8e8a-8a7f269503db None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.436123 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-be65dcca-87f5-4ffe-8a72-357582382659 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:34.437685 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 394/790] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:34.439077 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b19e4c-211a-46a2-891f-b62a71b60bf8 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.439339 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b19e4c-211a-46a2-891f-b62a71b60bf8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.439611 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b19e4c-211a-46a2-891f-b62a71b60bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.439973 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb7f88-8dc2-44a5-8e8a-8a7f269503db None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.445043 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1040e-fde7-411b-8c44-5e77934e8a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.445949 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1040e-fde7-411b-8c44-5e77934e8a5d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.446417 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1040e-fde7-411b-8c44-5e77934e8a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.446873 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1040e-fde7-411b-8c44-5e77934e8a5d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.447882 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1040e-fde7-411b-8c44-5e77934e8a5d admin admin] RBAC: Adding query filter params (interface=public, service_id=099ba2a65697404eb5000f073e59d7bc, region_id=RegionOne) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:34.448285 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1040e-fde7-411b-8c44-5e77934e8a5d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:34.449396 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING py.warnings [None req-a9a1040e-fde7-411b-8c44-5e77934e8a5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:46:34.449396 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: warnings.warn(msg) Feb 10 20:46:34.449396 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: Feb 10 20:46:34.450485 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1040e-fde7-411b-8c44-5e77934e8a5d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:34.458489 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 397/791] 10.222.0.31 () {56 vars in 1272 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/endpoints?service_id=099ba2a65697404eb5000f073e59d7bc&interface=public®ion_id=RegionOne => generated 194 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:34.460271 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e0b19e4c-211a-46a2-891f-b62a71b60bf8 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:34.461211 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1040e-fde7-411b-8c44-5e77934e8a5d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.461514 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e0b19e4c-211a-46a2-891f-b62a71b60bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:34.470872 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 395/792] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:34 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:34.471673 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b19e4c-211a-46a2-891f-b62a71b60bf8 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.472068 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1040e-fde7-411b-8c44-5e77934e8a5d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.476651 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45413af7-137c-4a93-a08c-c005c40339b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.477441 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45413af7-137c-4a93-a08c-c005c40339b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.477720 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45413af7-137c-4a93-a08c-c005c40339b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.477990 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45413af7-137c-4a93-a08c-c005c40339b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.478774 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45413af7-137c-4a93-a08c-c005c40339b5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:34.479074 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45413af7-137c-4a93-a08c-c005c40339b5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:34.480894 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45413af7-137c-4a93-a08c-c005c40339b5 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:34.490238 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b19e4c-211a-46a2-891f-b62a71b60bf8 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.495446 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 398/793] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:34.496242 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45413af7-137c-4a93-a08c-c005c40339b5 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.498064 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd127e-27de-4d98-8029-22d93b0d951f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.498962 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd127e-27de-4d98-8029-22d93b0d951f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.499413 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd127e-27de-4d98-8029-22d93b0d951f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.499949 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd127e-27de-4d98-8029-22d93b0d951f admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.500890 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd127e-27de-4d98-8029-22d93b0d951f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:34.502747 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd127e-27de-4d98-8029-22d93b0d951f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:34.508552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 396/794] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/services => generated 772 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:34.509614 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd127e-27de-4d98-8029-22d93b0d951f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.510720 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45413af7-137c-4a93-a08c-c005c40339b5 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.520402 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd127e-27de-4d98-8029-22d93b0d951f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.522652 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910114b6-0320-49a3-86ef-7d8d4a90523d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.529854 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910114b6-0320-49a3-86ef-7d8d4a90523d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.530169 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910114b6-0320-49a3-86ef-7d8d4a90523d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.530637 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910114b6-0320-49a3-86ef-7d8d4a90523d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.532232 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eec1bb-ca51-4a29-aaa9-626a28c82078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.533216 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eec1bb-ca51-4a29-aaa9-626a28c82078 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.533705 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eec1bb-ca51-4a29-aaa9-626a28c82078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.534236 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eec1bb-ca51-4a29-aaa9-626a28c82078 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.535312 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eec1bb-ca51-4a29-aaa9-626a28c82078 admin admin] RBAC: Adding query filter params (role.id=e06447c1c62d465c9f9c58168be71ed8, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=c0d84b0d7e3d423aa972e58be27c772c) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:34.535847 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eec1bb-ca51-4a29-aaa9-626a28c82078 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:34.543831 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eec1bb-ca51-4a29-aaa9-626a28c82078 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:34.549421 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910114b6-0320-49a3-86ef-7d8d4a90523d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:34.554821 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-910114b6-0320-49a3-86ef-7d8d4a90523d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 20:46:34.556252 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 399/795] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:34.558811 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 397/796] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/role_assignments?user.id=c0d84b0d7e3d423aa972e58be27c772c&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=e06447c1c62d465c9f9c58168be71ed8 => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:34.566859 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910114b6-0320-49a3-86ef-7d8d4a90523d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.584681 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910114b6-0320-49a3-86ef-7d8d4a90523d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.597940 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113dda1c-e15c-4001-a85a-970b5bbe3c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.598701 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113dda1c-e15c-4001-a85a-970b5bbe3c22 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.598977 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113dda1c-e15c-4001-a85a-970b5bbe3c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.599251 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113dda1c-e15c-4001-a85a-970b5bbe3c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.600049 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113dda1c-e15c-4001-a85a-970b5bbe3c22 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:34.600349 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113dda1c-e15c-4001-a85a-970b5bbe3c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:34.602061 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113dda1c-e15c-4001-a85a-970b5bbe3c22 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:34.618089 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 400/797] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:34.623984 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eec1bb-ca51-4a29-aaa9-626a28c82078 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.639854 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eec1bb-ca51-4a29-aaa9-626a28c82078 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.654837 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eab62a-d534-4c35-972f-074a0b364841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.656125 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eab62a-d534-4c35-972f-074a0b364841 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.656599 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eab62a-d534-4c35-972f-074a0b364841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.657063 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eab62a-d534-4c35-972f-074a0b364841 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.669327 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eab62a-d534-4c35-972f-074a0b364841 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:34.671645 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eab62a-d534-4c35-972f-074a0b364841 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:34.691244 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-06eab62a-d534-4c35-972f-074a0b364841 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:34.693311 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 398/798] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:34.699754 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113dda1c-e15c-4001-a85a-970b5bbe3c22 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.710675 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113dda1c-e15c-4001-a85a-970b5bbe3c22 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.716092 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1de087-4342-4478-ac3f-c9e0c4b7a5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.717270 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1de087-4342-4478-ac3f-c9e0c4b7a5ce admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.717814 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1de087-4342-4478-ac3f-c9e0c4b7a5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.718353 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1de087-4342-4478-ac3f-c9e0c4b7a5ce admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.719327 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1de087-4342-4478-ac3f-c9e0c4b7a5ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:34.719921 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1de087-4342-4478-ac3f-c9e0c4b7a5ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:34.721919 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1de087-4342-4478-ac3f-c9e0c4b7a5ce admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:34.743256 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 401/799] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:34.749657 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eab62a-d534-4c35-972f-074a0b364841 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.760504 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eab62a-d534-4c35-972f-074a0b364841 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.766237 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a49322-3954-46c5-863d-167624313848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.767451 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a49322-3954-46c5-863d-167624313848 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.767944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a49322-3954-46c5-863d-167624313848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.768457 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a49322-3954-46c5-863d-167624313848 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.777283 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a49322-3954-46c5-863d-167624313848 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:34.779755 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a49322-3954-46c5-863d-167624313848 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:34.795082 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-61a49322-3954-46c5-863d-167624313848 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 10 20:46:34.797252 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 399/800] 10.222.0.31 () {56 vars in 1138 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:34.803213 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1de087-4342-4478-ac3f-c9e0c4b7a5ce admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.816929 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1de087-4342-4478-ac3f-c9e0c4b7a5ce admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.822545 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbb709-7ebe-4611-b8cc-0b8c2efd47da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.823502 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbb709-7ebe-4611-b8cc-0b8c2efd47da admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.824037 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbb709-7ebe-4611-b8cc-0b8c2efd47da admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.824502 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbb709-7ebe-4611-b8cc-0b8c2efd47da admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.825660 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbb709-7ebe-4611-b8cc-0b8c2efd47da admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:34.826172 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbb709-7ebe-4611-b8cc-0b8c2efd47da admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:34.828312 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbb709-7ebe-4611-b8cc-0b8c2efd47da admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:34.852149 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 402/801] 10.222.0.31 () {56 vars in 1170 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:34.858331 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a49322-3954-46c5-863d-167624313848 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.868675 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a49322-3954-46c5-863d-167624313848 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.876325 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a0689-f60d-411c-beb8-6433854e5798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.877130 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a0689-f60d-411c-beb8-6433854e5798 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.881470 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a0689-f60d-411c-beb8-6433854e5798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.881470 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a0689-f60d-411c-beb8-6433854e5798 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.892207 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a0689-f60d-411c-beb8-6433854e5798 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:34.894317 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a0689-f60d-411c-beb8-6433854e5798 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:34.912687 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-ba8a0689-f60d-411c-beb8-6433854e5798 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:34.914590 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 400/802] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:34.920340 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbb709-7ebe-4611-b8cc-0b8c2efd47da admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.930650 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbb709-7ebe-4611-b8cc-0b8c2efd47da admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.935756 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420eead-89a2-4c52-932d-e620306b66b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.936563 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420eead-89a2-4c52-932d-e620306b66b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.937011 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420eead-89a2-4c52-932d-e620306b66b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.937510 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420eead-89a2-4c52-932d-e620306b66b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.938393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420eead-89a2-4c52-932d-e620306b66b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:34.938828 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420eead-89a2-4c52-932d-e620306b66b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:34.940627 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420eead-89a2-4c52-932d-e620306b66b6 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:34.952967 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 403/803] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:34.958134 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a0689-f60d-411c-beb8-6433854e5798 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:34.968453 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a0689-f60d-411c-beb8-6433854e5798 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:34.973281 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5d74c-c16c-489a-be0b-1c7e526e6f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:34.974399 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5d74c-c16c-489a-be0b-1c7e526e6f40 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:34.974832 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5d74c-c16c-489a-be0b-1c7e526e6f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:34.975276 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5d74c-c16c-489a-be0b-1c7e526e6f40 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:34.982841 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5d74c-c16c-489a-be0b-1c7e526e6f40 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:34.985134 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5d74c-c16c-489a-be0b-1c7e526e6f40 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:35.001546 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-f5d5d74c-c16c-489a-be0b-1c7e526e6f40 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:35.003048 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 401/804] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:35.008716 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420eead-89a2-4c52-932d-e620306b66b6 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:35.022333 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420eead-89a2-4c52-932d-e620306b66b6 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:35.030004 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7c175-9bee-49a6-b7ad-e360687ca90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:35.030828 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7c175-9bee-49a6-b7ad-e360687ca90f admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:35.031349 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7c175-9bee-49a6-b7ad-e360687ca90f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:35.031772 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7c175-9bee-49a6-b7ad-e360687ca90f admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:35.032713 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7c175-9bee-49a6-b7ad-e360687ca90f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:35.033151 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7c175-9bee-49a6-b7ad-e360687ca90f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:35.035141 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7c175-9bee-49a6-b7ad-e360687ca90f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:35.048242 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 404/805] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:35.053694 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5d74c-c16c-489a-be0b-1c7e526e6f40 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:35.070316 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5d74c-c16c-489a-be0b-1c7e526e6f40 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:35.078880 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a12b9e-db40-460d-bf8a-196df85fd5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:35.079962 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a12b9e-db40-460d-bf8a-196df85fd5a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:35.080374 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a12b9e-db40-460d-bf8a-196df85fd5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:35.080775 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a12b9e-db40-460d-bf8a-196df85fd5a6 admin admin] PATH_INFO: `/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/de790a1a69994f7498834ded10480e7c/roles/67325e5669ca4296b3b2c0eb443fda3e` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:35.099601 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a12b9e-db40-460d-bf8a-196df85fd5a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f35ac6d668442a9ea0347f99eb2881, user_id=de790a1a69994f7498834ded10480e7c, role_id=67325e5669ca4296b3b2c0eb443fda3e)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:35.102627 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a12b9e-db40-460d-bf8a-196df85fd5a6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:35.119096 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 402/806] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:46:35 2022] PUT /identity/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/de790a1a69994f7498834ded10480e7c/roles/67325e5669ca4296b3b2c0eb443fda3e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:46:35.588887 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427c617-be2e-4580-b124-28446f50ce1c None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:35.589264 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427c617-be2e-4580-b124-28446f50ce1c None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:35.589469 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427c617-be2e-4580-b124-28446f50ce1c None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:35.591501 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 405/807] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:35.597138 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde239cf-9f13-498e-9f74-68d4bc37daa3 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:35.597441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde239cf-9f13-498e-9f74-68d4bc37daa3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:35.597715 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde239cf-9f13-498e-9f74-68d4bc37daa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:35.622328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-fde239cf-9f13-498e-9f74-68d4bc37daa3 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:35.623506 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-fde239cf-9f13-498e-9f74-68d4bc37daa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:35.699960 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 403/808] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:35 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:35.734670 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427c617-be2e-4580-b124-28446f50ce1c None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:35.752338 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427c617-be2e-4580-b124-28446f50ce1c None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:35.759268 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b4c9f-468c-4009-9dc8-ad5a9b256d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:35.760531 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b4c9f-468c-4009-9dc8-ad5a9b256d3d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:35.761048 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b4c9f-468c-4009-9dc8-ad5a9b256d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:35.761538 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b4c9f-468c-4009-9dc8-ad5a9b256d3d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:35.779642 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b4c9f-468c-4009-9dc8-ad5a9b256d3d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:35.789246 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-b54b4c9f-468c-4009-9dc8-ad5a9b256d3d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:46:35.795441 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 406/809] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:46:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:35.796628 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde239cf-9f13-498e-9f74-68d4bc37daa3 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:35.810188 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde239cf-9f13-498e-9f74-68d4bc37daa3 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:35.822895 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532be8f1-34ac-4c70-8201-0e530b4cfb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:35.823552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532be8f1-34ac-4c70-8201-0e530b4cfb06 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:35.823826 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532be8f1-34ac-4c70-8201-0e530b4cfb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:35.824089 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532be8f1-34ac-4c70-8201-0e530b4cfb06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:35.824844 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532be8f1-34ac-4c70-8201-0e530b4cfb06 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:35.825142 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532be8f1-34ac-4c70-8201-0e530b4cfb06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:35.826765 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532be8f1-34ac-4c70-8201-0e530b4cfb06 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:35.843804 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 404/810] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:35.848995 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b4c9f-468c-4009-9dc8-ad5a9b256d3d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:35.862252 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b4c9f-468c-4009-9dc8-ad5a9b256d3d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:35.869103 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e827ad-f44c-4001-a62d-2a34eb8cbd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:35.870179 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e827ad-f44c-4001-a62d-2a34eb8cbd29 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:35.870697 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e827ad-f44c-4001-a62d-2a34eb8cbd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:35.871170 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e827ad-f44c-4001-a62d-2a34eb8cbd29 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:35.885954 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e827ad-f44c-4001-a62d-2a34eb8cbd29 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:35.888141 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e827ad-f44c-4001-a62d-2a34eb8cbd29 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:35.908134 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-38e827ad-f44c-4001-a62d-2a34eb8cbd29 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:35.909642 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 407/811] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:35.917307 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532be8f1-34ac-4c70-8201-0e530b4cfb06 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:35.934475 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532be8f1-34ac-4c70-8201-0e530b4cfb06 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:35.946501 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935750bb-36b3-4532-b982-b2050040303d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:35.947169 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935750bb-36b3-4532-b982-b2050040303d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:35.947442 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935750bb-36b3-4532-b982-b2050040303d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:35.947705 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935750bb-36b3-4532-b982-b2050040303d admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:35.948434 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935750bb-36b3-4532-b982-b2050040303d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:35.948730 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935750bb-36b3-4532-b982-b2050040303d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:35.950346 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935750bb-36b3-4532-b982-b2050040303d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:35.970434 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 405/812] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:35.976165 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e827ad-f44c-4001-a62d-2a34eb8cbd29 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:35.990883 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e827ad-f44c-4001-a62d-2a34eb8cbd29 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:35.995914 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b0082-574f-464f-9c63-69b373667a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:35.996958 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b0082-574f-464f-9c63-69b373667a8a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:35.997505 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b0082-574f-464f-9c63-69b373667a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:35.997984 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b0082-574f-464f-9c63-69b373667a8a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:36.010850 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b0082-574f-464f-9c63-69b373667a8a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:36.013162 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b0082-574f-464f-9c63-69b373667a8a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:36.031683 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-297b0082-574f-464f-9c63-69b373667a8a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 10 20:46:36.033814 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 408/813] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:46:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:36.041081 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935750bb-36b3-4532-b982-b2050040303d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:36.045225 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabea5d-6de5-4d1f-9980-ffa6dc54a721 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:36.045599 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabea5d-6de5-4d1f-9980-ffa6dc54a721 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:36.046055 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabea5d-6de5-4d1f-9980-ffa6dc54a721 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:36.047889 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 409/814] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:46:36.053164 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41daf8f-ab49-40f2-890e-fd26a74a7c4f None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:36.053481 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41daf8f-ab49-40f2-890e-fd26a74a7c4f None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:36.053760 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41daf8f-ab49-40f2-890e-fd26a74a7c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:36.063246 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935750bb-36b3-4532-b982-b2050040303d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:36.074366 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf13e6-05a1-4b7b-bed5-90242c49f8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:36.075033 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf13e6-05a1-4b7b-bed5-90242c49f8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:36.075310 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf13e6-05a1-4b7b-bed5-90242c49f8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:36.075575 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf13e6-05a1-4b7b-bed5-90242c49f8e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:36.076422 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf13e6-05a1-4b7b-bed5-90242c49f8e6 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:36.076722 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf13e6-05a1-4b7b-bed5-90242c49f8e6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:36.078561 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf13e6-05a1-4b7b-bed5-90242c49f8e6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:36.084856 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-b41daf8f-ab49-40f2-890e-fd26a74a7c4f None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:36.086053 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b41daf8f-ab49-40f2-890e-fd26a74a7c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:36.104403 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 410/815] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:36 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:46:36.106800 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 406/816] 10.222.0.31 () {56 vars in 1156 bytes} [Thu Feb 10 20:46:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:36.114348 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41daf8f-ab49-40f2-890e-fd26a74a7c4f None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:36.124455 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41daf8f-ab49-40f2-890e-fd26a74a7c4f None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:36.127504 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf13e6-05a1-4b7b-bed5-90242c49f8e6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:36.135752 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b25aff-4b07-4516-a60e-96f4584c5c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:36.136589 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b25aff-4b07-4516-a60e-96f4584c5c1d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:36.136870 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b25aff-4b07-4516-a60e-96f4584c5c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:36.137143 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b25aff-4b07-4516-a60e-96f4584c5c1d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:36.140732 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf13e6-05a1-4b7b-bed5-90242c49f8e6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:36.146253 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee74761-33da-4c00-a93f-b341dc2b7afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:36.147321 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee74761-33da-4c00-a93f-b341dc2b7afd admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:36.147695 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee74761-33da-4c00-a93f-b341dc2b7afd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:36.148499 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee74761-33da-4c00-a93f-b341dc2b7afd admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:36.149304 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee74761-33da-4c00-a93f-b341dc2b7afd admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:36.151120 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee74761-33da-4c00-a93f-b341dc2b7afd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:36.157623 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b25aff-4b07-4516-a60e-96f4584c5c1d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:36.159443 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b25aff-4b07-4516-a60e-96f4584c5c1d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:36.166254 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-bee74761-33da-4c00-a93f-b341dc2b7afd admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 10 20:46:36.168438 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 407/817] 10.222.0.31 () {56 vars in 1150 bytes} [Thu Feb 10 20:46:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:36.174917 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee74761-33da-4c00-a93f-b341dc2b7afd admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:36.185705 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee74761-33da-4c00-a93f-b341dc2b7afd admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:36.187724 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-25b25aff-4b07-4516-a60e-96f4584c5c1d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:36.191001 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f0539-7936-4de4-be1f-926d5aa19d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:36.191806 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f0539-7936-4de4-be1f-926d5aa19d18 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:36.192180 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f0539-7936-4de4-be1f-926d5aa19d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:36.192586 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f0539-7936-4de4-be1f-926d5aa19d18 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:36.193483 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f0539-7936-4de4-be1f-926d5aa19d18 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:36.193967 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f0539-7936-4de4-be1f-926d5aa19d18 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:36.195732 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f0539-7936-4de4-be1f-926d5aa19d18 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:36.197681 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 411/818] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:36.198552 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b25aff-4b07-4516-a60e-96f4584c5c1d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:36.201297 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 408/819] 10.222.0.31 () {56 vars in 1145 bytes} [Thu Feb 10 20:46:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:36.207729 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f0539-7936-4de4-be1f-926d5aa19d18 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:36.215936 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b25aff-4b07-4516-a60e-96f4584c5c1d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:36.219389 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f0539-7936-4de4-be1f-926d5aa19d18 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:36.224817 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94712cef-e65f-44a9-ad10-6043fd020452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:36.225881 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94712cef-e65f-44a9-ad10-6043fd020452 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:36.226370 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94712cef-e65f-44a9-ad10-6043fd020452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:36.226896 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94712cef-e65f-44a9-ad10-6043fd020452 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:36.227831 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94712cef-e65f-44a9-ad10-6043fd020452 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:36.228363 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94712cef-e65f-44a9-ad10-6043fd020452 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:36.230328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94712cef-e65f-44a9-ad10-6043fd020452 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:36.231627 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc0147-6b8f-426a-a98a-f22fca86a57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:36.232296 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc0147-6b8f-426a-a98a-f22fca86a57d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:36.232568 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc0147-6b8f-426a-a98a-f22fca86a57d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:36.232835 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc0147-6b8f-426a-a98a-f22fca86a57d admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:36.233593 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc0147-6b8f-426a-a98a-f22fca86a57d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:36.233920 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc0147-6b8f-426a-a98a-f22fca86a57d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:36.235477 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc0147-6b8f-426a-a98a-f22fca86a57d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:36.238038 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 409/820] 10.222.0.31 () {56 vars in 1145 bytes} [Thu Feb 10 20:46:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:36.245314 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94712cef-e65f-44a9-ad10-6043fd020452 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:36.256729 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94712cef-e65f-44a9-ad10-6043fd020452 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:36.256885 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 412/821] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:36.262087 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf631db-fa4f-4b60-b18e-4487612f8d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:36.262234 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc0147-6b8f-426a-a98a-f22fca86a57d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:36.263172 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf631db-fa4f-4b60-b18e-4487612f8d00 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:36.263696 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf631db-fa4f-4b60-b18e-4487612f8d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:36.264172 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf631db-fa4f-4b60-b18e-4487612f8d00 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:36.265210 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf631db-fa4f-4b60-b18e-4487612f8d00 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:36.266602 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-6cf631db-fa4f-4b60-b18e-4487612f8d00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:46:36.266602 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Feb 10 20:46:36.266602 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: Feb 10 20:46:36.267891 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf631db-fa4f-4b60-b18e-4487612f8d00 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:36.284382 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc0147-6b8f-426a-a98a-f22fca86a57d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:36.288812 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f61941-fb7d-494c-846f-5aa7fcc2b0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:36.289948 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f61941-fb7d-494c-846f-5aa7fcc2b0bd admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:36.290414 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f61941-fb7d-494c-846f-5aa7fcc2b0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:36.290841 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f61941-fb7d-494c-846f-5aa7fcc2b0bd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:36.298809 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f61941-fb7d-494c-846f-5aa7fcc2b0bd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:36.301145 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f61941-fb7d-494c-846f-5aa7fcc2b0bd admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:36.316541 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 410/822] 10.222.0.31 () {60 vars in 1165 bytes} [Thu Feb 10 20:46:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:46:36.316967 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-78f61941-fb7d-494c-846f-5aa7fcc2b0bd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:36.323440 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 413/823] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:36.324460 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf631db-fa4f-4b60-b18e-4487612f8d00 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:36.370938 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf631db-fa4f-4b60-b18e-4487612f8d00 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:36.382081 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3d6bc-9127-4746-b179-0174dae77007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:36.382765 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3d6bc-9127-4746-b179-0174dae77007 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:36.383045 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3d6bc-9127-4746-b179-0174dae77007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:36.383321 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3d6bc-9127-4746-b179-0174dae77007 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:36.384124 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3d6bc-9127-4746-b179-0174dae77007 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:36.384433 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3d6bc-9127-4746-b179-0174dae77007 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:36.386336 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3d6bc-9127-4746-b179-0174dae77007 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:36.411558 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 411/824] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:36.417868 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f61941-fb7d-494c-846f-5aa7fcc2b0bd admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:36.431217 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f61941-fb7d-494c-846f-5aa7fcc2b0bd admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:36.442957 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4d62b-1e5f-44d7-8934-3b9677275120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:36.444540 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4d62b-1e5f-44d7-8934-3b9677275120 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:36.445043 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4d62b-1e5f-44d7-8934-3b9677275120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:36.445564 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4d62b-1e5f-44d7-8934-3b9677275120 admin admin] PATH_INFO: `/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/6f09689635e54a4e85c0ef0e3539d911/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:36.447983 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4d62b-1e5f-44d7-8934-3b9677275120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f35ac6d668442a9ea0347f99eb2881, user_id=6f09689635e54a4e85c0ef0e3539d911, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:36.451068 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4d62b-1e5f-44d7-8934-3b9677275120 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:36.484555 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 414/825] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:46:36 2022] PUT /identity/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/6f09689635e54a4e85c0ef0e3539d911/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:46:37.321317 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14454d-ea59-45bb-973d-15a824bbe1bd None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:37.322027 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14454d-ea59-45bb-973d-15a824bbe1bd None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:37.322305 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14454d-ea59-45bb-973d-15a824bbe1bd None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:37.324374 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 412/826] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:37.329975 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba371aa-d60b-4c12-ae32-5e18c250d3f5 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:37.330863 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba371aa-d60b-4c12-ae32-5e18c250d3f5 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:37.331329 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba371aa-d60b-4c12-ae32-5e18c250d3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:37.365467 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-bba371aa-d60b-4c12-ae32-5e18c250d3f5 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:37.367027 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-bba371aa-d60b-4c12-ae32-5e18c250d3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:37.440712 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 415/827] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:37 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:46:37.476216 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14454d-ea59-45bb-973d-15a824bbe1bd None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:37.489878 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14454d-ea59-45bb-973d-15a824bbe1bd None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:37.499409 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86284748-f9cc-4254-a9cf-b0ee83ecc760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:37.500212 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86284748-f9cc-4254-a9cf-b0ee83ecc760 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:37.500491 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86284748-f9cc-4254-a9cf-b0ee83ecc760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:37.500753 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86284748-f9cc-4254-a9cf-b0ee83ecc760 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:37.501471 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86284748-f9cc-4254-a9cf-b0ee83ecc760 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:37.503057 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86284748-f9cc-4254-a9cf-b0ee83ecc760 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:37.520379 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-86284748-f9cc-4254-a9cf-b0ee83ecc760 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 10 20:46:37.521948 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 413/828] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:37 2022] GET /identity/v3/services/network => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:37.528022 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba371aa-d60b-4c12-ae32-5e18c250d3f5 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:37.538547 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba371aa-d60b-4c12-ae32-5e18c250d3f5 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:37.547095 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07eec3d-e9e1-4e9d-8480-062da7531bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:37.547779 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07eec3d-e9e1-4e9d-8480-062da7531bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:37.548045 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07eec3d-e9e1-4e9d-8480-062da7531bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:37.548317 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07eec3d-e9e1-4e9d-8480-062da7531bf0 admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:37.549075 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07eec3d-e9e1-4e9d-8480-062da7531bf0 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:37.549392 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07eec3d-e9e1-4e9d-8480-062da7531bf0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:37.550993 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07eec3d-e9e1-4e9d-8480-062da7531bf0 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:37.556333 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 416/829] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 10 20:46:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:37.562525 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86284748-f9cc-4254-a9cf-b0ee83ecc760 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:37.570076 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738557dc-9fdd-45f3-a5be-bf2931da3bd4 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:37.570362 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738557dc-9fdd-45f3-a5be-bf2931da3bd4 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:37.570637 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738557dc-9fdd-45f3-a5be-bf2931da3bd4 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:37.572709 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 417/830] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:37.574435 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86284748-f9cc-4254-a9cf-b0ee83ecc760 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:37.580825 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8cf85-72af-42bd-b4bc-8ebf1876b2f6 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:37.581208 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8cf85-72af-42bd-b4bc-8ebf1876b2f6 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:37.581589 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8cf85-72af-42bd-b4bc-8ebf1876b2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:37.583816 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759a9cf-ab76-43c8-a544-3f8921cb4108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:37.584782 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759a9cf-ab76-43c8-a544-3f8921cb4108 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:37.585297 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759a9cf-ab76-43c8-a544-3f8921cb4108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:37.585866 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759a9cf-ab76-43c8-a544-3f8921cb4108 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:37.586895 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759a9cf-ab76-43c8-a544-3f8921cb4108 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:37.587437 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759a9cf-ab76-43c8-a544-3f8921cb4108 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:37.589422 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759a9cf-ab76-43c8-a544-3f8921cb4108 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:37.602756 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-22c8cf85-72af-42bd-b4bc-8ebf1876b2f6 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:37.604019 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-22c8cf85-72af-42bd-b4bc-8ebf1876b2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:37.606333 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 414/831] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 10 20:46:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:37.611965 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759a9cf-ab76-43c8-a544-3f8921cb4108 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:37.615264 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 418/832] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:37 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:46:37.627491 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759a9cf-ab76-43c8-a544-3f8921cb4108 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:37.642510 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1e049-2a27-4a1f-ba1f-8e34ecc7e2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:37.643368 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1e049-2a27-4a1f-ba1f-8e34ecc7e2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:37.643814 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1e049-2a27-4a1f-ba1f-8e34ecc7e2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:37.644239 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1e049-2a27-4a1f-ba1f-8e34ecc7e2a9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:37.645144 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1e049-2a27-4a1f-ba1f-8e34ecc7e2a9 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:37.646904 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1e049-2a27-4a1f-ba1f-8e34ecc7e2a9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:37.664445 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8cf85-72af-42bd-b4bc-8ebf1876b2f6 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:37.674752 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8cf85-72af-42bd-b4bc-8ebf1876b2f6 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:37.680230 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52af464-d29b-47f6-939f-76168752af16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:37.681184 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52af464-d29b-47f6-939f-76168752af16 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:37.681612 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52af464-d29b-47f6-939f-76168752af16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:37.681978 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52af464-d29b-47f6-939f-76168752af16 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:37.682841 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52af464-d29b-47f6-939f-76168752af16 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:37.684729 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52af464-d29b-47f6-939f-76168752af16 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:37.685197 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 415/833] 10.222.0.31 () {60 vars in 1165 bytes} [Thu Feb 10 20:46:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:46:37.697551 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-b52af464-d29b-47f6-939f-76168752af16 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 10 20:46:37.699393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 419/834] 10.222.0.31 () {56 vars in 1153 bytes} [Thu Feb 10 20:46:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:37.705153 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1e049-2a27-4a1f-ba1f-8e34ecc7e2a9 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:37.735958 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1e049-2a27-4a1f-ba1f-8e34ecc7e2a9 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:37.742534 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170e58b-7481-4443-aa20-6ac2a23abee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:37.743362 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170e58b-7481-4443-aa20-6ac2a23abee9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:37.743678 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170e58b-7481-4443-aa20-6ac2a23abee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:37.743945 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170e58b-7481-4443-aa20-6ac2a23abee9 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:37.744693 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170e58b-7481-4443-aa20-6ac2a23abee9 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:37.745037 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170e58b-7481-4443-aa20-6ac2a23abee9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:37.746949 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170e58b-7481-4443-aa20-6ac2a23abee9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:37.757208 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 416/835] 10.222.0.31 () {56 vars in 1147 bytes} [Thu Feb 10 20:46:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:37.763435 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52af464-d29b-47f6-939f-76168752af16 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:37.779607 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52af464-d29b-47f6-939f-76168752af16 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:37.789918 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d36d1b-a40f-46e1-8c9e-97100cff71de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:37.790615 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d36d1b-a40f-46e1-8c9e-97100cff71de admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:37.790893 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d36d1b-a40f-46e1-8c9e-97100cff71de admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:37.791166 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d36d1b-a40f-46e1-8c9e-97100cff71de admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:37.791902 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d36d1b-a40f-46e1-8c9e-97100cff71de admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:37.792206 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d36d1b-a40f-46e1-8c9e-97100cff71de admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:37.798151 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d36d1b-a40f-46e1-8c9e-97100cff71de admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:37.803952 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 420/836] 10.222.0.31 () {56 vars in 1147 bytes} [Thu Feb 10 20:46:37 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:38.073638 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1b50c-53be-491a-86e1-9e1977666edd None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:38.074380 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1b50c-53be-491a-86e1-9e1977666edd None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:38.074854 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1b50c-53be-491a-86e1-9e1977666edd None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:38.077085 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 417/837] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:38.082509 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bcb2a-e07d-4d67-a27e-3f8292896b4c None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:38.082790 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bcb2a-e07d-4d67-a27e-3f8292896b4c None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:38.083057 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bcb2a-e07d-4d67-a27e-3f8292896b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:38.102202 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-974bcb2a-e07d-4d67-a27e-3f8292896b4c None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:38.103383 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-974bcb2a-e07d-4d67-a27e-3f8292896b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:38.111419 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 421/838] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:38 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:38.134662 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1b50c-53be-491a-86e1-9e1977666edd None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:38.146852 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1b50c-53be-491a-86e1-9e1977666edd None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:38.151273 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af97141-bac0-4128-8007-05ca47de5499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:38.152057 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af97141-bac0-4128-8007-05ca47de5499 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:38.152336 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af97141-bac0-4128-8007-05ca47de5499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:38.152602 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af97141-bac0-4128-8007-05ca47de5499 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:38.162731 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af97141-bac0-4128-8007-05ca47de5499 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:38.171764 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-8af97141-bac0-4128-8007-05ca47de5499 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 20:46:38.173266 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 418/839] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:46:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:38.179090 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bcb2a-e07d-4d67-a27e-3f8292896b4c None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:38.188394 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bcb2a-e07d-4d67-a27e-3f8292896b4c None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:38.192830 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb42153-3cdc-4496-a7ee-8cfa8dd783e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:38.193506 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb42153-3cdc-4496-a7ee-8cfa8dd783e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:38.193781 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb42153-3cdc-4496-a7ee-8cfa8dd783e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:38.194046 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb42153-3cdc-4496-a7ee-8cfa8dd783e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:38.194860 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb42153-3cdc-4496-a7ee-8cfa8dd783e1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:38.195161 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb42153-3cdc-4496-a7ee-8cfa8dd783e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:38.196734 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb42153-3cdc-4496-a7ee-8cfa8dd783e1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:38.205234 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 422/840] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 10 20:46:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:38.210721 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af97141-bac0-4128-8007-05ca47de5499 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:38.220948 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af97141-bac0-4128-8007-05ca47de5499 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:38.225911 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35dd67-e64a-49c4-a799-b21bd3eb751e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:38.226963 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35dd67-e64a-49c4-a799-b21bd3eb751e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:38.227440 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35dd67-e64a-49c4-a799-b21bd3eb751e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:38.227920 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35dd67-e64a-49c4-a799-b21bd3eb751e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:38.239090 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35dd67-e64a-49c4-a799-b21bd3eb751e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:38.241156 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35dd67-e64a-49c4-a799-b21bd3eb751e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:38.258736 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-5f35dd67-e64a-49c4-a799-b21bd3eb751e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:38.260498 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 419/841] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:38.266305 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb42153-3cdc-4496-a7ee-8cfa8dd783e1 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:38.278615 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb42153-3cdc-4496-a7ee-8cfa8dd783e1 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:38.284208 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a32c1-d27b-4882-9388-021191916757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:38.285129 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a32c1-d27b-4882-9388-021191916757 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:38.285651 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a32c1-d27b-4882-9388-021191916757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:38.286118 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a32c1-d27b-4882-9388-021191916757 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:38.287143 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a32c1-d27b-4882-9388-021191916757 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:38.287639 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a32c1-d27b-4882-9388-021191916757 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:38.289595 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a32c1-d27b-4882-9388-021191916757 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:38.302293 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 423/842] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:38.308076 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35dd67-e64a-49c4-a799-b21bd3eb751e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:38.318600 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35dd67-e64a-49c4-a799-b21bd3eb751e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:38.323575 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac3233-59cd-4bd3-8160-effa37ada122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:38.325129 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac3233-59cd-4bd3-8160-effa37ada122 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:38.325695 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac3233-59cd-4bd3-8160-effa37ada122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:38.326157 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac3233-59cd-4bd3-8160-effa37ada122 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:38.334691 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac3233-59cd-4bd3-8160-effa37ada122 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:38.337167 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac3233-59cd-4bd3-8160-effa37ada122 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:38.351128 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-69ac3233-59cd-4bd3-8160-effa37ada122 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 10 20:46:38.352804 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 420/843] 10.222.0.31 () {56 vars in 1138 bytes} [Thu Feb 10 20:46:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:38.358600 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a32c1-d27b-4882-9388-021191916757 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:38.369102 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a32c1-d27b-4882-9388-021191916757 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:38.374159 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473d162-2edf-4c19-9740-afa3685086a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:38.375208 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473d162-2edf-4c19-9740-afa3685086a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:38.375695 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473d162-2edf-4c19-9740-afa3685086a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:38.376159 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473d162-2edf-4c19-9740-afa3685086a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:38.377239 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473d162-2edf-4c19-9740-afa3685086a7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:38.377817 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473d162-2edf-4c19-9740-afa3685086a7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:38.379930 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473d162-2edf-4c19-9740-afa3685086a7 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:38.398131 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 424/844] 10.222.0.31 () {56 vars in 1170 bytes} [Thu Feb 10 20:46:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:38.403566 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac3233-59cd-4bd3-8160-effa37ada122 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:38.413744 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac3233-59cd-4bd3-8160-effa37ada122 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:38.418574 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ee6e7-f421-4f60-b7be-7910df708bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:38.419407 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ee6e7-f421-4f60-b7be-7910df708bdc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:38.419825 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ee6e7-f421-4f60-b7be-7910df708bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:38.420231 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ee6e7-f421-4f60-b7be-7910df708bdc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:38.428473 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ee6e7-f421-4f60-b7be-7910df708bdc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:38.430497 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ee6e7-f421-4f60-b7be-7910df708bdc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:38.440171 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 421/845] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:38 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:46:38.445876 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473d162-2edf-4c19-9740-afa3685086a7 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:38.455844 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473d162-2edf-4c19-9740-afa3685086a7 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:38.460584 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8951e08-0875-4c80-8a0b-8adbab99d950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:38.461551 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8951e08-0875-4c80-8a0b-8adbab99d950 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:38.461953 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8951e08-0875-4c80-8a0b-8adbab99d950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:38.462312 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8951e08-0875-4c80-8a0b-8adbab99d950 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:38.472848 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8951e08-0875-4c80-8a0b-8adbab99d950 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:38.474860 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8951e08-0875-4c80-8a0b-8adbab99d950 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:38.491821 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-f8951e08-0875-4c80-8a0b-8adbab99d950 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:38.493456 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 425/846] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:38.502662 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ee6e7-f421-4f60-b7be-7910df708bdc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:38.511816 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ee6e7-f421-4f60-b7be-7910df708bdc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:38.516575 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b60ea-83ba-40f1-92c5-92ae896a0004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:38.517410 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b60ea-83ba-40f1-92c5-92ae896a0004 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:38.517836 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b60ea-83ba-40f1-92c5-92ae896a0004 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:38.518242 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b60ea-83ba-40f1-92c5-92ae896a0004 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:38.519137 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b60ea-83ba-40f1-92c5-92ae896a0004 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:38.519577 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b60ea-83ba-40f1-92c5-92ae896a0004 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:38.521288 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b60ea-83ba-40f1-92c5-92ae896a0004 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:38.536436 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 422/847] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:38.546328 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8951e08-0875-4c80-8a0b-8adbab99d950 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:38.560360 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8951e08-0875-4c80-8a0b-8adbab99d950 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:38.565673 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac29041-3028-4a47-b669-1e21e843cf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:38.566624 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac29041-3028-4a47-b669-1e21e843cf00 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:38.567045 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac29041-3028-4a47-b669-1e21e843cf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:38.567503 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac29041-3028-4a47-b669-1e21e843cf00 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:38.575283 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac29041-3028-4a47-b669-1e21e843cf00 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:38.577582 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac29041-3028-4a47-b669-1e21e843cf00 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:38.591374 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-dac29041-3028-4a47-b669-1e21e843cf00 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:38.593079 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 426/848] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:38.598966 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b60ea-83ba-40f1-92c5-92ae896a0004 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:38.609222 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b60ea-83ba-40f1-92c5-92ae896a0004 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:38.614132 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452ff78-cb11-4ab5-bb94-616d610e94a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:38.615007 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452ff78-cb11-4ab5-bb94-616d610e94a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:38.615439 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452ff78-cb11-4ab5-bb94-616d610e94a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:38.615864 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452ff78-cb11-4ab5-bb94-616d610e94a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:38.616898 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452ff78-cb11-4ab5-bb94-616d610e94a1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:38.617342 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452ff78-cb11-4ab5-bb94-616d610e94a1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:38.619420 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452ff78-cb11-4ab5-bb94-616d610e94a1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:38.631926 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 423/849] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:38.638120 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac29041-3028-4a47-b669-1e21e843cf00 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:38.649270 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac29041-3028-4a47-b669-1e21e843cf00 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:38.654251 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe1040-ea2d-4116-9659-24d6264f0de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:38.655056 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe1040-ea2d-4116-9659-24d6264f0de5 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:38.655513 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe1040-ea2d-4116-9659-24d6264f0de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:38.655952 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe1040-ea2d-4116-9659-24d6264f0de5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:38.656994 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe1040-ea2d-4116-9659-24d6264f0de5 admin admin] RBAC: Adding query filter params (role.id=67325e5669ca4296b3b2c0eb443fda3e, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=de790a1a69994f7498834ded10480e7c) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:38.657475 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe1040-ea2d-4116-9659-24d6264f0de5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:38.659543 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe1040-ea2d-4116-9659-24d6264f0de5 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:38.666532 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 427/850] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:46:38 2022] GET /identity/v3/role_assignments?user.id=de790a1a69994f7498834ded10480e7c&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=67325e5669ca4296b3b2c0eb443fda3e => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:39.030335 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77684fbf-1137-40a5-9a0b-6032ef70cdd1 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:39.030817 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77684fbf-1137-40a5-9a0b-6032ef70cdd1 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:39.031195 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77684fbf-1137-40a5-9a0b-6032ef70cdd1 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:39.033321 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 424/851] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:39.039176 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89951a4-852e-49da-8031-fc42b7961165 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:39.039625 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89951a4-852e-49da-8031-fc42b7961165 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:39.039993 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89951a4-852e-49da-8031-fc42b7961165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:39.058765 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-b89951a4-852e-49da-8031-fc42b7961165 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:39.060090 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b89951a4-852e-49da-8031-fc42b7961165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:39.068212 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 428/852] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:39 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:39.094011 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77684fbf-1137-40a5-9a0b-6032ef70cdd1 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:39.106269 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77684fbf-1137-40a5-9a0b-6032ef70cdd1 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:39.110683 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f049771-0cf9-42db-811c-50bd1b5cd90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:39.111591 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f049771-0cf9-42db-811c-50bd1b5cd90b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:39.111961 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f049771-0cf9-42db-811c-50bd1b5cd90b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:39.112323 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f049771-0cf9-42db-811c-50bd1b5cd90b admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:39.113083 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f049771-0cf9-42db-811c-50bd1b5cd90b admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:39.114794 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f049771-0cf9-42db-811c-50bd1b5cd90b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:39.125737 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-3f049771-0cf9-42db-811c-50bd1b5cd90b admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 10 20:46:39.127319 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 425/853] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 10 20:46:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:39.133453 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89951a4-852e-49da-8031-fc42b7961165 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:39.142534 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89951a4-852e-49da-8031-fc42b7961165 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:39.147119 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3002c6c-b77b-4a11-ba1c-f09c5f6289fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:39.147884 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3002c6c-b77b-4a11-ba1c-f09c5f6289fc admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:39.148283 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3002c6c-b77b-4a11-ba1c-f09c5f6289fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:39.148722 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3002c6c-b77b-4a11-ba1c-f09c5f6289fc admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:39.149572 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3002c6c-b77b-4a11-ba1c-f09c5f6289fc admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:39.149968 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3002c6c-b77b-4a11-ba1c-f09c5f6289fc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:39.151659 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3002c6c-b77b-4a11-ba1c-f09c5f6289fc admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:39.156560 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 429/854] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 10 20:46:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:39.162109 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f049771-0cf9-42db-811c-50bd1b5cd90b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:39.171830 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f049771-0cf9-42db-811c-50bd1b5cd90b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:39.176568 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ec607-eb9a-44c2-b3a9-8b52e22ef88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:39.177382 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ec607-eb9a-44c2-b3a9-8b52e22ef88a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:39.177751 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42c77d-37b7-4505-bbc5-a52dedc3f930 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:39.177959 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ec607-eb9a-44c2-b3a9-8b52e22ef88a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:39.178118 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42c77d-37b7-4505-bbc5-a52dedc3f930 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:39.178262 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ec607-eb9a-44c2-b3a9-8b52e22ef88a admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:39.178408 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42c77d-37b7-4505-bbc5-a52dedc3f930 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:39.178743 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ec607-eb9a-44c2-b3a9-8b52e22ef88a admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:39.179039 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ec607-eb9a-44c2-b3a9-8b52e22ef88a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:39.180750 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ec607-eb9a-44c2-b3a9-8b52e22ef88a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:39.181426 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 430/855] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:46:39.185510 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6943dc-99a2-4e7e-bd3f-f2c7335df68e None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:39.185794 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6943dc-99a2-4e7e-bd3f-f2c7335df68e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:39.186064 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6943dc-99a2-4e7e-bd3f-f2c7335df68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:39.188860 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 426/856] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 10 20:46:39 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:39.204896 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-fe6943dc-99a2-4e7e-bd3f-f2c7335df68e None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:39.206162 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-fe6943dc-99a2-4e7e-bd3f-f2c7335df68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:39.221549 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 431/857] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:39 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:46:39.238956 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ec607-eb9a-44c2-b3a9-8b52e22ef88a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:39.250216 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ec607-eb9a-44c2-b3a9-8b52e22ef88a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:39.255375 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bf01f-f82d-4c7a-b19d-b8c8c29a838e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:39.256194 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bf01f-f82d-4c7a-b19d-b8c8c29a838e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:39.256478 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bf01f-f82d-4c7a-b19d-b8c8c29a838e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:39.256744 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bf01f-f82d-4c7a-b19d-b8c8c29a838e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:39.268734 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bf01f-f82d-4c7a-b19d-b8c8c29a838e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:39.276103 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-d23bf01f-f82d-4c7a-b19d-b8c8c29a838e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:46:39.281560 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 427/858] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:46:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:39.283807 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6943dc-99a2-4e7e-bd3f-f2c7335df68e None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:39.293195 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6943dc-99a2-4e7e-bd3f-f2c7335df68e None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:39.297786 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f090f54-1c2c-45c0-a5a9-87367b29d413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:39.298466 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f090f54-1c2c-45c0-a5a9-87367b29d413 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:39.298743 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f090f54-1c2c-45c0-a5a9-87367b29d413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:39.299007 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f090f54-1c2c-45c0-a5a9-87367b29d413 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:39.299774 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f090f54-1c2c-45c0-a5a9-87367b29d413 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:39.300062 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f090f54-1c2c-45c0-a5a9-87367b29d413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:39.301714 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f090f54-1c2c-45c0-a5a9-87367b29d413 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:39.316353 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 432/859] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:39.317941 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bf01f-f82d-4c7a-b19d-b8c8c29a838e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:39.328061 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bf01f-f82d-4c7a-b19d-b8c8c29a838e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:39.332775 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449947d-81b5-404a-b1dc-55ba7330de1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:39.333606 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449947d-81b5-404a-b1dc-55ba7330de1b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:39.334029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449947d-81b5-404a-b1dc-55ba7330de1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:39.334303 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449947d-81b5-404a-b1dc-55ba7330de1b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:39.351055 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449947d-81b5-404a-b1dc-55ba7330de1b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:39.353064 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449947d-81b5-404a-b1dc-55ba7330de1b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:39.370295 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-6449947d-81b5-404a-b1dc-55ba7330de1b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:39.371824 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 428/860] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:39.378176 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f090f54-1c2c-45c0-a5a9-87367b29d413 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:39.390179 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f090f54-1c2c-45c0-a5a9-87367b29d413 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:39.395147 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b930819-b199-42c5-a9b8-89cac8e3af08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:39.395940 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b930819-b199-42c5-a9b8-89cac8e3af08 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:39.396339 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b930819-b199-42c5-a9b8-89cac8e3af08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:39.396720 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b930819-b199-42c5-a9b8-89cac8e3af08 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:39.397619 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b930819-b199-42c5-a9b8-89cac8e3af08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:39.398012 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b930819-b199-42c5-a9b8-89cac8e3af08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:39.399783 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b930819-b199-42c5-a9b8-89cac8e3af08 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:39.416557 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 433/861] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:39.417996 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449947d-81b5-404a-b1dc-55ba7330de1b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:39.430240 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449947d-81b5-404a-b1dc-55ba7330de1b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:39.435033 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a694c-092d-40a1-90f9-3f215a90be28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:39.435876 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a694c-092d-40a1-90f9-3f215a90be28 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:39.436150 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a694c-092d-40a1-90f9-3f215a90be28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:39.436418 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a694c-092d-40a1-90f9-3f215a90be28 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:39.444854 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a694c-092d-40a1-90f9-3f215a90be28 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:39.447041 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a694c-092d-40a1-90f9-3f215a90be28 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:39.460868 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-b63a694c-092d-40a1-90f9-3f215a90be28 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 10 20:46:39.462448 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 429/862] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:46:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:39.468044 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b930819-b199-42c5-a9b8-89cac8e3af08 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:39.478583 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b930819-b199-42c5-a9b8-89cac8e3af08 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:39.483521 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9c64a-3a3c-4b52-949b-24c2d5c69265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:39.484486 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9c64a-3a3c-4b52-949b-24c2d5c69265 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:39.484963 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9c64a-3a3c-4b52-949b-24c2d5c69265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:39.485481 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9c64a-3a3c-4b52-949b-24c2d5c69265 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:39.486612 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9c64a-3a3c-4b52-949b-24c2d5c69265 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:39.487152 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9c64a-3a3c-4b52-949b-24c2d5c69265 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:39.489249 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9c64a-3a3c-4b52-949b-24c2d5c69265 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:39.513163 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 434/863] 10.222.0.31 () {56 vars in 1156 bytes} [Thu Feb 10 20:46:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:39.514814 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a694c-092d-40a1-90f9-3f215a90be28 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:39.524944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a694c-092d-40a1-90f9-3f215a90be28 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:39.529898 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f96b1d-298e-45b5-843d-fcb508f4bcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:39.530970 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f96b1d-298e-45b5-843d-fcb508f4bcef admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:39.531435 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f96b1d-298e-45b5-843d-fcb508f4bcef admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:39.531968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f96b1d-298e-45b5-843d-fcb508f4bcef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:39.540945 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f96b1d-298e-45b5-843d-fcb508f4bcef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:39.543088 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f96b1d-298e-45b5-843d-fcb508f4bcef admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:39.557496 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 430/864] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:39 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:46:39.559265 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9c64a-3a3c-4b52-949b-24c2d5c69265 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:39.569609 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9c64a-3a3c-4b52-949b-24c2d5c69265 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:39.574302 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7adc5e-90df-47e7-bdee-c34f8dc74583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:39.575185 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7adc5e-90df-47e7-bdee-c34f8dc74583 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:39.575610 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7adc5e-90df-47e7-bdee-c34f8dc74583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:39.575962 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7adc5e-90df-47e7-bdee-c34f8dc74583 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:39.588708 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7adc5e-90df-47e7-bdee-c34f8dc74583 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:39.590798 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7adc5e-90df-47e7-bdee-c34f8dc74583 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:39.608178 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-2e7adc5e-90df-47e7-bdee-c34f8dc74583 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:39.613467 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 435/865] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:39.615687 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f96b1d-298e-45b5-843d-fcb508f4bcef admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:39.624881 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f96b1d-298e-45b5-843d-fcb508f4bcef admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:39.629567 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03969d7b-8429-4acc-be0f-c490e368df39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:39.630364 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03969d7b-8429-4acc-be0f-c490e368df39 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:39.630771 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03969d7b-8429-4acc-be0f-c490e368df39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:39.631290 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03969d7b-8429-4acc-be0f-c490e368df39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:39.632105 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03969d7b-8429-4acc-be0f-c490e368df39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:39.632498 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03969d7b-8429-4acc-be0f-c490e368df39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:39.634506 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03969d7b-8429-4acc-be0f-c490e368df39 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:39.651060 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 431/866] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:39.653177 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7adc5e-90df-47e7-bdee-c34f8dc74583 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:39.663028 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7adc5e-90df-47e7-bdee-c34f8dc74583 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:39.667720 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6172164-56c2-4284-ae55-df358fa5d22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:39.668647 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6172164-56c2-4284-ae55-df358fa5d22e admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:39.669050 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6172164-56c2-4284-ae55-df358fa5d22e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:39.669439 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6172164-56c2-4284-ae55-df358fa5d22e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:39.676516 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6172164-56c2-4284-ae55-df358fa5d22e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:39.678916 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6172164-56c2-4284-ae55-df358fa5d22e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:39.692426 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-d6172164-56c2-4284-ae55-df358fa5d22e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:39.697469 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 436/867] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:39.700089 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03969d7b-8429-4acc-be0f-c490e368df39 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:39.710748 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03969d7b-8429-4acc-be0f-c490e368df39 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:39.716151 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acb59d-a5d2-4405-bba4-76fb564c9371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:39.716922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acb59d-a5d2-4405-bba4-76fb564c9371 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:39.717330 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acb59d-a5d2-4405-bba4-76fb564c9371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:39.717727 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acb59d-a5d2-4405-bba4-76fb564c9371 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:39.718702 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acb59d-a5d2-4405-bba4-76fb564c9371 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:39.719106 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acb59d-a5d2-4405-bba4-76fb564c9371 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:39.721205 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acb59d-a5d2-4405-bba4-76fb564c9371 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:39.737780 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 432/868] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:39.740830 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6172164-56c2-4284-ae55-df358fa5d22e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:39.751437 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6172164-56c2-4284-ae55-df358fa5d22e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:39.756019 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70dbe7-a819-4917-9b7b-a8ef193a3429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:39.756657 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70dbe7-a819-4917-9b7b-a8ef193a3429 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:39.756931 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70dbe7-a819-4917-9b7b-a8ef193a3429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:39.757204 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70dbe7-a819-4917-9b7b-a8ef193a3429 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:39.758077 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70dbe7-a819-4917-9b7b-a8ef193a3429 admin admin] RBAC: Adding query filter params (role.id=e06447c1c62d465c9f9c58168be71ed8, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=6f09689635e54a4e85c0ef0e3539d911) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:39.758383 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70dbe7-a819-4917-9b7b-a8ef193a3429 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:39.760223 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70dbe7-a819-4917-9b7b-a8ef193a3429 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:39.773503 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 437/869] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:46:39 2022] GET /identity/v3/role_assignments?user.id=6f09689635e54a4e85c0ef0e3539d911&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=e06447c1c62d465c9f9c58168be71ed8 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:40.167816 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f6a29-607a-44ac-957a-5ae535a14c72 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:40.168226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f6a29-607a-44ac-957a-5ae535a14c72 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:40.168402 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f6a29-607a-44ac-957a-5ae535a14c72 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:40.170482 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 433/870] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:40.176029 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2831c-785c-44e0-a1f7-789505e63ad8 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:40.176320 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2831c-785c-44e0-a1f7-789505e63ad8 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:40.176595 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2831c-785c-44e0-a1f7-789505e63ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:40.194517 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-a6c2831c-785c-44e0-a1f7-789505e63ad8 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:40.195699 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-a6c2831c-785c-44e0-a1f7-789505e63ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:40.203653 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 438/871] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:40 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:40.226662 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f6a29-607a-44ac-957a-5ae535a14c72 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:40.240141 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f6a29-607a-44ac-957a-5ae535a14c72 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:40.245224 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf57732-0057-4778-b20a-c2a086055867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:40.246190 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf57732-0057-4778-b20a-c2a086055867 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:40.246681 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf57732-0057-4778-b20a-c2a086055867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:40.247144 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf57732-0057-4778-b20a-c2a086055867 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:40.248093 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf57732-0057-4778-b20a-c2a086055867 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:40.249950 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf57732-0057-4778-b20a-c2a086055867 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:40.269731 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 434/872] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 10 20:46:40 2022] POST /identity/v3/services => generated 269 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:46:41.050953 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c38073-735b-4fd4-b3e7-21a4dd0e8fb7 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:41.051517 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c38073-735b-4fd4-b3e7-21a4dd0e8fb7 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:41.051517 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c38073-735b-4fd4-b3e7-21a4dd0e8fb7 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:41.053540 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 439/873] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:41.059395 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d90c7-3861-459a-b3b5-c5246e20fccf None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:41.059844 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d90c7-3861-459a-b3b5-c5246e20fccf None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:41.059933 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d90c7-3861-459a-b3b5-c5246e20fccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:41.078452 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-048d90c7-3861-459a-b3b5-c5246e20fccf None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:41.079636 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-048d90c7-3861-459a-b3b5-c5246e20fccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:41.096599 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 435/874] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:41 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:41.120210 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c38073-735b-4fd4-b3e7-21a4dd0e8fb7 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:41.132824 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c38073-735b-4fd4-b3e7-21a4dd0e8fb7 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:41.137617 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdc607-3119-4d8d-a62e-7838b2a798ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:41.138670 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdc607-3119-4d8d-a62e-7838b2a798ec admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:41.139145 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdc607-3119-4d8d-a62e-7838b2a798ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:41.139619 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdc607-3119-4d8d-a62e-7838b2a798ec admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:41.150118 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdc607-3119-4d8d-a62e-7838b2a798ec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:41.157719 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-cbfdc607-3119-4d8d-a62e-7838b2a798ec admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 10 20:46:41.159409 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 440/875] 10.222.0.31 () {56 vars in 1141 bytes} [Thu Feb 10 20:46:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:41.165535 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d90c7-3861-459a-b3b5-c5246e20fccf None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:41.174598 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d90c7-3861-459a-b3b5-c5246e20fccf None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:41.179213 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9c6be-b92f-4d78-b90a-b20e93a58434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:41.179875 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9c6be-b92f-4d78-b90a-b20e93a58434 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:41.180157 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9c6be-b92f-4d78-b90a-b20e93a58434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:41.180432 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9c6be-b92f-4d78-b90a-b20e93a58434 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:41.181242 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9c6be-b92f-4d78-b90a-b20e93a58434 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:41.181579 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9c6be-b92f-4d78-b90a-b20e93a58434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:41.183213 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9c6be-b92f-4d78-b90a-b20e93a58434 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:41.193880 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 436/876] 10.222.0.31 () {56 vars in 1136 bytes} [Thu Feb 10 20:46:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:41.199723 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdc607-3119-4d8d-a62e-7838b2a798ec admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:41.210430 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdc607-3119-4d8d-a62e-7838b2a798ec admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:41.215865 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad95e2-ed7d-4dab-a8a4-6b8d94478878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:41.217008 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad95e2-ed7d-4dab-a8a4-6b8d94478878 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:41.217547 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad95e2-ed7d-4dab-a8a4-6b8d94478878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:41.218011 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad95e2-ed7d-4dab-a8a4-6b8d94478878 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:41.229881 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad95e2-ed7d-4dab-a8a4-6b8d94478878 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:41.232034 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad95e2-ed7d-4dab-a8a4-6b8d94478878 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:41.249530 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-c6ad95e2-ed7d-4dab-a8a4-6b8d94478878 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:41.251310 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 441/877] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:41.257587 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9c6be-b92f-4d78-b90a-b20e93a58434 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:41.267532 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9c6be-b92f-4d78-b90a-b20e93a58434 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:41.272080 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3df96-7e35-4eb8-a8ea-65f744c194a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:41.272707 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3df96-7e35-4eb8-a8ea-65f744c194a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:41.272988 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3df96-7e35-4eb8-a8ea-65f744c194a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:41.273263 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3df96-7e35-4eb8-a8ea-65f744c194a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:41.274024 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3df96-7e35-4eb8-a8ea-65f744c194a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:41.274332 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3df96-7e35-4eb8-a8ea-65f744c194a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:41.276276 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3df96-7e35-4eb8-a8ea-65f744c194a2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:41.288375 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 437/878] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:41.293933 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad95e2-ed7d-4dab-a8a4-6b8d94478878 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:41.304338 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad95e2-ed7d-4dab-a8a4-6b8d94478878 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:41.309508 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcae3a-eb18-46eb-9c4b-320ff5f5545e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:41.310583 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcae3a-eb18-46eb-9c4b-320ff5f5545e admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:41.311057 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcae3a-eb18-46eb-9c4b-320ff5f5545e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:41.311520 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcae3a-eb18-46eb-9c4b-320ff5f5545e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:41.320685 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcae3a-eb18-46eb-9c4b-320ff5f5545e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:41.323131 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcae3a-eb18-46eb-9c4b-320ff5f5545e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:41.337864 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-7dbcae3a-eb18-46eb-9c4b-320ff5f5545e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 10 20:46:41.339685 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 442/879] 10.222.0.31 () {56 vars in 1138 bytes} [Thu Feb 10 20:46:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:41.345570 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3df96-7e35-4eb8-a8ea-65f744c194a2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:41.355769 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3df96-7e35-4eb8-a8ea-65f744c194a2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:41.360390 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47324a16-1e0a-4a03-a567-c84ebb676713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:41.361056 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47324a16-1e0a-4a03-a567-c84ebb676713 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:41.361336 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47324a16-1e0a-4a03-a567-c84ebb676713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:41.361639 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47324a16-1e0a-4a03-a567-c84ebb676713 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:41.362494 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47324a16-1e0a-4a03-a567-c84ebb676713 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:41.362799 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47324a16-1e0a-4a03-a567-c84ebb676713 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:41.364655 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47324a16-1e0a-4a03-a567-c84ebb676713 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:41.383276 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 438/880] 10.222.0.31 () {56 vars in 1170 bytes} [Thu Feb 10 20:46:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:41.388823 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcae3a-eb18-46eb-9c4b-320ff5f5545e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:41.399043 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcae3a-eb18-46eb-9c4b-320ff5f5545e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:41.404278 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14046c7e-a0b8-43ce-be7f-ebf8acab7532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:41.405201 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14046c7e-a0b8-43ce-be7f-ebf8acab7532 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:41.405721 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14046c7e-a0b8-43ce-be7f-ebf8acab7532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:41.406242 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14046c7e-a0b8-43ce-be7f-ebf8acab7532 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:41.415085 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14046c7e-a0b8-43ce-be7f-ebf8acab7532 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:41.417136 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14046c7e-a0b8-43ce-be7f-ebf8acab7532 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:41.426870 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 443/881] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:41 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:46:41.432797 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47324a16-1e0a-4a03-a567-c84ebb676713 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:41.447623 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47324a16-1e0a-4a03-a567-c84ebb676713 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:41.452481 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c0fda-4620-4bd6-8a2b-a32a496dee1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:41.453598 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0fda-4620-4bd6-8a2b-a32a496dee1c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:41.454141 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0fda-4620-4bd6-8a2b-a32a496dee1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:41.454607 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0fda-4620-4bd6-8a2b-a32a496dee1c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:41.465803 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c0fda-4620-4bd6-8a2b-a32a496dee1c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:41.468065 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c0fda-4620-4bd6-8a2b-a32a496dee1c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:41.484045 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482df2d1-92ca-40e6-9d0b-df0496568458 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:41.484359 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482df2d1-92ca-40e6-9d0b-df0496568458 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:41.484600 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482df2d1-92ca-40e6-9d0b-df0496568458 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:41.486680 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 444/882] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:46:41.488226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-df7c0fda-4620-4bd6-8a2b-a32a496dee1c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:41.490008 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 439/883] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:41.494414 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00693c-45d3-42bc-99af-beb823d3f079 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:41.494414 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00693c-45d3-42bc-99af-beb823d3f079 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:41.494414 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00693c-45d3-42bc-99af-beb823d3f079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:41.496993 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c0fda-4620-4bd6-8a2b-a32a496dee1c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:41.508992 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c0fda-4620-4bd6-8a2b-a32a496dee1c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:41.513652 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d939402-b5a8-4305-9643-73fbd804f3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:41.514276 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d939402-b5a8-4305-9643-73fbd804f3bf admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:41.514551 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d939402-b5a8-4305-9643-73fbd804f3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:41.514869 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d939402-b5a8-4305-9643-73fbd804f3bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:41.515496 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-da00693c-45d3-42bc-99af-beb823d3f079 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:41.515603 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d939402-b5a8-4305-9643-73fbd804f3bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:41.515875 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d939402-b5a8-4305-9643-73fbd804f3bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:41.517174 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-da00693c-45d3-42bc-99af-beb823d3f079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:41.517543 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d939402-b5a8-4305-9643-73fbd804f3bf admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:41.530510 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 445/884] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:41 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:46:41.535968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 440/885] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:41.541605 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00693c-45d3-42bc-99af-beb823d3f079 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:41.553921 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00693c-45d3-42bc-99af-beb823d3f079 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:41.559033 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d939402-b5a8-4305-9643-73fbd804f3bf admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:41.563021 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d91f4-a00b-4184-ad3a-942c7cd2beac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:41.564090 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d91f4-a00b-4184-ad3a-942c7cd2beac admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:41.565049 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d91f4-a00b-4184-ad3a-942c7cd2beac admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:41.565570 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d91f4-a00b-4184-ad3a-942c7cd2beac admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:41.569489 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d939402-b5a8-4305-9643-73fbd804f3bf admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:41.574120 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d91f4-a00b-4184-ad3a-942c7cd2beac admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:41.574455 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd2376-4558-483f-b75f-903430369a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:41.575200 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd2376-4558-483f-b75f-903430369a70 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:41.575480 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd2376-4558-483f-b75f-903430369a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:41.575754 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd2376-4558-483f-b75f-903430369a70 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:41.576542 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd2376-4558-483f-b75f-903430369a70 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:41.577331 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d91f4-a00b-4184-ad3a-942c7cd2beac admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:41.578282 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd2376-4558-483f-b75f-903430369a70 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:41.590760 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-574d91f4-a00b-4184-ad3a-942c7cd2beac admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:41.592606 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 446/886] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:41.598348 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d91f4-a00b-4184-ad3a-942c7cd2beac admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:41.605390 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 441/887] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 10 20:46:41 2022] POST /identity/v3/services => generated 251 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:46:41.615344 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d91f4-a00b-4184-ad3a-942c7cd2beac admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:41.632550 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ba298-7f38-4567-9b15-71e4fb679e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:41.633226 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ba298-7f38-4567-9b15-71e4fb679e45 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:41.633615 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ba298-7f38-4567-9b15-71e4fb679e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:41.633897 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ba298-7f38-4567-9b15-71e4fb679e45 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:41.634827 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ba298-7f38-4567-9b15-71e4fb679e45 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:41.635133 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ba298-7f38-4567-9b15-71e4fb679e45 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:41.637071 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ba298-7f38-4567-9b15-71e4fb679e45 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:41.650976 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 447/888] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:41.656930 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd2376-4558-483f-b75f-903430369a70 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:41.668197 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd2376-4558-483f-b75f-903430369a70 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:41.673030 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d52ba-32da-470c-8364-0d78f3baa6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:41.673798 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d52ba-32da-470c-8364-0d78f3baa6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:41.674080 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d52ba-32da-470c-8364-0d78f3baa6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:41.674404 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d52ba-32da-470c-8364-0d78f3baa6a8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:41.675264 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d52ba-32da-470c-8364-0d78f3baa6a8 admin admin] RBAC: Adding query filter params (role.id=7a87b44bd9ae4d0788eeb1ceb7897a47, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=de790a1a69994f7498834ded10480e7c) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:41.675574 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d52ba-32da-470c-8364-0d78f3baa6a8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:41.677577 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d52ba-32da-470c-8364-0d78f3baa6a8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:41.684328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 442/889] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:46:41 2022] GET /identity/v3/role_assignments?user.id=de790a1a69994f7498834ded10480e7c&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=7a87b44bd9ae4d0788eeb1ceb7897a47 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:42.046192 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e87073-ee68-403c-af8d-f034e74fb58b None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:42.046574 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e87073-ee68-403c-af8d-f034e74fb58b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:42.046762 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e87073-ee68-403c-af8d-f034e74fb58b None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:42.048772 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 448/890] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:42.054128 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b0c2d-ac9b-4bab-8371-369e461c00f5 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:42.054411 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b0c2d-ac9b-4bab-8371-369e461c00f5 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:42.054684 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b0c2d-ac9b-4bab-8371-369e461c00f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:42.072984 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-a34b0c2d-ac9b-4bab-8371-369e461c00f5 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:42.074188 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a34b0c2d-ac9b-4bab-8371-369e461c00f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:42.082101 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 443/891] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:42 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:42.104428 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e87073-ee68-403c-af8d-f034e74fb58b None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:42.116674 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e87073-ee68-403c-af8d-f034e74fb58b None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:42.121147 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1c937-f7ac-4e50-80a3-1b6921d7094c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:42.122031 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1c937-f7ac-4e50-80a3-1b6921d7094c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:42.122377 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1c937-f7ac-4e50-80a3-1b6921d7094c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:42.122716 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1c937-f7ac-4e50-80a3-1b6921d7094c admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:42.123447 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1c937-f7ac-4e50-80a3-1b6921d7094c admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:42.125095 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1c937-f7ac-4e50-80a3-1b6921d7094c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:42.136029 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-04e1c937-f7ac-4e50-80a3-1b6921d7094c admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 10 20:46:42.137548 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 449/892] 10.222.0.31 () {56 vars in 1147 bytes} [Thu Feb 10 20:46:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:42.143542 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b0c2d-ac9b-4bab-8371-369e461c00f5 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:42.152653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b0c2d-ac9b-4bab-8371-369e461c00f5 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:42.157179 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b702fa0-7b13-43d5-a801-ec03d8fbec9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:42.157928 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b702fa0-7b13-43d5-a801-ec03d8fbec9f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:42.158272 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b702fa0-7b13-43d5-a801-ec03d8fbec9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:42.158607 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b702fa0-7b13-43d5-a801-ec03d8fbec9f admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:42.159395 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b702fa0-7b13-43d5-a801-ec03d8fbec9f admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:42.159765 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b702fa0-7b13-43d5-a801-ec03d8fbec9f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:42.161460 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b702fa0-7b13-43d5-a801-ec03d8fbec9f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:42.166463 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 444/893] 10.222.0.31 () {56 vars in 1143 bytes} [Thu Feb 10 20:46:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:42.171996 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1c937-f7ac-4e50-80a3-1b6921d7094c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:42.181814 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1c937-f7ac-4e50-80a3-1b6921d7094c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:42.186484 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7379ec-8ed2-4be7-bbb9-50b8d2703c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:42.187199 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7379ec-8ed2-4be7-bbb9-50b8d2703c8b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:42.187576 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7379ec-8ed2-4be7-bbb9-50b8d2703c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:42.187914 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7379ec-8ed2-4be7-bbb9-50b8d2703c8b admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:42.188742 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7379ec-8ed2-4be7-bbb9-50b8d2703c8b admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:42.189113 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7379ec-8ed2-4be7-bbb9-50b8d2703c8b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:42.191197 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7379ec-8ed2-4be7-bbb9-50b8d2703c8b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:42.196071 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 450/894] 10.222.0.31 () {56 vars in 1143 bytes} [Thu Feb 10 20:46:42 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:42.604572 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e607266-66d0-4800-bfd2-47f97d7a8a09 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:42.604922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e607266-66d0-4800-bfd2-47f97d7a8a09 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:42.605112 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e607266-66d0-4800-bfd2-47f97d7a8a09 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:42.607103 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 445/895] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:42.612873 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062e8cc-8e1b-4421-9aa8-1dad99798185 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:42.613396 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062e8cc-8e1b-4421-9aa8-1dad99798185 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:42.613859 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062e8cc-8e1b-4421-9aa8-1dad99798185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:42.632610 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-e062e8cc-8e1b-4421-9aa8-1dad99798185 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:42.633824 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-e062e8cc-8e1b-4421-9aa8-1dad99798185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:42.641854 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 451/896] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:42 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:42.664747 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e607266-66d0-4800-bfd2-47f97d7a8a09 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:42.677264 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e607266-66d0-4800-bfd2-47f97d7a8a09 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:42.681882 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90facb8c-a731-4c1d-9bbf-b1eab55c7f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:42.682889 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90facb8c-a731-4c1d-9bbf-b1eab55c7f9d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:42.683353 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90facb8c-a731-4c1d-9bbf-b1eab55c7f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:42.683820 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90facb8c-a731-4c1d-9bbf-b1eab55c7f9d admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:42.684668 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90facb8c-a731-4c1d-9bbf-b1eab55c7f9d admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:42.686461 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90facb8c-a731-4c1d-9bbf-b1eab55c7f9d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:42.698141 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-90facb8c-a731-4c1d-9bbf-b1eab55c7f9d admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 10 20:46:42.704712 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 446/897] 10.222.0.31 () {56 vars in 1153 bytes} [Thu Feb 10 20:46:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:42.706289 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062e8cc-8e1b-4421-9aa8-1dad99798185 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:42.716343 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062e8cc-8e1b-4421-9aa8-1dad99798185 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:42.721123 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637575bf-28e4-4e49-970f-ca35d96be66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:42.722059 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637575bf-28e4-4e49-970f-ca35d96be66b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:42.722571 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637575bf-28e4-4e49-970f-ca35d96be66b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:42.723026 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637575bf-28e4-4e49-970f-ca35d96be66b admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:42.723920 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637575bf-28e4-4e49-970f-ca35d96be66b admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:42.724425 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637575bf-28e4-4e49-970f-ca35d96be66b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:42.726284 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637575bf-28e4-4e49-970f-ca35d96be66b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:42.735335 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 452/898] 10.222.0.31 () {56 vars in 1147 bytes} [Thu Feb 10 20:46:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:42.737401 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90facb8c-a731-4c1d-9bbf-b1eab55c7f9d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:42.747528 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90facb8c-a731-4c1d-9bbf-b1eab55c7f9d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:42.752407 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431cc17-a1e8-48fa-965c-d3a101da37c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:42.753280 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431cc17-a1e8-48fa-965c-d3a101da37c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:42.753844 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431cc17-a1e8-48fa-965c-d3a101da37c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:42.754337 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431cc17-a1e8-48fa-965c-d3a101da37c0 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:42.755345 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431cc17-a1e8-48fa-965c-d3a101da37c0 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:42.755847 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431cc17-a1e8-48fa-965c-d3a101da37c0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:42.757692 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431cc17-a1e8-48fa-965c-d3a101da37c0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:42.767964 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 447/899] 10.222.0.31 () {56 vars in 1147 bytes} [Thu Feb 10 20:46:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:42.769627 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637575bf-28e4-4e49-970f-ca35d96be66b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:42.779885 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637575bf-28e4-4e49-970f-ca35d96be66b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:42.784848 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64cfb7-8a34-4c59-9c02-70dc4529ea26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:42.785892 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64cfb7-8a34-4c59-9c02-70dc4529ea26 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:42.786435 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64cfb7-8a34-4c59-9c02-70dc4529ea26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:42.786901 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64cfb7-8a34-4c59-9c02-70dc4529ea26 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:42.788076 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64cfb7-8a34-4c59-9c02-70dc4529ea26 admin admin] RBAC: Adding query filter params (interface=public, service_id=005d9bb9a7134d68b2a50bd28e2a4809, region_id=RegionOne) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:42.788583 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64cfb7-8a34-4c59-9c02-70dc4529ea26 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:42.790572 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64cfb7-8a34-4c59-9c02-70dc4529ea26 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:42.801583 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 453/900] 10.222.0.31 () {56 vars in 1272 bytes} [Thu Feb 10 20:46:42 2022] GET /identity/v3/endpoints?service_id=005d9bb9a7134d68b2a50bd28e2a4809&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:42.803388 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431cc17-a1e8-48fa-965c-d3a101da37c0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:42.818628 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431cc17-a1e8-48fa-965c-d3a101da37c0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:42.823513 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fefc6-bbe9-4500-a865-c3ff51c42ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:42.824453 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fefc6-bbe9-4500-a865-c3ff51c42ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:42.825001 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fefc6-bbe9-4500-a865-c3ff51c42ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:42.825562 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fefc6-bbe9-4500-a865-c3ff51c42ed8 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:42.826452 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fefc6-bbe9-4500-a865-c3ff51c42ed8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:42.828270 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fefc6-bbe9-4500-a865-c3ff51c42ed8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:42.841555 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 448/901] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 10 20:46:42 2022] GET /identity/v3/services => generated 1268 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:46:43.895202 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89788a2f-5c4a-40ca-94f6-da646f1e2241 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:43.895716 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89788a2f-5c4a-40ca-94f6-da646f1e2241 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:43.895716 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89788a2f-5c4a-40ca-94f6-da646f1e2241 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:43.897673 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 454/902] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:43.903353 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458b701-2baa-4a92-ba03-bd039ef406ae None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:43.903775 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458b701-2baa-4a92-ba03-bd039ef406ae None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:43.903958 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458b701-2baa-4a92-ba03-bd039ef406ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:43.921981 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-b458b701-2baa-4a92-ba03-bd039ef406ae None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:43.923165 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b458b701-2baa-4a92-ba03-bd039ef406ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:43.930996 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 449/903] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:43 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:46:43.942250 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3831ee-1b30-4136-8e91-34be40c39e0e None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:43.942530 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3831ee-1b30-4136-8e91-34be40c39e0e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:43.942803 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3831ee-1b30-4136-8e91-34be40c39e0e None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:43.944880 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 455/904] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:43.950416 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4e43f-eaaf-4b4a-903a-6ba555d6438b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:43.950708 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4e43f-eaaf-4b4a-903a-6ba555d6438b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:43.950952 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4e43f-eaaf-4b4a-903a-6ba555d6438b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:43.955683 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3831ee-1b30-4136-8e91-34be40c39e0e None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:43.970335 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-f9a4e43f-eaaf-4b4a-903a-6ba555d6438b None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:43.970692 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3831ee-1b30-4136-8e91-34be40c39e0e None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:43.971703 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f9a4e43f-eaaf-4b4a-903a-6ba555d6438b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:43.975019 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1bd43-6274-4ed2-aba3-7d4aebcf4a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:43.975810 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1bd43-6274-4ed2-aba3-7d4aebcf4a33 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:43.976091 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1bd43-6274-4ed2-aba3-7d4aebcf4a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:43.976362 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1bd43-6274-4ed2-aba3-7d4aebcf4a33 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:43.977032 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1bd43-6274-4ed2-aba3-7d4aebcf4a33 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:43.978659 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1bd43-6274-4ed2-aba3-7d4aebcf4a33 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:43.979955 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 450/905] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:43 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:43.993602 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-43c1bd43-6274-4ed2-aba3-7d4aebcf4a33 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 10 20:46:43.995145 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 456/906] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 10 20:46:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:44.002748 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4e43f-eaaf-4b4a-903a-6ba555d6438b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:44.007500 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1bd43-6274-4ed2-aba3-7d4aebcf4a33 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:44.015319 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4e43f-eaaf-4b4a-903a-6ba555d6438b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:44.017185 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1bd43-6274-4ed2-aba3-7d4aebcf4a33 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:44.020463 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c069ec6-b41f-4792-bd80-b08a933b51f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:44.021347 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c069ec6-b41f-4792-bd80-b08a933b51f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:44.021720 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c069ec6-b41f-4792-bd80-b08a933b51f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:44.022052 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c069ec6-b41f-4792-bd80-b08a933b51f8 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:44.022440 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d062444-b0c2-4e54-95fe-66d4e2940e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:44.022894 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c069ec6-b41f-4792-bd80-b08a933b51f8 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:44.023269 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c069ec6-b41f-4792-bd80-b08a933b51f8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:44.023765 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d062444-b0c2-4e54-95fe-66d4e2940e84 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:44.024213 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d062444-b0c2-4e54-95fe-66d4e2940e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:44.024641 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d062444-b0c2-4e54-95fe-66d4e2940e84 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:44.025106 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c069ec6-b41f-4792-bd80-b08a933b51f8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:44.030418 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 451/907] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 10 20:46:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:44.036527 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d062444-b0c2-4e54-95fe-66d4e2940e84 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:44.036671 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c069ec6-b41f-4792-bd80-b08a933b51f8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:44.044063 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-1d062444-b0c2-4e54-95fe-66d4e2940e84 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 10 20:46:44.045743 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 457/908] 10.222.0.31 () {56 vars in 1141 bytes} [Thu Feb 10 20:46:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:44.049469 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c069ec6-b41f-4792-bd80-b08a933b51f8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:44.051838 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d062444-b0c2-4e54-95fe-66d4e2940e84 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:44.053644 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007e65c-eb27-44f5-8c44-233a0a2b55ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:44.054464 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007e65c-eb27-44f5-8c44-233a0a2b55ca admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:44.054891 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007e65c-eb27-44f5-8c44-233a0a2b55ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:44.055324 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007e65c-eb27-44f5-8c44-233a0a2b55ca admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:44.056175 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007e65c-eb27-44f5-8c44-233a0a2b55ca admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:44.056629 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007e65c-eb27-44f5-8c44-233a0a2b55ca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:44.058416 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007e65c-eb27-44f5-8c44-233a0a2b55ca admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:44.062651 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d062444-b0c2-4e54-95fe-66d4e2940e84 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:44.065000 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 452/909] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 10 20:46:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:44.069421 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf64ebb-df4c-45a6-972a-cf5d92f7f75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:44.069421 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf64ebb-df4c-45a6-972a-cf5d92f7f75c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:44.069421 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf64ebb-df4c-45a6-972a-cf5d92f7f75c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:44.069421 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf64ebb-df4c-45a6-972a-cf5d92f7f75c admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:44.070757 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf64ebb-df4c-45a6-972a-cf5d92f7f75c admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:44.070757 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf64ebb-df4c-45a6-972a-cf5d92f7f75c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:44.071793 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007e65c-eb27-44f5-8c44-233a0a2b55ca admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:44.072206 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf64ebb-df4c-45a6-972a-cf5d92f7f75c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:44.081217 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 458/910] 10.222.0.31 () {56 vars in 1136 bytes} [Thu Feb 10 20:46:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:44.081794 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007e65c-eb27-44f5-8c44-233a0a2b55ca admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:44.086545 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf64ebb-df4c-45a6-972a-cf5d92f7f75c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:44.088948 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01569b24-939f-455f-8250-b8b62ab4c35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:44.089815 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01569b24-939f-455f-8250-b8b62ab4c35f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:44.090265 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01569b24-939f-455f-8250-b8b62ab4c35f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:44.090707 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01569b24-939f-455f-8250-b8b62ab4c35f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:44.091691 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01569b24-939f-455f-8250-b8b62ab4c35f admin admin] RBAC: Adding query filter params (interface=public, service_id=41d66c3657364d5999d1fdbaf6e77693, region_id=RegionOne) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:44.092179 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01569b24-939f-455f-8250-b8b62ab4c35f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:44.094066 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01569b24-939f-455f-8250-b8b62ab4c35f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:44.096441 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf64ebb-df4c-45a6-972a-cf5d92f7f75c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:44.100721 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 453/911] 10.222.0.31 () {56 vars in 1272 bytes} [Thu Feb 10 20:46:44 2022] GET /identity/v3/endpoints?service_id=41d66c3657364d5999d1fdbaf6e77693&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:44.105448 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fef2e-17b6-4a32-9f1a-f4b154a534f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:44.105448 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fef2e-17b6-4a32-9f1a-f4b154a534f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:44.105448 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fef2e-17b6-4a32-9f1a-f4b154a534f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:44.105448 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fef2e-17b6-4a32-9f1a-f4b154a534f1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:44.106766 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01569b24-939f-455f-8250-b8b62ab4c35f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:44.113895 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fef2e-17b6-4a32-9f1a-f4b154a534f1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:44.115790 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fef2e-17b6-4a32-9f1a-f4b154a534f1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:44.117124 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01569b24-939f-455f-8250-b8b62ab4c35f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:44.121994 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189014ad-9cf0-42cd-8550-6dc5fead57cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:44.122880 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189014ad-9cf0-42cd-8550-6dc5fead57cb admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:44.123356 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189014ad-9cf0-42cd-8550-6dc5fead57cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:44.123840 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189014ad-9cf0-42cd-8550-6dc5fead57cb admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:44.124693 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189014ad-9cf0-42cd-8550-6dc5fead57cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:44.126533 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189014ad-9cf0-42cd-8550-6dc5fead57cb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:44.132865 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-6a3fef2e-17b6-4a32-9f1a-f4b154a534f1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:44.134218 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 454/913] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 10 20:46:44 2022] GET /identity/v3/services => generated 1268 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:46:44.134322 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 459/913] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:44.140252 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fef2e-17b6-4a32-9f1a-f4b154a534f1 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:44.150791 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fef2e-17b6-4a32-9f1a-f4b154a534f1 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:44.156008 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d63b15-8119-45ee-b4da-d4dd4333cd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:44.157288 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d63b15-8119-45ee-b4da-d4dd4333cd8b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:44.158014 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d63b15-8119-45ee-b4da-d4dd4333cd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:44.158358 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d63b15-8119-45ee-b4da-d4dd4333cd8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:44.159187 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d63b15-8119-45ee-b4da-d4dd4333cd8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:44.159552 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d63b15-8119-45ee-b4da-d4dd4333cd8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:44.161383 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d63b15-8119-45ee-b4da-d4dd4333cd8b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:44.179784 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 460/914] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:44.185717 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189014ad-9cf0-42cd-8550-6dc5fead57cb admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:44.196240 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189014ad-9cf0-42cd-8550-6dc5fead57cb admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:44.201320 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438cb03-cd67-43e8-aa91-1843b79f7506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:44.202212 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438cb03-cd67-43e8-aa91-1843b79f7506 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:44.202464 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438cb03-cd67-43e8-aa91-1843b79f7506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:44.202727 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438cb03-cd67-43e8-aa91-1843b79f7506 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:44.211141 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438cb03-cd67-43e8-aa91-1843b79f7506 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:44.213220 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438cb03-cd67-43e8-aa91-1843b79f7506 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:44.228528 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-a438cb03-cd67-43e8-aa91-1843b79f7506 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 10 20:46:44.230223 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 455/915] 10.222.0.31 () {56 vars in 1138 bytes} [Thu Feb 10 20:46:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:44.235981 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d63b15-8119-45ee-b4da-d4dd4333cd8b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:44.246355 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d63b15-8119-45ee-b4da-d4dd4333cd8b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:44.251535 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e9a85-3427-49e4-bd4e-335dc9a49aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:44.252319 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e9a85-3427-49e4-bd4e-335dc9a49aab admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:44.252557 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e9a85-3427-49e4-bd4e-335dc9a49aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:44.252830 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e9a85-3427-49e4-bd4e-335dc9a49aab admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:44.253711 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e9a85-3427-49e4-bd4e-335dc9a49aab admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:44.254010 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e9a85-3427-49e4-bd4e-335dc9a49aab admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:44.255945 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e9a85-3427-49e4-bd4e-335dc9a49aab admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:44.276766 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 461/916] 10.222.0.31 () {56 vars in 1170 bytes} [Thu Feb 10 20:46:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:44.282350 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438cb03-cd67-43e8-aa91-1843b79f7506 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:44.292714 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438cb03-cd67-43e8-aa91-1843b79f7506 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:44.297575 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4b090-f83a-424e-a2d1-e3f150a894c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:44.298430 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4b090-f83a-424e-a2d1-e3f150a894c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:44.298746 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4b090-f83a-424e-a2d1-e3f150a894c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:44.299010 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4b090-f83a-424e-a2d1-e3f150a894c1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:44.310461 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4b090-f83a-424e-a2d1-e3f150a894c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:44.312349 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4b090-f83a-424e-a2d1-e3f150a894c1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:44.330617 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-26b4b090-f83a-424e-a2d1-e3f150a894c1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:44.332940 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 456/917] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:44.338590 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e9a85-3427-49e4-bd4e-335dc9a49aab admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:44.348614 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e9a85-3427-49e4-bd4e-335dc9a49aab admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:44.353045 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeab33b-7415-4c6c-8afc-b9d17b03f9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:44.353733 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeab33b-7415-4c6c-8afc-b9d17b03f9da admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:44.354009 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeab33b-7415-4c6c-8afc-b9d17b03f9da admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:44.354275 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeab33b-7415-4c6c-8afc-b9d17b03f9da admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:44.355046 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeab33b-7415-4c6c-8afc-b9d17b03f9da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:44.355342 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeab33b-7415-4c6c-8afc-b9d17b03f9da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:44.356933 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeab33b-7415-4c6c-8afc-b9d17b03f9da admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:44.368942 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 462/918] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:44.374797 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4b090-f83a-424e-a2d1-e3f150a894c1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:44.384603 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4b090-f83a-424e-a2d1-e3f150a894c1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:44.389907 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d0fa2-e204-4bca-a57e-061d67b10147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:44.390690 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d0fa2-e204-4bca-a57e-061d67b10147 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:44.390961 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d0fa2-e204-4bca-a57e-061d67b10147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:44.391228 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d0fa2-e204-4bca-a57e-061d67b10147 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:44.398218 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d0fa2-e204-4bca-a57e-061d67b10147 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:44.400167 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d0fa2-e204-4bca-a57e-061d67b10147 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:44.413465 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-504d0fa2-e204-4bca-a57e-061d67b10147 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:44.414922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 457/919] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:44.420664 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeab33b-7415-4c6c-8afc-b9d17b03f9da admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:44.430446 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeab33b-7415-4c6c-8afc-b9d17b03f9da admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:44.435100 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108f4d0-9fa8-4b7e-af28-a345f832ceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:44.435795 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108f4d0-9fa8-4b7e-af28-a345f832ceb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:44.436072 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108f4d0-9fa8-4b7e-af28-a345f832ceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:44.436333 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108f4d0-9fa8-4b7e-af28-a345f832ceb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:44.437174 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108f4d0-9fa8-4b7e-af28-a345f832ceb4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:44.437509 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108f4d0-9fa8-4b7e-af28-a345f832ceb4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:44.439438 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108f4d0-9fa8-4b7e-af28-a345f832ceb4 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:44.452717 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 463/920] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:44.458943 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d0fa2-e204-4bca-a57e-061d67b10147 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:44.462894 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8ba40-2ab6-493f-8e9e-da3851e54c88 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:44.463177 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8ba40-2ab6-493f-8e9e-da3851e54c88 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:44.463449 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8ba40-2ab6-493f-8e9e-da3851e54c88 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:44.465562 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 464/921] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:44.470805 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfcecf-d1c3-4b60-8eaa-bd76281b9211 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:44.471084 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfcecf-d1c3-4b60-8eaa-bd76281b9211 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:44.471409 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfcecf-d1c3-4b60-8eaa-bd76281b9211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:44.472334 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d0fa2-e204-4bca-a57e-061d67b10147 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:44.477187 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fb229-f2a5-4aa1-bc27-aeb344a0c6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:44.478533 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fb229-f2a5-4aa1-bc27-aeb344a0c6ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:44.479949 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fb229-f2a5-4aa1-bc27-aeb344a0c6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:44.480429 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fb229-f2a5-4aa1-bc27-aeb344a0c6ed admin admin] PATH_INFO: `/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/de790a1a69994f7498834ded10480e7c/roles/7a87b44bd9ae4d0788eeb1ceb7897a47` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:44.482954 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fb229-f2a5-4aa1-bc27-aeb344a0c6ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f35ac6d668442a9ea0347f99eb2881, user_id=de790a1a69994f7498834ded10480e7c, role_id=7a87b44bd9ae4d0788eeb1ceb7897a47)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:44.486803 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fb229-f2a5-4aa1-bc27-aeb344a0c6ed admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:44.490551 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-0abfcecf-d1c3-4b60-8eaa-bd76281b9211 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:44.491691 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-0abfcecf-d1c3-4b60-8eaa-bd76281b9211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:44.504683 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 458/923] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:46:44 2022] PUT /identity/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/de790a1a69994f7498834ded10480e7c/roles/7a87b44bd9ae4d0788eeb1ceb7897a47 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:46:44.504849 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 465/923] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:44 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:46:44.524478 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfcecf-d1c3-4b60-8eaa-bd76281b9211 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:44.535379 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfcecf-d1c3-4b60-8eaa-bd76281b9211 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:44.597655 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5812e-ab0b-4c4d-9f49-3944a93e9767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:44.598332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5812e-ab0b-4c4d-9f49-3944a93e9767 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:44.598606 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5812e-ab0b-4c4d-9f49-3944a93e9767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:44.598872 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5812e-ab0b-4c4d-9f49-3944a93e9767 admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:44.599631 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5812e-ab0b-4c4d-9f49-3944a93e9767 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:44.601247 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5812e-ab0b-4c4d-9f49-3944a93e9767 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:44.625609 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 466/924] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 10 20:46:44 2022] POST /identity/v3/services => generated 241 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:46:45.077471 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a6d56-1aa3-4b30-9e8a-31769320493e None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:45.077992 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a6d56-1aa3-4b30-9e8a-31769320493e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:45.077992 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a6d56-1aa3-4b30-9e8a-31769320493e None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:45.080046 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 459/925] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:45.085529 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f3f44-a4e3-4787-89ea-f47688ad66a9 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:45.085909 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f3f44-a4e3-4787-89ea-f47688ad66a9 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:45.086070 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f3f44-a4e3-4787-89ea-f47688ad66a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:45.103735 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-395f3f44-a4e3-4787-89ea-f47688ad66a9 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:45.104942 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-395f3f44-a4e3-4787-89ea-f47688ad66a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:45.124999 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 467/926] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:45 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:45.147463 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a6d56-1aa3-4b30-9e8a-31769320493e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:45.159666 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a6d56-1aa3-4b30-9e8a-31769320493e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:45.163967 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35265fa6-b011-4a0c-a91c-e97609f88d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:45.164756 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35265fa6-b011-4a0c-a91c-e97609f88d91 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:45.165032 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35265fa6-b011-4a0c-a91c-e97609f88d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:45.165295 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35265fa6-b011-4a0c-a91c-e97609f88d91 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:45.166014 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35265fa6-b011-4a0c-a91c-e97609f88d91 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:45.167623 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35265fa6-b011-4a0c-a91c-e97609f88d91 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:45.178548 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-35265fa6-b011-4a0c-a91c-e97609f88d91 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 10 20:46:45.179936 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 460/927] 10.222.0.31 () {56 vars in 1153 bytes} [Thu Feb 10 20:46:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:45.185744 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f3f44-a4e3-4787-89ea-f47688ad66a9 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:45.195046 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f3f44-a4e3-4787-89ea-f47688ad66a9 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:45.199626 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650f3d2-4193-4ef5-b2dd-dfb834b946cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:45.200287 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650f3d2-4193-4ef5-b2dd-dfb834b946cf admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:45.200564 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650f3d2-4193-4ef5-b2dd-dfb834b946cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:45.200834 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650f3d2-4193-4ef5-b2dd-dfb834b946cf admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:45.201582 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650f3d2-4193-4ef5-b2dd-dfb834b946cf admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:45.201882 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650f3d2-4193-4ef5-b2dd-dfb834b946cf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:45.203472 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650f3d2-4193-4ef5-b2dd-dfb834b946cf admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:45.208648 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 468/928] 10.222.0.31 () {56 vars in 1147 bytes} [Thu Feb 10 20:46:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:45.214218 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35265fa6-b011-4a0c-a91c-e97609f88d91 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:45.223968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35265fa6-b011-4a0c-a91c-e97609f88d91 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:45.228461 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a1247-c4e5-45ef-ad80-2e778501c965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:45.229106 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a1247-c4e5-45ef-ad80-2e778501c965 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:45.229411 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a1247-c4e5-45ef-ad80-2e778501c965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:45.229685 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a1247-c4e5-45ef-ad80-2e778501c965 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:45.230438 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a1247-c4e5-45ef-ad80-2e778501c965 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:45.230734 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a1247-c4e5-45ef-ad80-2e778501c965 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:45.232313 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a1247-c4e5-45ef-ad80-2e778501c965 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:45.241484 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 461/929] 10.222.0.31 () {56 vars in 1147 bytes} [Thu Feb 10 20:46:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:45.243093 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650f3d2-4193-4ef5-b2dd-dfb834b946cf admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:45.253171 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650f3d2-4193-4ef5-b2dd-dfb834b946cf admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:45.257823 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a5fe1-211a-4cc4-a527-226966fb494f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:45.258521 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a5fe1-211a-4cc4-a527-226966fb494f admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:45.258798 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a5fe1-211a-4cc4-a527-226966fb494f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:45.259108 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a5fe1-211a-4cc4-a527-226966fb494f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:45.259913 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a5fe1-211a-4cc4-a527-226966fb494f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:45.260932 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING py.warnings [None req-af4a5fe1-211a-4cc4-a527-226966fb494f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:46:45.260932 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: warnings.warn(msg) Feb 10 20:46:45.260932 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: Feb 10 20:46:45.261919 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a5fe1-211a-4cc4-a527-226966fb494f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:45.283694 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 469/930] 10.222.0.31 () {60 vars in 1165 bytes} [Thu Feb 10 20:46:45 2022] POST /identity/v3/endpoints => generated 347 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:46:46.469130 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338ab96-29f2-4e22-bdc7-3d2538ab3a2a None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:46.469887 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338ab96-29f2-4e22-bdc7-3d2538ab3a2a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:46.469887 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338ab96-29f2-4e22-bdc7-3d2538ab3a2a None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:46.471673 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 462/931] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:46.477297 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26ec68-d2b6-4736-b8ed-a07476ac345b None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:46.477779 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26ec68-d2b6-4736-b8ed-a07476ac345b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:46.477958 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26ec68-d2b6-4736-b8ed-a07476ac345b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:46.495947 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-4a26ec68-d2b6-4736-b8ed-a07476ac345b None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:46.497252 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4a26ec68-d2b6-4736-b8ed-a07476ac345b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:46.516153 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 470/932] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:46 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:46.549336 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338ab96-29f2-4e22-bdc7-3d2538ab3a2a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:46.561451 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338ab96-29f2-4e22-bdc7-3d2538ab3a2a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:46.565775 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f36218-2e24-47c6-8985-be53af69d18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:46.566554 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f36218-2e24-47c6-8985-be53af69d18a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:46.566827 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f36218-2e24-47c6-8985-be53af69d18a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:46.567087 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f36218-2e24-47c6-8985-be53af69d18a admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:46.568118 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f36218-2e24-47c6-8985-be53af69d18a admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:46.569716 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f36218-2e24-47c6-8985-be53af69d18a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:46.580591 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-63f36218-2e24-47c6-8985-be53af69d18a admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 10 20:46:46.582174 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 463/933] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 10 20:46:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:46.588178 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26ec68-d2b6-4736-b8ed-a07476ac345b None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:46.599664 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26ec68-d2b6-4736-b8ed-a07476ac345b None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:46.604760 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8597d6-cf0b-4149-9d5f-8f1f804920d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:46.605878 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8597d6-cf0b-4149-9d5f-8f1f804920d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:46.606329 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8597d6-cf0b-4149-9d5f-8f1f804920d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:46.606765 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8597d6-cf0b-4149-9d5f-8f1f804920d8 admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:46.607693 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8597d6-cf0b-4149-9d5f-8f1f804920d8 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:46.608172 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8597d6-cf0b-4149-9d5f-8f1f804920d8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:46.610037 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8597d6-cf0b-4149-9d5f-8f1f804920d8 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:46.620583 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 471/934] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 10 20:46:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:46.622414 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f36218-2e24-47c6-8985-be53af69d18a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:46.632406 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f36218-2e24-47c6-8985-be53af69d18a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:46.637388 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af244b-a018-45e0-ac4f-212165d40913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:46.638247 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af244b-a018-45e0-ac4f-212165d40913 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:46.638686 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af244b-a018-45e0-ac4f-212165d40913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:46.639148 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af244b-a018-45e0-ac4f-212165d40913 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:46.640025 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af244b-a018-45e0-ac4f-212165d40913 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:46.640486 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af244b-a018-45e0-ac4f-212165d40913 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:46.642259 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af244b-a018-45e0-ac4f-212165d40913 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:46.652122 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 464/935] 10.222.0.31 () {56 vars in 1135 bytes} [Thu Feb 10 20:46:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:46.654621 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8597d6-cf0b-4149-9d5f-8f1f804920d8 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:46.664478 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8597d6-cf0b-4149-9d5f-8f1f804920d8 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:46.669842 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b332140-d32d-493e-b10c-59e09be3750c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:46.670684 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b332140-d32d-493e-b10c-59e09be3750c admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:46.671130 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b332140-d32d-493e-b10c-59e09be3750c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:46.671588 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b332140-d32d-493e-b10c-59e09be3750c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:46.672489 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b332140-d32d-493e-b10c-59e09be3750c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:46.674245 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b332140-d32d-493e-b10c-59e09be3750c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:46.698897 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 472/936] 10.222.0.31 () {60 vars in 1165 bytes} [Thu Feb 10 20:46:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:46:46.803931 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e8f5a-a588-4163-81fa-ff7582d7270e None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:46.804103 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e8f5a-a588-4163-81fa-ff7582d7270e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:46.804375 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e8f5a-a588-4163-81fa-ff7582d7270e None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:46.806491 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 465/937] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:46.815282 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24f6d5-b526-4471-ba39-4cfd2853bbbd None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:46.815719 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24f6d5-b526-4471-ba39-4cfd2853bbbd None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:46.816087 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24f6d5-b526-4471-ba39-4cfd2853bbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:46.835234 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-fc24f6d5-b526-4471-ba39-4cfd2853bbbd None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:46.836465 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-fc24f6d5-b526-4471-ba39-4cfd2853bbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:46.854509 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 473/938] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:46 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:46.879021 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e8f5a-a588-4163-81fa-ff7582d7270e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:46.888106 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3fa33-3574-40b1-94cb-73416d5b81e6 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:46.888395 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3fa33-3574-40b1-94cb-73416d5b81e6 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:46.888672 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3fa33-3574-40b1-94cb-73416d5b81e6 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:46.890659 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 474/939] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:46:46.892363 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e8f5a-a588-4163-81fa-ff7582d7270e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:46.895834 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d6793-c385-470f-b555-08c9cd8dd40e None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:46.896115 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d6793-c385-470f-b555-08c9cd8dd40e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:46.896395 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d6793-c385-470f-b555-08c9cd8dd40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:46.898307 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd9d84-347f-40d2-96e5-62d3b6722dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:46.899343 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd9d84-347f-40d2-96e5-62d3b6722dad admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:46.899808 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd9d84-347f-40d2-96e5-62d3b6722dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:46.900324 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd9d84-347f-40d2-96e5-62d3b6722dad admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:46.911513 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd9d84-347f-40d2-96e5-62d3b6722dad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:46.915259 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-5d3d6793-c385-470f-b555-08c9cd8dd40e None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:46.916437 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-5d3d6793-c385-470f-b555-08c9cd8dd40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:46.919605 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-b1bd9d84-347f-40d2-96e5-62d3b6722dad admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 10 20:46:46.921205 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 466/940] 10.222.0.31 () {56 vars in 1141 bytes} [Thu Feb 10 20:46:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:46.924605 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 475/941] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:46 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:46:46.926949 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd9d84-347f-40d2-96e5-62d3b6722dad admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:46.938478 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd9d84-347f-40d2-96e5-62d3b6722dad admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:46.945476 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763434b-d58f-49c9-8d1e-71af14e658fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:46.946356 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763434b-d58f-49c9-8d1e-71af14e658fb admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:46.946801 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763434b-d58f-49c9-8d1e-71af14e658fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:46.947234 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763434b-d58f-49c9-8d1e-71af14e658fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:46.947807 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d6793-c385-470f-b555-08c9cd8dd40e None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:46.948337 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763434b-d58f-49c9-8d1e-71af14e658fb admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:46.948825 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763434b-d58f-49c9-8d1e-71af14e658fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:46.950604 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763434b-d58f-49c9-8d1e-71af14e658fb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:46.959310 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d6793-c385-470f-b555-08c9cd8dd40e None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:46.960316 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 467/942] 10.222.0.31 () {56 vars in 1136 bytes} [Thu Feb 10 20:46:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:46.966128 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763434b-d58f-49c9-8d1e-71af14e658fb admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:46.966616 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fba286-f648-48e5-a7d8-a472dd608713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:46.967668 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fba286-f648-48e5-a7d8-a472dd608713 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:46.967943 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fba286-f648-48e5-a7d8-a472dd608713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:46.968209 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fba286-f648-48e5-a7d8-a472dd608713 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:46.968918 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fba286-f648-48e5-a7d8-a472dd608713 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:46.970601 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fba286-f648-48e5-a7d8-a472dd608713 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:46.977005 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763434b-d58f-49c9-8d1e-71af14e658fb admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:46.981789 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cda31a-447c-4854-ad51-603f677a0bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:46.982742 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cda31a-447c-4854-ad51-603f677a0bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:46.983102 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-81fba286-f648-48e5-a7d8-a472dd608713 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 10 20:46:46.983318 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cda31a-447c-4854-ad51-603f677a0bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:46.983724 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cda31a-447c-4854-ad51-603f677a0bd2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:46.984640 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 476/943] 10.222.0.31 () {56 vars in 1147 bytes} [Thu Feb 10 20:46:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:46.990289 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fba286-f648-48e5-a7d8-a472dd608713 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:46.995681 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cda31a-447c-4854-ad51-603f677a0bd2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:46.997832 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cda31a-447c-4854-ad51-603f677a0bd2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:46.999870 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fba286-f648-48e5-a7d8-a472dd608713 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:47.004576 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2980d-d5b0-4a96-8cc3-6a24bd2dc417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:47.005228 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2980d-d5b0-4a96-8cc3-6a24bd2dc417 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:47.005547 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2980d-d5b0-4a96-8cc3-6a24bd2dc417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:47.005822 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2980d-d5b0-4a96-8cc3-6a24bd2dc417 admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:47.006713 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2980d-d5b0-4a96-8cc3-6a24bd2dc417 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:47.006821 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2980d-d5b0-4a96-8cc3-6a24bd2dc417 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:47.008534 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2980d-d5b0-4a96-8cc3-6a24bd2dc417 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:47.016994 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-d7cda31a-447c-4854-ad51-603f677a0bd2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:47.017701 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 477/944] 10.222.0.31 () {56 vars in 1143 bytes} [Thu Feb 10 20:46:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:47.018983 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 468/945] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:47.021398 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2980d-d5b0-4a96-8cc3-6a24bd2dc417 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:47.024524 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cda31a-447c-4854-ad51-603f677a0bd2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:47.033092 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2980d-d5b0-4a96-8cc3-6a24bd2dc417 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:47.034224 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cda31a-447c-4854-ad51-603f677a0bd2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:47.038570 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fdbb7-b2bf-4856-816c-07f727c2e32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:47.038969 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92821c6-874b-41e5-bc6d-0a2193a9f913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:47.039604 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fdbb7-b2bf-4856-816c-07f727c2e32f admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:47.039794 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92821c6-874b-41e5-bc6d-0a2193a9f913 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:47.040164 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92821c6-874b-41e5-bc6d-0a2193a9f913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:47.040339 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fdbb7-b2bf-4856-816c-07f727c2e32f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:47.040608 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92821c6-874b-41e5-bc6d-0a2193a9f913 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:47.040906 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fdbb7-b2bf-4856-816c-07f727c2e32f admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:47.041560 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92821c6-874b-41e5-bc6d-0a2193a9f913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:47.041952 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92821c6-874b-41e5-bc6d-0a2193a9f913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:47.042129 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549fdbb7-b2bf-4856-816c-07f727c2e32f admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:47.042562 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549fdbb7-b2bf-4856-816c-07f727c2e32f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:47.043873 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92821c6-874b-41e5-bc6d-0a2193a9f913 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:47.044564 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549fdbb7-b2bf-4856-816c-07f727c2e32f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:47.050370 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 478/946] 10.222.0.31 () {56 vars in 1143 bytes} [Thu Feb 10 20:46:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:47.056284 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 469/947] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:47.056525 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fdbb7-b2bf-4856-816c-07f727c2e32f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:47.061660 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92821c6-874b-41e5-bc6d-0a2193a9f913 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:47.070529 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fdbb7-b2bf-4856-816c-07f727c2e32f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:47.071631 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92821c6-874b-41e5-bc6d-0a2193a9f913 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:47.075927 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69e312-5d9b-47d9-9633-9cc539e9eda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:47.076872 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69e312-5d9b-47d9-9633-9cc539e9eda5 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:47.077294 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69e312-5d9b-47d9-9633-9cc539e9eda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:47.077506 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05530819-219e-46d2-965f-6027ef000d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:47.077955 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69e312-5d9b-47d9-9633-9cc539e9eda5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:47.078825 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05530819-219e-46d2-965f-6027ef000d9e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:47.079048 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69e312-5d9b-47d9-9633-9cc539e9eda5 admin admin] RBAC: Adding query filter params (interface=public, service_id=f8929d4beccb4f32b7d4b63258f243c3, region_id=RegionOne) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:47.079280 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05530819-219e-46d2-965f-6027ef000d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:47.079650 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05530819-219e-46d2-965f-6027ef000d9e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:47.079869 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69e312-5d9b-47d9-9633-9cc539e9eda5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:47.081864 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69e312-5d9b-47d9-9633-9cc539e9eda5 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:47.087888 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 479/948] 10.222.0.31 () {56 vars in 1272 bytes} [Thu Feb 10 20:46:47 2022] GET /identity/v3/endpoints?service_id=f8929d4beccb4f32b7d4b63258f243c3&interface=public®ion_id=RegionOne => generated 194 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:47.092505 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05530819-219e-46d2-965f-6027ef000d9e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:47.092505 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05530819-219e-46d2-965f-6027ef000d9e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:47.093748 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69e312-5d9b-47d9-9633-9cc539e9eda5 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:47.103961 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69e312-5d9b-47d9-9633-9cc539e9eda5 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:47.106922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-05530819-219e-46d2-965f-6027ef000d9e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 10 20:46:47.108552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 470/949] 10.222.0.31 () {56 vars in 1138 bytes} [Thu Feb 10 20:46:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:47.109298 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e108e1-bc3a-4440-8637-b0e0bcf6c6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:47.110165 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e108e1-bc3a-4440-8637-b0e0bcf6c6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:47.110570 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e108e1-bc3a-4440-8637-b0e0bcf6c6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:47.110962 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e108e1-bc3a-4440-8637-b0e0bcf6c6e4 admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:47.111820 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e108e1-bc3a-4440-8637-b0e0bcf6c6e4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:47.113654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e108e1-bc3a-4440-8637-b0e0bcf6c6e4 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:47.114289 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05530819-219e-46d2-965f-6027ef000d9e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:47.120955 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 480/950] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 10 20:46:47 2022] GET /identity/v3/services => generated 1497 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:46:47.129578 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05530819-219e-46d2-965f-6027ef000d9e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:47.139015 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c543f-db97-44ec-9b9f-05d052f03279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:47.139737 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c543f-db97-44ec-9b9f-05d052f03279 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:47.139985 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c543f-db97-44ec-9b9f-05d052f03279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:47.140248 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c543f-db97-44ec-9b9f-05d052f03279 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:47.141108 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c543f-db97-44ec-9b9f-05d052f03279 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:47.141439 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c543f-db97-44ec-9b9f-05d052f03279 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:47.143344 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c543f-db97-44ec-9b9f-05d052f03279 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:47.163953 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 471/951] 10.222.0.31 () {56 vars in 1170 bytes} [Thu Feb 10 20:46:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:47.169966 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e108e1-bc3a-4440-8637-b0e0bcf6c6e4 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:47.179982 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e108e1-bc3a-4440-8637-b0e0bcf6c6e4 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:47.184754 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4174fa7-95f2-4d40-b4f8-d2f2b76ab8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:47.185457 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4174fa7-95f2-4d40-b4f8-d2f2b76ab8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:47.185738 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4174fa7-95f2-4d40-b4f8-d2f2b76ab8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:47.186008 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4174fa7-95f2-4d40-b4f8-d2f2b76ab8c7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:47.195218 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4174fa7-95f2-4d40-b4f8-d2f2b76ab8c7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:47.196996 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4174fa7-95f2-4d40-b4f8-d2f2b76ab8c7 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:47.207436 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 481/952] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:47 2022] GET /identity/v3/auth/tokens => generated 2138 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:46:47.213275 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c543f-db97-44ec-9b9f-05d052f03279 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:47.223600 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c543f-db97-44ec-9b9f-05d052f03279 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:47.228384 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b98486-df40-40b7-b96e-7d4be7cf47b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:47.229194 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b98486-df40-40b7-b96e-7d4be7cf47b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:47.229577 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b98486-df40-40b7-b96e-7d4be7cf47b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:47.229831 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b98486-df40-40b7-b96e-7d4be7cf47b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:47.241220 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b98486-df40-40b7-b96e-7d4be7cf47b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:47.243098 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b98486-df40-40b7-b96e-7d4be7cf47b1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:47.261178 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-40b98486-df40-40b7-b96e-7d4be7cf47b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:47.262928 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 472/953] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:47.268680 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4174fa7-95f2-4d40-b4f8-d2f2b76ab8c7 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:47.278560 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4174fa7-95f2-4d40-b4f8-d2f2b76ab8c7 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:47.283429 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff009e9-0f07-4f1c-8347-c1e35afacbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:47.284113 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff009e9-0f07-4f1c-8347-c1e35afacbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:47.284391 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff009e9-0f07-4f1c-8347-c1e35afacbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:47.284664 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff009e9-0f07-4f1c-8347-c1e35afacbb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:47.285457 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff009e9-0f07-4f1c-8347-c1e35afacbb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:47.285765 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff009e9-0f07-4f1c-8347-c1e35afacbb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:47.287429 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff009e9-0f07-4f1c-8347-c1e35afacbb4 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:47.301589 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 482/954] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:47.307545 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b98486-df40-40b7-b96e-7d4be7cf47b1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:47.317716 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b98486-df40-40b7-b96e-7d4be7cf47b1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:47.323845 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a072c7d-456b-48c1-bda0-4ce1816ab67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:47.324652 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a072c7d-456b-48c1-bda0-4ce1816ab67c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:47.324980 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a072c7d-456b-48c1-bda0-4ce1816ab67c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:47.325260 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a072c7d-456b-48c1-bda0-4ce1816ab67c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:47.332552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a072c7d-456b-48c1-bda0-4ce1816ab67c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:47.334581 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a072c7d-456b-48c1-bda0-4ce1816ab67c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:47.347228 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-0a072c7d-456b-48c1-bda0-4ce1816ab67c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:47.348699 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 473/955] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:47.354454 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff009e9-0f07-4f1c-8347-c1e35afacbb4 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:47.364314 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff009e9-0f07-4f1c-8347-c1e35afacbb4 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:47.368811 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec4fe3-df5f-4fc5-8c06-f2684f42c3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:47.369486 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec4fe3-df5f-4fc5-8c06-f2684f42c3bc admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:47.369766 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec4fe3-df5f-4fc5-8c06-f2684f42c3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:47.370036 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec4fe3-df5f-4fc5-8c06-f2684f42c3bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:47.370824 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec4fe3-df5f-4fc5-8c06-f2684f42c3bc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:47.371125 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec4fe3-df5f-4fc5-8c06-f2684f42c3bc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:47.373043 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec4fe3-df5f-4fc5-8c06-f2684f42c3bc admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:47.385285 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 483/956] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:47.391729 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a072c7d-456b-48c1-bda0-4ce1816ab67c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:47.402135 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a072c7d-456b-48c1-bda0-4ce1816ab67c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:47.406931 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8499ace-62c2-43fe-91dd-593cfb086fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:47.407785 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8499ace-62c2-43fe-91dd-593cfb086fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:47.408205 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8499ace-62c2-43fe-91dd-593cfb086fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:47.408614 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8499ace-62c2-43fe-91dd-593cfb086fc5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:47.409637 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8499ace-62c2-43fe-91dd-593cfb086fc5 admin admin] RBAC: Adding query filter params (role.id=7a87b44bd9ae4d0788eeb1ceb7897a47, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=de790a1a69994f7498834ded10480e7c) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:47.410087 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8499ace-62c2-43fe-91dd-593cfb086fc5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:47.412086 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8499ace-62c2-43fe-91dd-593cfb086fc5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:47.419080 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 474/957] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:46:47 2022] GET /identity/v3/role_assignments?user.id=de790a1a69994f7498834ded10480e7c&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=7a87b44bd9ae4d0788eeb1ceb7897a47 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:47.578639 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7ff14-e583-4308-84ff-ec3373a50fa6 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:47.579141 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7ff14-e583-4308-84ff-ec3373a50fa6 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:47.579141 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7ff14-e583-4308-84ff-ec3373a50fa6 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:47.581253 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 484/958] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:47.587119 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21be37-50de-4db2-b16c-3878867bdce3 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:47.587617 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21be37-50de-4db2-b16c-3878867bdce3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:47.587702 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21be37-50de-4db2-b16c-3878867bdce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:47.608054 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-0a21be37-50de-4db2-b16c-3878867bdce3 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:47.609236 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0a21be37-50de-4db2-b16c-3878867bdce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:47.618394 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 475/959] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:47 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:47.640049 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7ff14-e583-4308-84ff-ec3373a50fa6 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:47.654227 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7ff14-e583-4308-84ff-ec3373a50fa6 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:47.658636 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b190a4-e2c4-4da7-9a09-9404270f298e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:47.659424 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b190a4-e2c4-4da7-9a09-9404270f298e admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:47.659704 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b190a4-e2c4-4da7-9a09-9404270f298e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:47.659973 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b190a4-e2c4-4da7-9a09-9404270f298e admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:47.660645 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b190a4-e2c4-4da7-9a09-9404270f298e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:47.662304 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b190a4-e2c4-4da7-9a09-9404270f298e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:47.674160 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-69b190a4-e2c4-4da7-9a09-9404270f298e admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 10 20:46:47.675655 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 485/960] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:47.681848 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21be37-50de-4db2-b16c-3878867bdce3 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:47.691153 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21be37-50de-4db2-b16c-3878867bdce3 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:47.696328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c065b0-7708-49e0-b5db-b76f883ba117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:47.697174 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c065b0-7708-49e0-b5db-b76f883ba117 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:47.697618 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c065b0-7708-49e0-b5db-b76f883ba117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:47.698029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c065b0-7708-49e0-b5db-b76f883ba117 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:47.698952 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c065b0-7708-49e0-b5db-b76f883ba117 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:47.699416 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c065b0-7708-49e0-b5db-b76f883ba117 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:47.701204 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c065b0-7708-49e0-b5db-b76f883ba117 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:47.706245 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 476/961] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 10 20:46:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:47.712106 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b190a4-e2c4-4da7-9a09-9404270f298e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:47.722401 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b190a4-e2c4-4da7-9a09-9404270f298e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:47.727248 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba3ff5-af8e-4aa8-9d8d-a0380946ec07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:47.728122 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba3ff5-af8e-4aa8-9d8d-a0380946ec07 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:47.728553 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba3ff5-af8e-4aa8-9d8d-a0380946ec07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:47.728963 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba3ff5-af8e-4aa8-9d8d-a0380946ec07 admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:47.729882 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba3ff5-af8e-4aa8-9d8d-a0380946ec07 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:47.730346 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba3ff5-af8e-4aa8-9d8d-a0380946ec07 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:47.732209 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba3ff5-af8e-4aa8-9d8d-a0380946ec07 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:47.736984 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 486/962] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 10 20:46:47 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:49.007678 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5f7f1-ad2b-4746-b3c4-d2751259879b None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:49.008200 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5f7f1-ad2b-4746-b3c4-d2751259879b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:49.008200 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5f7f1-ad2b-4746-b3c4-d2751259879b None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:49.010254 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 477/963] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:49.015779 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720863e-c530-4a70-af52-0487b16935bb None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:49.016179 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720863e-c530-4a70-af52-0487b16935bb None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:49.016342 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720863e-c530-4a70-af52-0487b16935bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:49.034549 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-d720863e-c530-4a70-af52-0487b16935bb None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:49.035724 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d720863e-c530-4a70-af52-0487b16935bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:49.043673 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 487/964] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:49 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:49.067153 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5f7f1-ad2b-4746-b3c4-d2751259879b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:49.079866 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5f7f1-ad2b-4746-b3c4-d2751259879b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:49.084297 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8b7f8-8259-450e-87a1-51b70090ce1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:49.084943 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8b7f8-8259-450e-87a1-51b70090ce1c admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:49.085220 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8b7f8-8259-450e-87a1-51b70090ce1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:49.085519 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8b7f8-8259-450e-87a1-51b70090ce1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:49.086244 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8b7f8-8259-450e-87a1-51b70090ce1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:49.088068 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8b7f8-8259-450e-87a1-51b70090ce1c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:49.089455 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.common [None req-32b8b7f8-8259-450e-87a1-51b70090ce1c admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 10 20:46:49.110248 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.sql.core [None req-32b8b7f8-8259-450e-87a1-51b70090ce1c admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 10 20:46:49.110248 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 10 20:46:49.110248 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [parameters: {'id': '60588ff5c27148c28613464c4ba987b9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 10 20:46:49.110248 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79128) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 10 20:46:49.116956 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-32b8b7f8-8259-450e-87a1-51b70090ce1c admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 60588ff5c27148c28613464c4ba987b9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 60588ff5c27148c28613464c4ba987b9. Feb 10 20:46:49.118653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 478/965] 10.222.0.31 () {60 vars in 1161 bytes} [Thu Feb 10 20:46:49 2022] POST /identity/v3/projects => generated 262 bytes in 52 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:49.124688 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720863e-c530-4a70-af52-0487b16935bb None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:49.134303 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720863e-c530-4a70-af52-0487b16935bb None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:49.140129 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6073b0-7050-409a-8c9f-a2e146c4a425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:49.140986 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6073b0-7050-409a-8c9f-a2e146c4a425 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:49.141270 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6073b0-7050-409a-8c9f-a2e146c4a425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:49.141572 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6073b0-7050-409a-8c9f-a2e146c4a425 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:49.149703 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6073b0-7050-409a-8c9f-a2e146c4a425 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:49.151814 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6073b0-7050-409a-8c9f-a2e146c4a425 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:49.165906 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-9b6073b0-7050-409a-8c9f-a2e146c4a425 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:49.167506 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 488/966] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:49.173648 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8b7f8-8259-450e-87a1-51b70090ce1c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:49.184693 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8b7f8-8259-450e-87a1-51b70090ce1c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:49.189348 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1fbda-3a13-41c3-984b-63dbf82833cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:49.190008 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1fbda-3a13-41c3-984b-63dbf82833cc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:49.190291 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1fbda-3a13-41c3-984b-63dbf82833cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:49.190552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1fbda-3a13-41c3-984b-63dbf82833cc admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:49.191362 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be1fbda-3a13-41c3-984b-63dbf82833cc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:49.191976 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be1fbda-3a13-41c3-984b-63dbf82833cc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:49.193777 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be1fbda-3a13-41c3-984b-63dbf82833cc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:49.214875 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 479/967] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 10 20:46:49 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:49.412432 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf73215-881c-4509-9ef3-11ccf0ef523b None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:49.412745 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf73215-881c-4509-9ef3-11ccf0ef523b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:49.412914 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf73215-881c-4509-9ef3-11ccf0ef523b None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:49.414938 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 489/968] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:49.420450 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7970a7a-bb09-4889-aff2-03116f0bef25 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:49.420737 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7970a7a-bb09-4889-aff2-03116f0bef25 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:49.421004 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7970a7a-bb09-4889-aff2-03116f0bef25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:49.439549 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-b7970a7a-bb09-4889-aff2-03116f0bef25 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:49.441046 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b7970a7a-bb09-4889-aff2-03116f0bef25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:49.449700 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 480/969] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:49 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:49.474298 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf73215-881c-4509-9ef3-11ccf0ef523b None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:49.490022 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf73215-881c-4509-9ef3-11ccf0ef523b None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:49.495668 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8960e-7703-4317-a068-04d4da813165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:49.496561 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8960e-7703-4317-a068-04d4da813165 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:49.496861 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8960e-7703-4317-a068-04d4da813165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:49.497101 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8960e-7703-4317-a068-04d4da813165 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:49.498173 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8960e-7703-4317-a068-04d4da813165 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:49.499861 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8960e-7703-4317-a068-04d4da813165 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:49.513854 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-01c8960e-7703-4317-a068-04d4da813165 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 10 20:46:49.515389 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 490/970] 10.222.0.31 () {56 vars in 1147 bytes} [Thu Feb 10 20:46:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:49.521407 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7970a7a-bb09-4889-aff2-03116f0bef25 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:49.531080 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7970a7a-bb09-4889-aff2-03116f0bef25 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:49.538356 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24730a-10b3-46f9-9ec4-36e9b2ba5b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:49.539273 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24730a-10b3-46f9-9ec4-36e9b2ba5b5a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:49.539745 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24730a-10b3-46f9-9ec4-36e9b2ba5b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:49.540204 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24730a-10b3-46f9-9ec4-36e9b2ba5b5a admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:49.541128 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24730a-10b3-46f9-9ec4-36e9b2ba5b5a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:49.541659 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24730a-10b3-46f9-9ec4-36e9b2ba5b5a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:49.543445 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24730a-10b3-46f9-9ec4-36e9b2ba5b5a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:49.550026 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 481/971] 10.222.0.31 () {56 vars in 1143 bytes} [Thu Feb 10 20:46:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:49.555857 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8960e-7703-4317-a068-04d4da813165 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:49.565921 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8960e-7703-4317-a068-04d4da813165 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:49.571052 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774358b3-5b6f-49be-aba4-b03d4e85d714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:49.571961 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774358b3-5b6f-49be-aba4-b03d4e85d714 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:49.572432 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774358b3-5b6f-49be-aba4-b03d4e85d714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:49.572920 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774358b3-5b6f-49be-aba4-b03d4e85d714 admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:49.573858 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774358b3-5b6f-49be-aba4-b03d4e85d714 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:49.574365 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774358b3-5b6f-49be-aba4-b03d4e85d714 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:49.576213 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774358b3-5b6f-49be-aba4-b03d4e85d714 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:49.582091 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 491/972] 10.222.0.31 () {56 vars in 1143 bytes} [Thu Feb 10 20:46:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:49.588021 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24730a-10b3-46f9-9ec4-36e9b2ba5b5a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:49.598228 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24730a-10b3-46f9-9ec4-36e9b2ba5b5a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:49.603031 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb9ec1-9e67-4e83-a333-d7f6158ded3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:49.603911 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb9ec1-9e67-4e83-a333-d7f6158ded3e admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:49.604384 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb9ec1-9e67-4e83-a333-d7f6158ded3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:49.604870 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb9ec1-9e67-4e83-a333-d7f6158ded3e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:49.605872 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb9ec1-9e67-4e83-a333-d7f6158ded3e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:49.607701 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb9ec1-9e67-4e83-a333-d7f6158ded3e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:49.630780 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 482/973] 10.222.0.31 () {60 vars in 1165 bytes} [Thu Feb 10 20:46:49 2022] POST /identity/v3/endpoints => generated 349 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:46:49.739895 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824a26b-18f8-47ff-8978-822b21e1f6b9 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:49.740201 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824a26b-18f8-47ff-8978-822b21e1f6b9 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:49.740444 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824a26b-18f8-47ff-8978-822b21e1f6b9 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:49.742567 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 492/974] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:49.748385 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739c2b9-dffa-474f-b00d-39d9ed03a66c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:49.748664 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739c2b9-dffa-474f-b00d-39d9ed03a66c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:49.748940 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739c2b9-dffa-474f-b00d-39d9ed03a66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:49.769139 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-9739c2b9-dffa-474f-b00d-39d9ed03a66c None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:49.770408 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9739c2b9-dffa-474f-b00d-39d9ed03a66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:49.790138 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 483/975] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:49 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:49.813343 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824a26b-18f8-47ff-8978-822b21e1f6b9 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:49.826989 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824a26b-18f8-47ff-8978-822b21e1f6b9 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:49.834007 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441330f2-0550-40d0-93b2-2d5f16569544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:49.834794 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441330f2-0550-40d0-93b2-2d5f16569544 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:49.835070 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441330f2-0550-40d0-93b2-2d5f16569544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:49.835351 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441330f2-0550-40d0-93b2-2d5f16569544 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:49.836054 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441330f2-0550-40d0-93b2-2d5f16569544 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:49.837766 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441330f2-0550-40d0-93b2-2d5f16569544 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:49.848449 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-441330f2-0550-40d0-93b2-2d5f16569544 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 10 20:46:49.849943 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 493/976] 10.222.0.31 () {56 vars in 1126 bytes} [Thu Feb 10 20:46:49 2022] GET /identity/v3/services/image => generated 86 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:49.856107 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739c2b9-dffa-474f-b00d-39d9ed03a66c None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:49.865593 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739c2b9-dffa-474f-b00d-39d9ed03a66c None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:49.872258 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ae3d7-9b6a-43e5-9e83-fa53104ac821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:49.872927 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ae3d7-9b6a-43e5-9e83-fa53104ac821 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:49.873236 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ae3d7-9b6a-43e5-9e83-fa53104ac821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:49.873544 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ae3d7-9b6a-43e5-9e83-fa53104ac821 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:49.874281 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ae3d7-9b6a-43e5-9e83-fa53104ac821 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:49.874580 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ae3d7-9b6a-43e5-9e83-fa53104ac821 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:49.876178 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ae3d7-9b6a-43e5-9e83-fa53104ac821 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:49.882382 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 484/977] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:49.888039 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441330f2-0550-40d0-93b2-2d5f16569544 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:49.898145 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441330f2-0550-40d0-93b2-2d5f16569544 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:49.902826 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad13b08-8808-4cd3-8e6a-5bf4192fb9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:49.903640 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad13b08-8808-4cd3-8e6a-5bf4192fb9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:49.904058 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad13b08-8808-4cd3-8e6a-5bf4192fb9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:49.904496 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad13b08-8808-4cd3-8e6a-5bf4192fb9f2 admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:49.905393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad13b08-8808-4cd3-8e6a-5bf4192fb9f2 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:49.905832 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad13b08-8808-4cd3-8e6a-5bf4192fb9f2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:49.907568 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad13b08-8808-4cd3-8e6a-5bf4192fb9f2 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:49.912737 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 494/978] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:50.078948 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c216c-263f-4e3d-8f27-82d7a6b6b5cb None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:50.078948 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c216c-263f-4e3d-8f27-82d7a6b6b5cb None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:50.079565 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c216c-263f-4e3d-8f27-82d7a6b6b5cb None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:50.081620 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 485/979] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:50.087861 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef355a-81f0-40fe-91fd-774345cd9163 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:50.088304 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef355a-81f0-40fe-91fd-774345cd9163 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:50.088407 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef355a-81f0-40fe-91fd-774345cd9163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:50.107011 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-94ef355a-81f0-40fe-91fd-774345cd9163 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:50.108254 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-94ef355a-81f0-40fe-91fd-774345cd9163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:50.116715 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 495/980] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:50 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:50.140501 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c216c-263f-4e3d-8f27-82d7a6b6b5cb None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:50.153504 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c216c-263f-4e3d-8f27-82d7a6b6b5cb None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:50.158309 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b8161-91d5-4188-aa98-60aa3d785fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:50.159227 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b8161-91d5-4188-aa98-60aa3d785fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:50.159769 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b8161-91d5-4188-aa98-60aa3d785fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:50.160232 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b8161-91d5-4188-aa98-60aa3d785fc5 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:50.161191 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b8161-91d5-4188-aa98-60aa3d785fc5 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:50.163020 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b8161-91d5-4188-aa98-60aa3d785fc5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:50.181712 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 486/981] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 10 20:46:50 2022] POST /identity/v3/services => generated 242 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:46:51.519269 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ded6e-9b75-4aaf-b966-32631c287e66 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:51.519846 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ded6e-9b75-4aaf-b966-32631c287e66 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:51.519846 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ded6e-9b75-4aaf-b966-32631c287e66 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:51.521719 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 496/982] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:51.529804 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8943a69-eeb2-4d3a-a638-36f2e71c69c6 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:51.530722 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8943a69-eeb2-4d3a-a638-36f2e71c69c6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:51.531200 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8943a69-eeb2-4d3a-a638-36f2e71c69c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:51.550577 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-c8943a69-eeb2-4d3a-a638-36f2e71c69c6 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:51.552000 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c8943a69-eeb2-4d3a-a638-36f2e71c69c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:51.568741 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 487/983] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:51 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:51.594448 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ded6e-9b75-4aaf-b966-32631c287e66 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:51.607064 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ded6e-9b75-4aaf-b966-32631c287e66 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:51.611684 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f861368-751f-46a0-9110-184064538639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:51.612585 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f861368-751f-46a0-9110-184064538639 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:51.613057 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f861368-751f-46a0-9110-184064538639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:51.613555 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f861368-751f-46a0-9110-184064538639 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:51.614486 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f861368-751f-46a0-9110-184064538639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:51.616563 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f861368-751f-46a0-9110-184064538639 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:51.618115 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.common [None req-5f861368-751f-46a0-9110-184064538639 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 10 20:46:51.635208 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.sql.core [None req-5f861368-751f-46a0-9110-184064538639 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 10 20:46:51.635208 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 10 20:46:51.635208 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [parameters: {'user_id': '81fbc363ff15481aa715694fd73a0aaa', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 10 20:46:51.635208 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79129) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 10 20:46:51.651498 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-5f861368-751f-46a0-9110-184064538639 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 10 20:46:51.654556 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 497/984] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:46:51 2022] POST /identity/v3/users => generated 160 bytes in 60 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:51.663405 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8943a69-eeb2-4d3a-a638-36f2e71c69c6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:51.673687 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8943a69-eeb2-4d3a-a638-36f2e71c69c6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:51.678761 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06d202-5bbf-4528-b358-da53fecb31ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:51.679832 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06d202-5bbf-4528-b358-da53fecb31ce admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:51.680302 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06d202-5bbf-4528-b358-da53fecb31ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:51.680762 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06d202-5bbf-4528-b358-da53fecb31ce admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:51.688937 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06d202-5bbf-4528-b358-da53fecb31ce admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:51.691376 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06d202-5bbf-4528-b358-da53fecb31ce admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:51.707258 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-9d06d202-5bbf-4528-b358-da53fecb31ce admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 10 20:46:51.709072 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 488/985] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:46:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:51.715432 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f861368-751f-46a0-9110-184064538639 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:51.728422 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f861368-751f-46a0-9110-184064538639 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:51.734732 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1dba0-bfab-422d-9524-8ed2c499a7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:51.735616 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1dba0-bfab-422d-9524-8ed2c499a7ea admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:51.736106 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1dba0-bfab-422d-9524-8ed2c499a7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:51.736569 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1dba0-bfab-422d-9524-8ed2c499a7ea admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:51.737732 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1dba0-bfab-422d-9524-8ed2c499a7ea admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:51.738227 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1dba0-bfab-422d-9524-8ed2c499a7ea admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:51.740539 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1dba0-bfab-422d-9524-8ed2c499a7ea admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:51.781303 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 498/986] 10.222.0.31 () {56 vars in 1122 bytes} [Thu Feb 10 20:46:51 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:51.924602 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82aec3-9d60-4c34-af81-8dabf0516b7c None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:51.925066 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82aec3-9d60-4c34-af81-8dabf0516b7c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:51.925245 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82aec3-9d60-4c34-af81-8dabf0516b7c None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:51.927299 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 489/987] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:51.933281 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a122f6c-6f9d-498e-8b7a-cd5df71f3a98 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:51.933630 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a122f6c-6f9d-498e-8b7a-cd5df71f3a98 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:51.933920 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a122f6c-6f9d-498e-8b7a-cd5df71f3a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:51.953672 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-5a122f6c-6f9d-498e-8b7a-cd5df71f3a98 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:51.955229 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-5a122f6c-6f9d-498e-8b7a-cd5df71f3a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:51.963739 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 499/988] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:51 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:51.987482 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82aec3-9d60-4c34-af81-8dabf0516b7c None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:52.000440 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82aec3-9d60-4c34-af81-8dabf0516b7c None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:52.005661 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb994d8d-1e18-4669-be9b-caf4a17d3a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:52.006465 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb994d8d-1e18-4669-be9b-caf4a17d3a68 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:52.006749 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb994d8d-1e18-4669-be9b-caf4a17d3a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:52.007016 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb994d8d-1e18-4669-be9b-caf4a17d3a68 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:52.007684 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb994d8d-1e18-4669-be9b-caf4a17d3a68 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:52.009293 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb994d8d-1e18-4669-be9b-caf4a17d3a68 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:52.021004 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-cb994d8d-1e18-4669-be9b-caf4a17d3a68 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 10 20:46:52.022567 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 490/989] 10.222.0.31 () {56 vars in 1147 bytes} [Thu Feb 10 20:46:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:52.028642 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a122f6c-6f9d-498e-8b7a-cd5df71f3a98 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:52.039853 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a122f6c-6f9d-498e-8b7a-cd5df71f3a98 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:52.047167 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d279b8-1083-42ce-857d-78ebb7b5e346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:52.048187 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d279b8-1083-42ce-857d-78ebb7b5e346 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:52.048670 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d279b8-1083-42ce-857d-78ebb7b5e346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:52.049150 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d279b8-1083-42ce-857d-78ebb7b5e346 admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:52.050131 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d279b8-1083-42ce-857d-78ebb7b5e346 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:52.050633 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d279b8-1083-42ce-857d-78ebb7b5e346 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:52.052455 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d279b8-1083-42ce-857d-78ebb7b5e346 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:52.058489 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 500/990] 10.222.0.31 () {56 vars in 1143 bytes} [Thu Feb 10 20:46:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:52.068117 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb994d8d-1e18-4669-be9b-caf4a17d3a68 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:52.077316 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb994d8d-1e18-4669-be9b-caf4a17d3a68 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:52.082220 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8b875-5631-41a8-b1b2-04f51e52ac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:52.082949 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8b875-5631-41a8-b1b2-04f51e52ac71 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:52.083225 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8b875-5631-41a8-b1b2-04f51e52ac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:52.083537 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8b875-5631-41a8-b1b2-04f51e52ac71 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:52.084268 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8b875-5631-41a8-b1b2-04f51e52ac71 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:52.084571 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8b875-5631-41a8-b1b2-04f51e52ac71 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:52.086197 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8b875-5631-41a8-b1b2-04f51e52ac71 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:52.091992 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 491/991] 10.222.0.31 () {56 vars in 1143 bytes} [Thu Feb 10 20:46:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:52.099681 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d279b8-1083-42ce-857d-78ebb7b5e346 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:52.111339 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d279b8-1083-42ce-857d-78ebb7b5e346 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:52.117003 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1334071-622f-4b55-9cd3-eb70da2bad56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:52.117949 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1334071-622f-4b55-9cd3-eb70da2bad56 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:52.118462 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1334071-622f-4b55-9cd3-eb70da2bad56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:52.118902 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1334071-622f-4b55-9cd3-eb70da2bad56 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:52.119739 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1334071-622f-4b55-9cd3-eb70da2bad56 admin admin] RBAC: Adding query filter params (interface=admin, service_id=f8929d4beccb4f32b7d4b63258f243c3, region_id=RegionOne) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:52.120050 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1334071-622f-4b55-9cd3-eb70da2bad56 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:52.121720 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1334071-622f-4b55-9cd3-eb70da2bad56 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:52.128685 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 501/992] 10.222.0.31 () {56 vars in 1270 bytes} [Thu Feb 10 20:46:52 2022] GET /identity/v3/endpoints?service_id=f8929d4beccb4f32b7d4b63258f243c3&interface=admin®ion_id=RegionOne => generated 193 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:52.135203 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8b875-5631-41a8-b1b2-04f51e52ac71 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:52.145239 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8b875-5631-41a8-b1b2-04f51e52ac71 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:52.150799 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181348ae-d360-4122-accb-2e334b46224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:52.151835 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181348ae-d360-4122-accb-2e334b46224e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:52.152263 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181348ae-d360-4122-accb-2e334b46224e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:52.152747 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181348ae-d360-4122-accb-2e334b46224e admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:52.153550 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181348ae-d360-4122-accb-2e334b46224e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:52.155587 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181348ae-d360-4122-accb-2e334b46224e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:52.162668 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 492/993] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 10 20:46:52 2022] GET /identity/v3/services => generated 1727 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 20:46:52.179329 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab66551-5e49-4969-b863-7775768439bc None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:52.179763 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab66551-5e49-4969-b863-7775768439bc None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:52.180233 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab66551-5e49-4969-b863-7775768439bc None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:52.183045 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 502/994] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:52.189584 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc15a6-a837-485f-991f-9ce0bf067837 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:52.189926 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc15a6-a837-485f-991f-9ce0bf067837 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:52.190100 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc15a6-a837-485f-991f-9ce0bf067837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:52.212348 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-91fc15a6-a837-485f-991f-9ce0bf067837 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:52.213773 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-91fc15a6-a837-485f-991f-9ce0bf067837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:52.225422 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 493/995] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:52 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:52.248702 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab66551-5e49-4969-b863-7775768439bc None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:52.263810 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab66551-5e49-4969-b863-7775768439bc None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:52.269540 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3339b2e-2e50-409c-8ed2-315ee4349884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:52.270311 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3339b2e-2e50-409c-8ed2-315ee4349884 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:52.270656 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3339b2e-2e50-409c-8ed2-315ee4349884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:52.270988 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3339b2e-2e50-409c-8ed2-315ee4349884 admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:52.271793 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3339b2e-2e50-409c-8ed2-315ee4349884 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:52.273495 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3339b2e-2e50-409c-8ed2-315ee4349884 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:52.293682 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 503/996] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 10 20:46:52 2022] POST /identity/v3/services => generated 242 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:46:52.508290 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f642f-5c1e-41e5-8f62-bac0f1675883 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:52.508655 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f642f-5c1e-41e5-8f62-bac0f1675883 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:52.508825 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f642f-5c1e-41e5-8f62-bac0f1675883 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:52.510698 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 494/997] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:52.517344 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5baaac-3778-4572-9bd9-31649741f894 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:52.517704 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5baaac-3778-4572-9bd9-31649741f894 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:52.517984 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5baaac-3778-4572-9bd9-31649741f894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:52.539349 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-0c5baaac-3778-4572-9bd9-31649741f894 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:52.542093 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-0c5baaac-3778-4572-9bd9-31649741f894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:52.560476 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 504/998] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:52 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:46:52.586434 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f642f-5c1e-41e5-8f62-bac0f1675883 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:52.601245 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f642f-5c1e-41e5-8f62-bac0f1675883 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:52.605675 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c65bb4-2f76-4c0e-ac40-8352d38a4cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:52.606605 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c65bb4-2f76-4c0e-ac40-8352d38a4cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:52.606949 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c65bb4-2f76-4c0e-ac40-8352d38a4cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:52.607312 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c65bb4-2f76-4c0e-ac40-8352d38a4cb7 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:52.608044 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c65bb4-2f76-4c0e-ac40-8352d38a4cb7 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:52.609785 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c65bb4-2f76-4c0e-ac40-8352d38a4cb7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:52.623434 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-75c65bb4-2f76-4c0e-ac40-8352d38a4cb7 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 10 20:46:52.624920 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 495/999] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:52.631143 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5baaac-3778-4572-9bd9-31649741f894 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:52.640614 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5baaac-3778-4572-9bd9-31649741f894 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:52.645364 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed1f62-438b-4ae8-a72f-e673a1baa787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:52.646136 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed1f62-438b-4ae8-a72f-e673a1baa787 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:52.646478 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed1f62-438b-4ae8-a72f-e673a1baa787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:52.646816 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed1f62-438b-4ae8-a72f-e673a1baa787 admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:52.647632 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed1f62-438b-4ae8-a72f-e673a1baa787 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:52.647998 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed1f62-438b-4ae8-a72f-e673a1baa787 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:52.649718 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed1f62-438b-4ae8-a72f-e673a1baa787 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:52.655846 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 505/1000] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 10 20:46:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:52.661866 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c65bb4-2f76-4c0e-ac40-8352d38a4cb7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:52.672564 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c65bb4-2f76-4c0e-ac40-8352d38a4cb7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:52.678929 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823c4c4-fead-4044-b917-2da404d2ef85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:52.679653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823c4c4-fead-4044-b917-2da404d2ef85 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:52.679930 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823c4c4-fead-4044-b917-2da404d2ef85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:52.680190 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823c4c4-fead-4044-b917-2da404d2ef85 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:52.680923 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823c4c4-fead-4044-b917-2da404d2ef85 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:52.681228 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823c4c4-fead-4044-b917-2da404d2ef85 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:52.682833 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823c4c4-fead-4044-b917-2da404d2ef85 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:52.688201 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 496/1001] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 10 20:46:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:52.694596 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed1f62-438b-4ae8-a72f-e673a1baa787 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:52.706205 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed1f62-438b-4ae8-a72f-e673a1baa787 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:52.710746 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc5033-5897-42d5-bfc7-6b2fc4879053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:52.711387 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc5033-5897-42d5-bfc7-6b2fc4879053 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:52.711659 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc5033-5897-42d5-bfc7-6b2fc4879053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:52.711928 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc5033-5897-42d5-bfc7-6b2fc4879053 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:52.712718 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc5033-5897-42d5-bfc7-6b2fc4879053 admin admin] RBAC: Adding query filter params (interface=public, service_id=9283c0763895467aa0015a9e506f81b2, region_id=RegionOne) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:52.713038 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc5033-5897-42d5-bfc7-6b2fc4879053 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:52.714660 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc5033-5897-42d5-bfc7-6b2fc4879053 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:52.720080 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 506/1002] 10.222.0.31 () {56 vars in 1272 bytes} [Thu Feb 10 20:46:52 2022] GET /identity/v3/endpoints?service_id=9283c0763895467aa0015a9e506f81b2&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:52.725423 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823c4c4-fead-4044-b917-2da404d2ef85 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:52.735069 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823c4c4-fead-4044-b917-2da404d2ef85 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:52.739647 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814cfc6-35e9-4d19-88ec-0ac1993e24a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:52.740314 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814cfc6-35e9-4d19-88ec-0ac1993e24a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:52.740593 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814cfc6-35e9-4d19-88ec-0ac1993e24a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:52.740857 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814cfc6-35e9-4d19-88ec-0ac1993e24a0 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:52.741567 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814cfc6-35e9-4d19-88ec-0ac1993e24a0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:52.743137 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814cfc6-35e9-4d19-88ec-0ac1993e24a0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:52.756938 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 497/1003] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 10 20:46:52 2022] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:46:54.379517 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74de52d-3be8-4e50-b7e2-8e02c33ed365 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:54.380073 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74de52d-3be8-4e50-b7e2-8e02c33ed365 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:54.380073 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74de52d-3be8-4e50-b7e2-8e02c33ed365 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:54.381845 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 507/1004] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:54.387483 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a5a73-7943-4b50-9d3b-52b5dfe54fa6 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:54.387897 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a5a73-7943-4b50-9d3b-52b5dfe54fa6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:54.388034 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a5a73-7943-4b50-9d3b-52b5dfe54fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:54.406620 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-6b1a5a73-7943-4b50-9d3b-52b5dfe54fa6 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:54.407800 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6b1a5a73-7943-4b50-9d3b-52b5dfe54fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:54.416178 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 498/1005] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:54 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:54.439803 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74de52d-3be8-4e50-b7e2-8e02c33ed365 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:54.452874 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74de52d-3be8-4e50-b7e2-8e02c33ed365 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:54.457628 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ad294-0e41-4902-87de-52d364c2a9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:54.458428 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ad294-0e41-4902-87de-52d364c2a9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:54.458704 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ad294-0e41-4902-87de-52d364c2a9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:54.458973 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ad294-0e41-4902-87de-52d364c2a9b4 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:54.459631 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ad294-0e41-4902-87de-52d364c2a9b4 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:54.461222 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ad294-0e41-4902-87de-52d364c2a9b4 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:54.472823 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-830ad294-0e41-4902-87de-52d364c2a9b4 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 10 20:46:54.474264 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 508/1006] 10.222.0.31 () {56 vars in 1147 bytes} [Thu Feb 10 20:46:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:54.480526 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a5a73-7943-4b50-9d3b-52b5dfe54fa6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:54.490105 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a5a73-7943-4b50-9d3b-52b5dfe54fa6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:54.496216 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884e128-cdda-4acf-b0c1-96f37b2d79fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:54.496972 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884e128-cdda-4acf-b0c1-96f37b2d79fa admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:54.497264 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884e128-cdda-4acf-b0c1-96f37b2d79fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:54.497747 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884e128-cdda-4acf-b0c1-96f37b2d79fa admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:54.498509 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884e128-cdda-4acf-b0c1-96f37b2d79fa admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:54.498824 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884e128-cdda-4acf-b0c1-96f37b2d79fa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:54.500736 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884e128-cdda-4acf-b0c1-96f37b2d79fa admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:54.509377 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 499/1007] 10.222.0.31 () {56 vars in 1143 bytes} [Thu Feb 10 20:46:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:54.513026 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ad294-0e41-4902-87de-52d364c2a9b4 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:54.513996 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3beb3b9-fda5-4384-9adc-9be7e83cd2c8 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:54.514282 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3beb3b9-fda5-4384-9adc-9be7e83cd2c8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:54.514604 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3beb3b9-fda5-4384-9adc-9be7e83cd2c8 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:54.516495 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 500/1008] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:54.521658 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a49dfc-fcbb-43dd-893e-cf341756e45c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:54.522149 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a49dfc-fcbb-43dd-893e-cf341756e45c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:54.522630 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a49dfc-fcbb-43dd-893e-cf341756e45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:54.522957 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ad294-0e41-4902-87de-52d364c2a9b4 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:54.529875 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e9272-455d-46bf-a519-b041014bfa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:54.530853 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e9272-455d-46bf-a519-b041014bfa3e admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:54.531131 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e9272-455d-46bf-a519-b041014bfa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:54.531402 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e9272-455d-46bf-a519-b041014bfa3e admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:54.532162 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e9272-455d-46bf-a519-b041014bfa3e admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:54.533323 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e9272-455d-46bf-a519-b041014bfa3e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:54.534159 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e9272-455d-46bf-a519-b041014bfa3e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:54.540949 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 509/1009] 10.222.0.31 () {56 vars in 1143 bytes} [Thu Feb 10 20:46:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:54.545339 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e9272-455d-46bf-a519-b041014bfa3e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:54.548467 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-62a49dfc-fcbb-43dd-893e-cf341756e45c None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:54.549692 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-62a49dfc-fcbb-43dd-893e-cf341756e45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:54.554889 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e9272-455d-46bf-a519-b041014bfa3e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:54.561379 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 501/1010] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:54 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:46:54.562613 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98338d-8361-4ed6-a6a3-5687c005cd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:54.563296 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98338d-8361-4ed6-a6a3-5687c005cd12 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:54.563570 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98338d-8361-4ed6-a6a3-5687c005cd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:54.563838 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98338d-8361-4ed6-a6a3-5687c005cd12 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:54.564629 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98338d-8361-4ed6-a6a3-5687c005cd12 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:54.566257 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98338d-8361-4ed6-a6a3-5687c005cd12 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:54.580788 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a49dfc-fcbb-43dd-893e-cf341756e45c None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:54.589428 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 510/1011] 10.222.0.31 () {60 vars in 1165 bytes} [Thu Feb 10 20:46:54 2022] POST /identity/v3/endpoints => generated 325 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:46:54.590663 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a49dfc-fcbb-43dd-893e-cf341756e45c None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:54.606558 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd2a0e-fcab-4b04-807b-ce141ec693af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:54.607373 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd2a0e-fcab-4b04-807b-ce141ec693af admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:54.607644 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd2a0e-fcab-4b04-807b-ce141ec693af admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:54.607912 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd2a0e-fcab-4b04-807b-ce141ec693af admin admin] PATH_INFO: `/v3/services/image` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:54.608580 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd2a0e-fcab-4b04-807b-ce141ec693af admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:54.610435 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd2a0e-fcab-4b04-807b-ce141ec693af admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:54.622163 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-b0dd2a0e-fcab-4b04-807b-ce141ec693af admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 10 20:46:54.623661 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 502/1012] 10.222.0.31 () {56 vars in 1126 bytes} [Thu Feb 10 20:46:54 2022] GET /identity/v3/services/image => generated 86 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:54.629764 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98338d-8361-4ed6-a6a3-5687c005cd12 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:54.640658 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98338d-8361-4ed6-a6a3-5687c005cd12 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:54.645267 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac620ba-cb5c-43a0-82d9-00b748992643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:54.645987 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac620ba-cb5c-43a0-82d9-00b748992643 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:54.646262 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac620ba-cb5c-43a0-82d9-00b748992643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:54.646528 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac620ba-cb5c-43a0-82d9-00b748992643 admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:54.647304 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac620ba-cb5c-43a0-82d9-00b748992643 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:54.647606 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac620ba-cb5c-43a0-82d9-00b748992643 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:54.649205 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac620ba-cb5c-43a0-82d9-00b748992643 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:54.655269 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 511/1013] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:54.661071 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd2a0e-fcab-4b04-807b-ce141ec693af admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:54.672079 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd2a0e-fcab-4b04-807b-ce141ec693af admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:54.677497 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8cb4ba-7ca5-4123-a7e6-b76e0995ac30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:54.678204 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cb4ba-7ca5-4123-a7e6-b76e0995ac30 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:54.678480 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cb4ba-7ca5-4123-a7e6-b76e0995ac30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:54.678750 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cb4ba-7ca5-4123-a7e6-b76e0995ac30 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:54.679522 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8cb4ba-7ca5-4123-a7e6-b76e0995ac30 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:54.679832 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8cb4ba-7ca5-4123-a7e6-b76e0995ac30 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:54.681546 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8cb4ba-7ca5-4123-a7e6-b76e0995ac30 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:54.687896 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 503/1014] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:54.694585 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac620ba-cb5c-43a0-82d9-00b748992643 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:54.705684 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac620ba-cb5c-43a0-82d9-00b748992643 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:54.710842 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0653e7b-4c68-4809-b027-7ed16a2a923f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:54.711801 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0653e7b-4c68-4809-b027-7ed16a2a923f admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:54.712214 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0653e7b-4c68-4809-b027-7ed16a2a923f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:54.712616 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0653e7b-4c68-4809-b027-7ed16a2a923f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:54.713609 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0653e7b-4c68-4809-b027-7ed16a2a923f admin admin] RBAC: Adding query filter params (interface=public, service_id=49f39a4493a84e25a57de9de8b952fb2, region_id=RegionOne) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:54.714074 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0653e7b-4c68-4809-b027-7ed16a2a923f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:54.715813 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0653e7b-4c68-4809-b027-7ed16a2a923f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:54.721992 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 512/1015] 10.222.0.31 () {56 vars in 1272 bytes} [Thu Feb 10 20:46:54 2022] GET /identity/v3/endpoints?service_id=49f39a4493a84e25a57de9de8b952fb2&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:54.727732 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8cb4ba-7ca5-4123-a7e6-b76e0995ac30 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:54.738309 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8cb4ba-7ca5-4123-a7e6-b76e0995ac30 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:54.743007 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48223951-9097-4cad-b24a-cdf8e5b6c348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:54.743680 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48223951-9097-4cad-b24a-cdf8e5b6c348 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:54.743957 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48223951-9097-4cad-b24a-cdf8e5b6c348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:54.744221 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48223951-9097-4cad-b24a-cdf8e5b6c348 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:54.744914 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48223951-9097-4cad-b24a-cdf8e5b6c348 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:54.746567 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48223951-9097-4cad-b24a-cdf8e5b6c348 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:54.754453 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 504/1016] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 10 20:46:54 2022] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:46:54.959353 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598af5d-7f28-4d06-997e-d2e35a66812b None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:54.959633 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598af5d-7f28-4d06-997e-d2e35a66812b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:54.959902 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598af5d-7f28-4d06-997e-d2e35a66812b None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:54.961802 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 513/1017] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:54.967294 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc6547-6010-4d65-acac-ed934dd88e05 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:54.967582 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc6547-6010-4d65-acac-ed934dd88e05 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:54.967852 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc6547-6010-4d65-acac-ed934dd88e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:54.986498 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-03cc6547-6010-4d65-acac-ed934dd88e05 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:54.987681 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-03cc6547-6010-4d65-acac-ed934dd88e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:54.996091 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 505/1018] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:54 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:55.019368 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598af5d-7f28-4d06-997e-d2e35a66812b None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:55.032160 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598af5d-7f28-4d06-997e-d2e35a66812b None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:55.037040 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848619e-ee5b-4016-b3b4-6fac02f48164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:55.037878 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848619e-ee5b-4016-b3b4-6fac02f48164 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:55.038155 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848619e-ee5b-4016-b3b4-6fac02f48164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:55.038426 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848619e-ee5b-4016-b3b4-6fac02f48164 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:55.039076 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848619e-ee5b-4016-b3b4-6fac02f48164 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:55.040632 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848619e-ee5b-4016-b3b4-6fac02f48164 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:55.051445 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-9848619e-ee5b-4016-b3b4-6fac02f48164 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 10 20:46:55.052756 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 514/1019] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:55.058801 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc6547-6010-4d65-acac-ed934dd88e05 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:55.067861 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc6547-6010-4d65-acac-ed934dd88e05 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:55.072862 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e676a-290c-49c3-8f03-9bfbdd646e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:55.073538 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e676a-290c-49c3-8f03-9bfbdd646e71 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:55.073819 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e676a-290c-49c3-8f03-9bfbdd646e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:55.074073 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e676a-290c-49c3-8f03-9bfbdd646e71 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:55.074777 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e676a-290c-49c3-8f03-9bfbdd646e71 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:55.075074 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e676a-290c-49c3-8f03-9bfbdd646e71 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:55.076643 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e676a-290c-49c3-8f03-9bfbdd646e71 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:55.081715 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 506/1020] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 10 20:46:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:55.087254 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848619e-ee5b-4016-b3b4-6fac02f48164 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:55.097595 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848619e-ee5b-4016-b3b4-6fac02f48164 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:55.102222 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa74aef-6b97-4b41-b08f-ef8baeccfe10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:55.102877 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa74aef-6b97-4b41-b08f-ef8baeccfe10 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:55.103150 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa74aef-6b97-4b41-b08f-ef8baeccfe10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:55.103417 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa74aef-6b97-4b41-b08f-ef8baeccfe10 admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:55.104130 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa74aef-6b97-4b41-b08f-ef8baeccfe10 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:55.104430 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa74aef-6b97-4b41-b08f-ef8baeccfe10 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:55.106049 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa74aef-6b97-4b41-b08f-ef8baeccfe10 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:55.111222 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 515/1021] 10.222.0.31 () {56 vars in 1133 bytes} [Thu Feb 10 20:46:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:55.116771 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e676a-290c-49c3-8f03-9bfbdd646e71 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:55.126534 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e676a-290c-49c3-8f03-9bfbdd646e71 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:55.131523 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94547409-e197-4b56-a6fa-547071039ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:55.132168 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94547409-e197-4b56-a6fa-547071039ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:55.132396 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94547409-e197-4b56-a6fa-547071039ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:55.132677 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94547409-e197-4b56-a6fa-547071039ba8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:55.133450 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94547409-e197-4b56-a6fa-547071039ba8 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:55.135021 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94547409-e197-4b56-a6fa-547071039ba8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:55.156045 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 507/1022] 10.222.0.31 () {60 vars in 1165 bytes} [Thu Feb 10 20:46:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:46:56.801012 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fa646-7374-4976-9fa9-22c37d7598f0 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:56.801562 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fa646-7374-4976-9fa9-22c37d7598f0 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:56.801562 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fa646-7374-4976-9fa9-22c37d7598f0 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:56.803454 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 516/1023] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:56.808611 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3ad6a-8a2c-4bb1-b918-24e4e8b4c1e5 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:56.809017 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3ad6a-8a2c-4bb1-b918-24e4e8b4c1e5 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:56.809204 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3ad6a-8a2c-4bb1-b918-24e4e8b4c1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:56.827512 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-abf3ad6a-8a2c-4bb1-b918-24e4e8b4c1e5 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:56.828672 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-abf3ad6a-8a2c-4bb1-b918-24e4e8b4c1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:56.846224 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 508/1024] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:56 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:56.869459 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fa646-7374-4976-9fa9-22c37d7598f0 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:56.882087 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fa646-7374-4976-9fa9-22c37d7598f0 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:56.886800 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc980de-9633-47df-91bd-a7693cc6efa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:56.887571 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc980de-9633-47df-91bd-a7693cc6efa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:56.887845 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc980de-9633-47df-91bd-a7693cc6efa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:56.888094 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc980de-9633-47df-91bd-a7693cc6efa4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:56.889275 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc980de-9633-47df-91bd-a7693cc6efa4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:56.890982 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc980de-9633-47df-91bd-a7693cc6efa4 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:56.892849 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 517/1025] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:56.898458 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3ad6a-8a2c-4bb1-b918-24e4e8b4c1e5 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:56.907539 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3ad6a-8a2c-4bb1-b918-24e4e8b4c1e5 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:56.912504 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff419d-3740-4c78-9974-486b243f4295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:56.913151 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff419d-3740-4c78-9974-486b243f4295 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:56.913422 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff419d-3740-4c78-9974-486b243f4295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:56.913718 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff419d-3740-4c78-9974-486b243f4295 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:56.914427 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff419d-3740-4c78-9974-486b243f4295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:56.916298 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff419d-3740-4c78-9974-486b243f4295 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:56.944646 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 509/1026] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 10 20:46:56 2022] POST /identity/v3/projects => generated 311 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:46:56.951427 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924267-4caf-4f15-92ee-75c7fa4769df None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:56.951764 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924267-4caf-4f15-92ee-75c7fa4769df None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:56.951969 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924267-4caf-4f15-92ee-75c7fa4769df None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:56.954173 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 518/1027] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:56.960110 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64540dd5-c2c4-4539-8f5a-e37499159e85 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:56.960462 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64540dd5-c2c4-4539-8f5a-e37499159e85 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:56.960710 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64540dd5-c2c4-4539-8f5a-e37499159e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:56.980469 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-64540dd5-c2c4-4539-8f5a-e37499159e85 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:56.981780 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-64540dd5-c2c4-4539-8f5a-e37499159e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:57.044678 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 510/1028] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:56 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:57.069267 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e924267-4caf-4f15-92ee-75c7fa4769df None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:57.083105 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e924267-4caf-4f15-92ee-75c7fa4769df None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:57.088002 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dfcb9-d433-4098-8d32-9ec1a46fc6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:57.088805 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dfcb9-d433-4098-8d32-9ec1a46fc6de admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:57.089048 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dfcb9-d433-4098-8d32-9ec1a46fc6de admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:57.089347 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dfcb9-d433-4098-8d32-9ec1a46fc6de admin admin] PATH_INFO: `/v3/services/image` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:57.090033 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dfcb9-d433-4098-8d32-9ec1a46fc6de admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:57.091638 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dfcb9-d433-4098-8d32-9ec1a46fc6de admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:57.103505 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-249dfcb9-d433-4098-8d32-9ec1a46fc6de admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 10 20:46:57.105020 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 519/1029] 10.222.0.31 () {56 vars in 1126 bytes} [Thu Feb 10 20:46:57 2022] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:57.111347 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64540dd5-c2c4-4539-8f5a-e37499159e85 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:57.120386 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64540dd5-c2c4-4539-8f5a-e37499159e85 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:57.125058 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91df6e-2d0c-4d0d-8d70-4f5d474e5382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:57.125757 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91df6e-2d0c-4d0d-8d70-4f5d474e5382 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:57.126034 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91df6e-2d0c-4d0d-8d70-4f5d474e5382 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:57.127188 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91df6e-2d0c-4d0d-8d70-4f5d474e5382 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:57.127946 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91df6e-2d0c-4d0d-8d70-4f5d474e5382 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:57.128244 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91df6e-2d0c-4d0d-8d70-4f5d474e5382 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:57.129872 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91df6e-2d0c-4d0d-8d70-4f5d474e5382 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:57.139762 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 511/1030] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:57.141183 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dfcb9-d433-4098-8d32-9ec1a46fc6de admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:57.151195 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dfcb9-d433-4098-8d32-9ec1a46fc6de admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:57.155701 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ac185-aa76-4730-8313-55da2415eb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:57.156343 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ac185-aa76-4730-8313-55da2415eb0d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:57.156618 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ac185-aa76-4730-8313-55da2415eb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:57.156886 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ac185-aa76-4730-8313-55da2415eb0d admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:57.157752 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ac185-aa76-4730-8313-55da2415eb0d admin admin] RBAC: Adding query filter params (type=image) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:57.158126 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ac185-aa76-4730-8313-55da2415eb0d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:57.159709 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ac185-aa76-4730-8313-55da2415eb0d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:57.165339 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 520/1031] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:57.172851 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91df6e-2d0c-4d0d-8d70-4f5d474e5382 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:57.183178 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91df6e-2d0c-4d0d-8d70-4f5d474e5382 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:57.187802 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab83fdf-2723-422e-a25f-88387fd6650e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:57.188475 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab83fdf-2723-422e-a25f-88387fd6650e admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:57.188753 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab83fdf-2723-422e-a25f-88387fd6650e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:57.189021 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab83fdf-2723-422e-a25f-88387fd6650e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:57.189913 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab83fdf-2723-422e-a25f-88387fd6650e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:57.191539 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab83fdf-2723-422e-a25f-88387fd6650e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:57.213014 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 512/1032] 10.222.0.31 () {60 vars in 1165 bytes} [Thu Feb 10 20:46:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:46:57.456356 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375c6cb-1790-4dd3-866d-1465b0aa222b None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:57.456714 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375c6cb-1790-4dd3-866d-1465b0aa222b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:57.456913 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375c6cb-1790-4dd3-866d-1465b0aa222b None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:57.458896 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 521/1033] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:57.464035 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db96a9-aeaa-44b6-bb9e-668b66a6fc00 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:57.464326 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db96a9-aeaa-44b6-bb9e-668b66a6fc00 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:57.464596 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db96a9-aeaa-44b6-bb9e-668b66a6fc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:57.482240 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-64db96a9-aeaa-44b6-bb9e-668b66a6fc00 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:57.483396 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-64db96a9-aeaa-44b6-bb9e-668b66a6fc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:57.501805 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 513/1034] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:57 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:57.526342 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375c6cb-1790-4dd3-866d-1465b0aa222b None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:57.541756 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375c6cb-1790-4dd3-866d-1465b0aa222b None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:57.546757 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196db422-73d6-45ba-9b74-706a7be2acc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:57.547563 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196db422-73d6-45ba-9b74-706a7be2acc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:57.547839 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196db422-73d6-45ba-9b74-706a7be2acc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:57.548100 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196db422-73d6-45ba-9b74-706a7be2acc1 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:57.559693 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196db422-73d6-45ba-9b74-706a7be2acc1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:46:57.566811 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-196db422-73d6-45ba-9b74-706a7be2acc1 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 10 20:46:57.568164 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 522/1035] 10.222.0.31 () {56 vars in 1141 bytes} [Thu Feb 10 20:46:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:57.574748 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db96a9-aeaa-44b6-bb9e-668b66a6fc00 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:57.583734 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db96a9-aeaa-44b6-bb9e-668b66a6fc00 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:57.588198 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc96aa9-fa47-4fa2-bde2-80330556fc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:57.588863 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc96aa9-fa47-4fa2-bde2-80330556fc8c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:57.589134 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc96aa9-fa47-4fa2-bde2-80330556fc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:57.589438 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc96aa9-fa47-4fa2-bde2-80330556fc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:57.590312 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc96aa9-fa47-4fa2-bde2-80330556fc8c admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:57.590616 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc96aa9-fa47-4fa2-bde2-80330556fc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:57.592221 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc96aa9-fa47-4fa2-bde2-80330556fc8c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:57.600549 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 514/1036] 10.222.0.31 () {56 vars in 1136 bytes} [Thu Feb 10 20:46:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:57.605963 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196db422-73d6-45ba-9b74-706a7be2acc1 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:57.616239 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196db422-73d6-45ba-9b74-706a7be2acc1 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:57.620623 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7447d5d-0115-4d96-b5b5-7b710bb4b70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:57.621419 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7447d5d-0115-4d96-b5b5-7b710bb4b70f admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:57.621697 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7447d5d-0115-4d96-b5b5-7b710bb4b70f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:57.621961 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7447d5d-0115-4d96-b5b5-7b710bb4b70f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:57.632032 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7447d5d-0115-4d96-b5b5-7b710bb4b70f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:57.633914 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7447d5d-0115-4d96-b5b5-7b710bb4b70f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:57.650071 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-d7447d5d-0115-4d96-b5b5-7b710bb4b70f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:57.651412 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 523/1037] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:57.657045 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc96aa9-fa47-4fa2-bde2-80330556fc8c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:57.667166 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc96aa9-fa47-4fa2-bde2-80330556fc8c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:57.671595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f665fd-98cd-4d4e-8d2d-e64894bbbc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:57.672217 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f665fd-98cd-4d4e-8d2d-e64894bbbc0a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:57.672495 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f665fd-98cd-4d4e-8d2d-e64894bbbc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:57.672759 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f665fd-98cd-4d4e-8d2d-e64894bbbc0a admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:57.673513 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f665fd-98cd-4d4e-8d2d-e64894bbbc0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:57.673916 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f665fd-98cd-4d4e-8d2d-e64894bbbc0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:57.675475 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f665fd-98cd-4d4e-8d2d-e64894bbbc0a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:57.687265 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 515/1038] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:57.692895 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7447d5d-0115-4d96-b5b5-7b710bb4b70f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:57.703238 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7447d5d-0115-4d96-b5b5-7b710bb4b70f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:57.708220 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f9044-a024-46b6-81a1-637282bf4937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:57.708930 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f9044-a024-46b6-81a1-637282bf4937 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:57.709202 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f9044-a024-46b6-81a1-637282bf4937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:57.709499 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f9044-a024-46b6-81a1-637282bf4937 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:57.716701 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f9044-a024-46b6-81a1-637282bf4937 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:57.718724 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f9044-a024-46b6-81a1-637282bf4937 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:57.732096 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-f80f9044-a024-46b6-81a1-637282bf4937 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 20:46:57.733420 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 524/1039] 10.222.0.31 () {56 vars in 1114 bytes} [Thu Feb 10 20:46:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:46:57.739064 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f665fd-98cd-4d4e-8d2d-e64894bbbc0a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:57.748930 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f665fd-98cd-4d4e-8d2d-e64894bbbc0a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:57.753882 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cbfd6-7d3b-4fe9-9d24-898c0ad66a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:57.754524 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cbfd6-7d3b-4fe9-9d24-898c0ad66a9b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:57.754793 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cbfd6-7d3b-4fe9-9d24-898c0ad66a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:57.755036 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cbfd6-7d3b-4fe9-9d24-898c0ad66a9b admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:57.755871 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2cbfd6-7d3b-4fe9-9d24-898c0ad66a9b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:57.756182 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2cbfd6-7d3b-4fe9-9d24-898c0ad66a9b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:57.758037 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2cbfd6-7d3b-4fe9-9d24-898c0ad66a9b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:57.781176 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 516/1040] 10.222.0.31 () {56 vars in 1154 bytes} [Thu Feb 10 20:46:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:57.782178 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f9044-a024-46b6-81a1-637282bf4937 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:57.793719 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f9044-a024-46b6-81a1-637282bf4937 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:57.798287 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a750f-ae75-47cd-ba55-3c2488e77efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:57.798966 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a750f-ae75-47cd-ba55-3c2488e77efa admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:57.799239 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a750f-ae75-47cd-ba55-3c2488e77efa admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:57.799501 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a750f-ae75-47cd-ba55-3c2488e77efa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:57.807165 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a750f-ae75-47cd-ba55-3c2488e77efa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:57.808893 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a750f-ae75-47cd-ba55-3c2488e77efa admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:57.817606 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 525/1041] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:57 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:46:57.823145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cbfd6-7d3b-4fe9-9d24-898c0ad66a9b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:57.833281 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cbfd6-7d3b-4fe9-9d24-898c0ad66a9b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:57.838258 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0168f1b-4052-41b1-bd2c-86021031b14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:57.839131 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0168f1b-4052-41b1-bd2c-86021031b14a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:57.839486 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0168f1b-4052-41b1-bd2c-86021031b14a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:57.839842 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0168f1b-4052-41b1-bd2c-86021031b14a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:57.849972 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0168f1b-4052-41b1-bd2c-86021031b14a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:57.851879 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0168f1b-4052-41b1-bd2c-86021031b14a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:57.868254 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-e0168f1b-4052-41b1-bd2c-86021031b14a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:46:57.869750 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 517/1042] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:57.875265 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a750f-ae75-47cd-ba55-3c2488e77efa admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:57.884661 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a750f-ae75-47cd-ba55-3c2488e77efa admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:57.889514 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cdb72-beeb-406f-b6f1-18f82d03568e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:57.890275 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cdb72-beeb-406f-b6f1-18f82d03568e admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:57.890652 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cdb72-beeb-406f-b6f1-18f82d03568e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:57.891020 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cdb72-beeb-406f-b6f1-18f82d03568e admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:57.891851 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cdb72-beeb-406f-b6f1-18f82d03568e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:57.892254 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cdb72-beeb-406f-b6f1-18f82d03568e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:57.894011 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cdb72-beeb-406f-b6f1-18f82d03568e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:57.909389 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 526/1043] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:57.912176 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0168f1b-4052-41b1-bd2c-86021031b14a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:57.921974 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0168f1b-4052-41b1-bd2c-86021031b14a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:57.926900 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367beb3-7cb6-4883-99a5-097a3432b4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:57.927632 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367beb3-7cb6-4883-99a5-097a3432b4fd admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:57.927935 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367beb3-7cb6-4883-99a5-097a3432b4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:57.928156 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367beb3-7cb6-4883-99a5-097a3432b4fd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:57.934915 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367beb3-7cb6-4883-99a5-097a3432b4fd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:57.936832 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367beb3-7cb6-4883-99a5-097a3432b4fd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:57.949901 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-2367beb3-7cb6-4883-99a5-097a3432b4fd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:46:57.951209 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 518/1044] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:46:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:46:57.956925 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cdb72-beeb-406f-b6f1-18f82d03568e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:57.967341 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cdb72-beeb-406f-b6f1-18f82d03568e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:57.972347 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009f3de-3970-4940-813e-0aa9f966dfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:57.973109 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009f3de-3970-4940-813e-0aa9f966dfca admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:57.973521 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009f3de-3970-4940-813e-0aa9f966dfca admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:57.973912 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009f3de-3970-4940-813e-0aa9f966dfca admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:57.974806 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009f3de-3970-4940-813e-0aa9f966dfca admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:57.975212 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009f3de-3970-4940-813e-0aa9f966dfca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:57.977173 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009f3de-3970-4940-813e-0aa9f966dfca admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:57.993381 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 527/1045] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:46:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:57.996272 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367beb3-7cb6-4883-99a5-097a3432b4fd admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:58.006524 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367beb3-7cb6-4883-99a5-097a3432b4fd admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:58.010909 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5120f9b-f409-496a-adae-a5db2d609505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:58.011534 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5120f9b-f409-496a-adae-a5db2d609505 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:58.011808 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5120f9b-f409-496a-adae-a5db2d609505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:58.012071 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5120f9b-f409-496a-adae-a5db2d609505 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:58.012894 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5120f9b-f409-496a-adae-a5db2d609505 admin admin] RBAC: Adding query filter params (role.id=7a87b44bd9ae4d0788eeb1ceb7897a47, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=c0d84b0d7e3d423aa972e58be27c772c) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:46:58.013196 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5120f9b-f409-496a-adae-a5db2d609505 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:58.015053 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5120f9b-f409-496a-adae-a5db2d609505 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:58.021092 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 519/1046] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:46:57 2022] GET /identity/v3/role_assignments?user.id=c0d84b0d7e3d423aa972e58be27c772c&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=7a87b44bd9ae4d0788eeb1ceb7897a47 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:46:59.208236 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d655477-1b2e-41a6-8cfd-7758f29e5c80 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:59.208817 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d655477-1b2e-41a6-8cfd-7758f29e5c80 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:59.208817 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d655477-1b2e-41a6-8cfd-7758f29e5c80 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:59.210712 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 528/1047] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:59.216251 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bb298-e484-4f34-b5bd-a6ed120c083b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:59.216684 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bb298-e484-4f34-b5bd-a6ed120c083b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:59.216971 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bb298-e484-4f34-b5bd-a6ed120c083b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:59.234582 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-b09bb298-e484-4f34-b5bd-a6ed120c083b None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:59.235868 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b09bb298-e484-4f34-b5bd-a6ed120c083b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:59.244085 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 520/1048] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:59 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:59.269172 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d655477-1b2e-41a6-8cfd-7758f29e5c80 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:59.281936 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d655477-1b2e-41a6-8cfd-7758f29e5c80 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:59.286857 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ca305-9861-4978-9a67-c14ede294cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:59.287761 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ca305-9861-4978-9a67-c14ede294cae admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:59.288132 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ca305-9861-4978-9a67-c14ede294cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:59.288500 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ca305-9861-4978-9a67-c14ede294cae admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:59.289841 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ca305-9861-4978-9a67-c14ede294cae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:59.291618 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ca305-9861-4978-9a67-c14ede294cae admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:59.294371 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 529/1049] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:46:59.298977 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bb298-e484-4f34-b5bd-a6ed120c083b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:59.308128 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bb298-e484-4f34-b5bd-a6ed120c083b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:59.312847 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fc50c-ba74-4398-9b70-754a4622c020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:59.313538 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fc50c-ba74-4398-9b70-754a4622c020 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:59.313815 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fc50c-ba74-4398-9b70-754a4622c020 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:59.314083 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fc50c-ba74-4398-9b70-754a4622c020 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:59.314797 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fc50c-ba74-4398-9b70-754a4622c020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:59.316781 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fc50c-ba74-4398-9b70-754a4622c020 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:59.339139 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 521/1050] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 10 20:46:59 2022] POST /identity/v3/users => generated 285 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:46:59.447006 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e8582-b2b7-4056-af44-4f27644f326b None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:59.447401 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e8582-b2b7-4056-af44-4f27644f326b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:59.447752 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e8582-b2b7-4056-af44-4f27644f326b None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:59.450025 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 530/1051] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:46:59.455967 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c27bd-ab0c-405b-b542-5335abf7b75c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:59.456259 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c27bd-ab0c-405b-b542-5335abf7b75c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:59.456555 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c27bd-ab0c-405b-b542-5335abf7b75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:59.475977 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e87c27bd-ab0c-405b-b542-5335abf7b75c None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:46:59.477100 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e87c27bd-ab0c-405b-b542-5335abf7b75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:46:59.485835 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 522/1052] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:46:59 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:46:59.508415 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e8582-b2b7-4056-af44-4f27644f326b None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:59.521083 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e8582-b2b7-4056-af44-4f27644f326b None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:59.529310 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cecc8-605d-44c2-a34c-d2264e3a98c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:59.530072 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cecc8-605d-44c2-a34c-d2264e3a98c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:59.530341 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cecc8-605d-44c2-a34c-d2264e3a98c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:59.530600 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cecc8-605d-44c2-a34c-d2264e3a98c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:59.543773 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2cecc8-605d-44c2-a34c-d2264e3a98c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:59.545709 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2cecc8-605d-44c2-a34c-d2264e3a98c9 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:59.555615 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 531/1053] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:46:59 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:46:59.561329 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c27bd-ab0c-405b-b542-5335abf7b75c None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:46:59.570687 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c27bd-ab0c-405b-b542-5335abf7b75c None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:46:59.576558 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82aa36-d032-4f46-aab7-46384cc8723c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:46:59.577475 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82aa36-d032-4f46-aab7-46384cc8723c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:46:59.577708 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82aa36-d032-4f46-aab7-46384cc8723c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:46:59.577974 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82aa36-d032-4f46-aab7-46384cc8723c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:46:59.579149 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82aa36-d032-4f46-aab7-46384cc8723c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:46:59.581233 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82aa36-d032-4f46-aab7-46384cc8723c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:46:59.583150 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 523/1054] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:46:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:00.197240 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b3a58-f579-4b5b-af00-102290f304ca None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:00.197496 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b3a58-f579-4b5b-af00-102290f304ca None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:00.197802 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b3a58-f579-4b5b-af00-102290f304ca None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:00.199571 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 532/1055] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:47:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:47:00.206104 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f1ce6-81d5-495d-8dfe-46b410ce5859 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:00.206383 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f1ce6-81d5-495d-8dfe-46b410ce5859 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:00.206653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f1ce6-81d5-495d-8dfe-46b410ce5859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:00.224949 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-0d2f1ce6-81d5-495d-8dfe-46b410ce5859 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:47:00.226153 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0d2f1ce6-81d5-495d-8dfe-46b410ce5859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:47:00.234434 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 524/1056] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:47:00 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:47:00.257176 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b3a58-f579-4b5b-af00-102290f304ca None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:00.270314 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b3a58-f579-4b5b-af00-102290f304ca None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:00.275350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001be8a-984e-4911-89d7-6bbc2d7abfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:00.276145 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001be8a-984e-4911-89d7-6bbc2d7abfe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:00.276417 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001be8a-984e-4911-89d7-6bbc2d7abfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:00.276678 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001be8a-984e-4911-89d7-6bbc2d7abfe6 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:00.286892 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001be8a-984e-4911-89d7-6bbc2d7abfe6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:47:00.294020 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-f001be8a-984e-4911-89d7-6bbc2d7abfe6 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 10 20:47:00.295142 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 533/1057] 10.222.0.31 () {56 vars in 1141 bytes} [Thu Feb 10 20:47:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:47:00.301099 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f1ce6-81d5-495d-8dfe-46b410ce5859 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:00.310186 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f1ce6-81d5-495d-8dfe-46b410ce5859 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:00.315606 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67375b6f-28fd-4859-8fe2-499f3eafe254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:00.316328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67375b6f-28fd-4859-8fe2-499f3eafe254 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:00.316599 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67375b6f-28fd-4859-8fe2-499f3eafe254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:00.316859 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67375b6f-28fd-4859-8fe2-499f3eafe254 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:00.317640 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67375b6f-28fd-4859-8fe2-499f3eafe254 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:00.317934 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67375b6f-28fd-4859-8fe2-499f3eafe254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:00.319513 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67375b6f-28fd-4859-8fe2-499f3eafe254 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:00.327985 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 525/1058] 10.222.0.31 () {56 vars in 1136 bytes} [Thu Feb 10 20:47:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:00.333901 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001be8a-984e-4911-89d7-6bbc2d7abfe6 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:00.344029 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001be8a-984e-4911-89d7-6bbc2d7abfe6 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:00.349704 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31ba81-e61f-4f2c-921b-f500ba6ec24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:00.350511 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31ba81-e61f-4f2c-921b-f500ba6ec24f admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:00.350780 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31ba81-e61f-4f2c-921b-f500ba6ec24f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:00.351080 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31ba81-e61f-4f2c-921b-f500ba6ec24f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:00.360846 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31ba81-e61f-4f2c-921b-f500ba6ec24f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:00.362803 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31ba81-e61f-4f2c-921b-f500ba6ec24f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:00.378720 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-fc31ba81-e61f-4f2c-921b-f500ba6ec24f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:47:00.379841 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 534/1059] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:47:00.385865 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67375b6f-28fd-4859-8fe2-499f3eafe254 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:00.395364 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67375b6f-28fd-4859-8fe2-499f3eafe254 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:00.400233 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e5c36-6b5c-4b45-a3d6-0c70970cca78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:00.400899 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e5c36-6b5c-4b45-a3d6-0c70970cca78 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:00.401162 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e5c36-6b5c-4b45-a3d6-0c70970cca78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:00.401475 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e5c36-6b5c-4b45-a3d6-0c70970cca78 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:00.402163 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e5c36-6b5c-4b45-a3d6-0c70970cca78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:00.402459 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e5c36-6b5c-4b45-a3d6-0c70970cca78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:00.404111 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e5c36-6b5c-4b45-a3d6-0c70970cca78 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:00.415797 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 526/1060] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:00.421337 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31ba81-e61f-4f2c-921b-f500ba6ec24f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:00.431960 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31ba81-e61f-4f2c-921b-f500ba6ec24f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:00.437627 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2ea98-9bc1-49a0-881c-a0307fc2d815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:00.438411 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2ea98-9bc1-49a0-881c-a0307fc2d815 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:00.438685 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2ea98-9bc1-49a0-881c-a0307fc2d815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:00.438958 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2ea98-9bc1-49a0-881c-a0307fc2d815 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:00.446585 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2ea98-9bc1-49a0-881c-a0307fc2d815 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:00.448668 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2ea98-9bc1-49a0-881c-a0307fc2d815 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:00.464326 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-b4b2ea98-9bc1-49a0-881c-a0307fc2d815 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 20:47:00.465523 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 535/1061] 10.222.0.31 () {56 vars in 1114 bytes} [Thu Feb 10 20:47:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:47:00.471839 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e5c36-6b5c-4b45-a3d6-0c70970cca78 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:00.482285 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e5c36-6b5c-4b45-a3d6-0c70970cca78 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:00.487737 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82fbfb-c349-4571-a190-dde5c44d165f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:00.488393 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82fbfb-c349-4571-a190-dde5c44d165f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:00.488670 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82fbfb-c349-4571-a190-dde5c44d165f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:00.488936 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82fbfb-c349-4571-a190-dde5c44d165f admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:00.489819 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82fbfb-c349-4571-a190-dde5c44d165f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:00.490121 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82fbfb-c349-4571-a190-dde5c44d165f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:00.491952 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82fbfb-c349-4571-a190-dde5c44d165f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:00.509423 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 527/1062] 10.222.0.31 () {56 vars in 1154 bytes} [Thu Feb 10 20:47:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:00.514997 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2ea98-9bc1-49a0-881c-a0307fc2d815 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:00.525577 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2ea98-9bc1-49a0-881c-a0307fc2d815 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:00.530304 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f4d67-d210-4a1f-af63-ba9d60b7aa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:00.531140 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f4d67-d210-4a1f-af63-ba9d60b7aa4e admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:00.531414 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f4d67-d210-4a1f-af63-ba9d60b7aa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:00.531673 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f4d67-d210-4a1f-af63-ba9d60b7aa4e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:00.542580 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f4d67-d210-4a1f-af63-ba9d60b7aa4e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:00.544409 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f4d67-d210-4a1f-af63-ba9d60b7aa4e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:00.561316 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-026f4d67-d210-4a1f-af63-ba9d60b7aa4e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:47:00.562700 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 536/1063] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:47:00.568500 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82fbfb-c349-4571-a190-dde5c44d165f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:00.578982 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82fbfb-c349-4571-a190-dde5c44d165f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:00.584889 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd7ad3-159c-4693-b4df-27154fb68e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:00.585641 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd7ad3-159c-4693-b4df-27154fb68e22 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:00.585980 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd7ad3-159c-4693-b4df-27154fb68e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:00.586301 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd7ad3-159c-4693-b4df-27154fb68e22 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:00.587073 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd7ad3-159c-4693-b4df-27154fb68e22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:00.587462 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd7ad3-159c-4693-b4df-27154fb68e22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:00.589030 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd7ad3-159c-4693-b4df-27154fb68e22 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:00.600677 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 528/1064] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:00.606439 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f4d67-d210-4a1f-af63-ba9d60b7aa4e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:00.616076 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f4d67-d210-4a1f-af63-ba9d60b7aa4e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:00.621540 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4398fa-18ec-4af8-9549-2e4cafe9e4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:00.622304 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4398fa-18ec-4af8-9549-2e4cafe9e4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:00.622574 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4398fa-18ec-4af8-9549-2e4cafe9e4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:00.622834 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4398fa-18ec-4af8-9549-2e4cafe9e4f3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:00.629770 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4398fa-18ec-4af8-9549-2e4cafe9e4f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:00.631753 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4398fa-18ec-4af8-9549-2e4cafe9e4f3 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:00.644399 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-bd4398fa-18ec-4af8-9549-2e4cafe9e4f3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:47:00.645529 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 537/1065] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:47:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:47:00.651289 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd7ad3-159c-4693-b4df-27154fb68e22 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:00.661428 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd7ad3-159c-4693-b4df-27154fb68e22 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:00.667164 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b8722-5aa2-48d1-80c3-2f2fd607d613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:00.667800 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b8722-5aa2-48d1-80c3-2f2fd607d613 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:00.668072 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b8722-5aa2-48d1-80c3-2f2fd607d613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:00.668335 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b8722-5aa2-48d1-80c3-2f2fd607d613 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:00.669124 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b8722-5aa2-48d1-80c3-2f2fd607d613 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:00.669442 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b8722-5aa2-48d1-80c3-2f2fd607d613 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:00.671262 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b8722-5aa2-48d1-80c3-2f2fd607d613 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:00.683721 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 529/1066] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:47:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:00.689385 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4398fa-18ec-4af8-9549-2e4cafe9e4f3 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:00.700365 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4398fa-18ec-4af8-9549-2e4cafe9e4f3 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:00.705151 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38eee0-5bcb-479f-a60f-3c22ff8218d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:00.706000 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38eee0-5bcb-479f-a60f-3c22ff8218d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:00.706274 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38eee0-5bcb-479f-a60f-3c22ff8218d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:00.706630 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38eee0-5bcb-479f-a60f-3c22ff8218d2 admin admin] PATH_INFO: `/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/c0d84b0d7e3d423aa972e58be27c772c/roles/7a87b44bd9ae4d0788eeb1ceb7897a47` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:00.709139 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38eee0-5bcb-479f-a60f-3c22ff8218d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f35ac6d668442a9ea0347f99eb2881, user_id=c0d84b0d7e3d423aa972e58be27c772c, role_id=7a87b44bd9ae4d0788eeb1ceb7897a47)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:00.711749 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38eee0-5bcb-479f-a60f-3c22ff8218d2 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:00.725343 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 538/1067] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:47:00 2022] PUT /identity/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/c0d84b0d7e3d423aa972e58be27c772c/roles/7a87b44bd9ae4d0788eeb1ceb7897a47 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:47:01.616946 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86141669-e9b1-45ea-805c-f1de00c3edd2 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:01.617556 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86141669-e9b1-45ea-805c-f1de00c3edd2 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:01.617556 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86141669-e9b1-45ea-805c-f1de00c3edd2 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:01.619358 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 530/1068] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:47:01.624818 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff23ec8-38b0-4795-8080-d42f2993c99e None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:01.625248 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff23ec8-38b0-4795-8080-d42f2993c99e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:01.625484 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff23ec8-38b0-4795-8080-d42f2993c99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:01.644221 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-0ff23ec8-38b0-4795-8080-d42f2993c99e None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:47:01.645420 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-0ff23ec8-38b0-4795-8080-d42f2993c99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:47:01.705644 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 539/1069] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:47:01 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:47:01.729220 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86141669-e9b1-45ea-805c-f1de00c3edd2 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:01.743333 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86141669-e9b1-45ea-805c-f1de00c3edd2 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:01.748554 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69529746-2145-483d-9ecf-f594ec74d652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:01.749338 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69529746-2145-483d-9ecf-f594ec74d652 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:01.749644 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69529746-2145-483d-9ecf-f594ec74d652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:01.749909 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69529746-2145-483d-9ecf-f594ec74d652 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:01.760457 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69529746-2145-483d-9ecf-f594ec74d652 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:47:01.767199 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-69529746-2145-483d-9ecf-f594ec74d652 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:47:01.768348 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 531/1070] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:47:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:47:01.774385 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff23ec8-38b0-4795-8080-d42f2993c99e None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:01.783691 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff23ec8-38b0-4795-8080-d42f2993c99e None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:01.790260 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0278c-217a-4245-93fe-8d9d39b6be26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:01.791119 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0278c-217a-4245-93fe-8d9d39b6be26 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:01.791237 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0278c-217a-4245-93fe-8d9d39b6be26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:01.791500 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0278c-217a-4245-93fe-8d9d39b6be26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:01.792951 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0278c-217a-4245-93fe-8d9d39b6be26 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:01.793519 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0278c-217a-4245-93fe-8d9d39b6be26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:01.795747 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0278c-217a-4245-93fe-8d9d39b6be26 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:01.805694 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 540/1071] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:47:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:01.811700 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69529746-2145-483d-9ecf-f594ec74d652 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:01.822250 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69529746-2145-483d-9ecf-f594ec74d652 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:01.827544 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7fe00-fb46-4564-b9ff-29cfa7b1f1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:01.828391 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7fe00-fb46-4564-b9ff-29cfa7b1f1ee admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:01.828668 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7fe00-fb46-4564-b9ff-29cfa7b1f1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:01.828928 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7fe00-fb46-4564-b9ff-29cfa7b1f1ee admin admin] PATH_INFO: `/v3/users/8985e6a45f0c4a39ade7d2fa8bafe030` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:01.842268 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7fe00-fb46-4564-b9ff-29cfa7b1f1ee admin admin] RBAC: Authorizing `identity:get_user(user_id=8985e6a45f0c4a39ade7d2fa8bafe030)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:01.844374 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7fe00-fb46-4564-b9ff-29cfa7b1f1ee admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:01.846029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 532/1072] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:47:01 2022] GET /identity/v3/users/8985e6a45f0c4a39ade7d2fa8bafe030 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:01.851848 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0278c-217a-4245-93fe-8d9d39b6be26 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:01.861900 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0278c-217a-4245-93fe-8d9d39b6be26 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:01.866784 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37ed2a-b7eb-4f8a-9391-7cb0f331810a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:01.867421 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37ed2a-b7eb-4f8a-9391-7cb0f331810a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:01.867702 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37ed2a-b7eb-4f8a-9391-7cb0f331810a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:01.867973 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37ed2a-b7eb-4f8a-9391-7cb0f331810a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:01.876052 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37ed2a-b7eb-4f8a-9391-7cb0f331810a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:01.877838 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37ed2a-b7eb-4f8a-9391-7cb0f331810a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:01.886713 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 541/1073] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:47:01 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:47:01.892458 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7fe00-fb46-4564-b9ff-29cfa7b1f1ee admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:01.902313 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7fe00-fb46-4564-b9ff-29cfa7b1f1ee admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:01.907452 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c249867-0adc-4117-a713-cc627c73a7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:01.908297 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c249867-0adc-4117-a713-cc627c73a7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:01.908573 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c249867-0adc-4117-a713-cc627c73a7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:01.908843 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c249867-0adc-4117-a713-cc627c73a7b1 admin admin] PATH_INFO: `/v3/projects/c38f2eeb848b4a74bef0e99388202f6e` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:01.910020 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c249867-0adc-4117-a713-cc627c73a7b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=c38f2eeb848b4a74bef0e99388202f6e)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:01.912030 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c249867-0adc-4117-a713-cc627c73a7b1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:01.918249 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 533/1074] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:47:01 2022] GET /identity/v3/projects/c38f2eeb848b4a74bef0e99388202f6e => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:01.919333 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37ed2a-b7eb-4f8a-9391-7cb0f331810a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:01.927954 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37ed2a-b7eb-4f8a-9391-7cb0f331810a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:01.932462 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6536c93-7a1a-471e-a5b7-cdff783d768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:01.933061 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6536c93-7a1a-471e-a5b7-cdff783d768b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:01.933320 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6536c93-7a1a-471e-a5b7-cdff783d768b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:01.933650 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6536c93-7a1a-471e-a5b7-cdff783d768b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:01.934481 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6536c93-7a1a-471e-a5b7-cdff783d768b admin admin] RBAC: Adding query filter params (role.id=e06447c1c62d465c9f9c58168be71ed8, scope.project.id=c38f2eeb848b4a74bef0e99388202f6e, user.id=8985e6a45f0c4a39ade7d2fa8bafe030) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:01.934785 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6536c93-7a1a-471e-a5b7-cdff783d768b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:01.936585 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6536c93-7a1a-471e-a5b7-cdff783d768b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:01.942055 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 542/1075] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:47:01 2022] GET /identity/v3/role_assignments?user.id=8985e6a45f0c4a39ade7d2fa8bafe030&scope.project.id=c38f2eeb848b4a74bef0e99388202f6e&role.id=e06447c1c62d465c9f9c58168be71ed8 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:02.869013 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310c038-2874-420b-a21f-0df2810cfbf0 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:02.869574 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310c038-2874-420b-a21f-0df2810cfbf0 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:02.869574 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310c038-2874-420b-a21f-0df2810cfbf0 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:02.871255 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 534/1076] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:47:02.876977 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf576b6-1fc0-4a3f-999f-1d6c19595a27 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:02.877436 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf576b6-1fc0-4a3f-999f-1d6c19595a27 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:02.877640 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf576b6-1fc0-4a3f-999f-1d6c19595a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:02.895726 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-5bf576b6-1fc0-4a3f-999f-1d6c19595a27 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:47:02.896911 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-5bf576b6-1fc0-4a3f-999f-1d6c19595a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:47:02.905031 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 543/1077] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:47:02 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:47:02.928924 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310c038-2874-420b-a21f-0df2810cfbf0 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:02.941703 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310c038-2874-420b-a21f-0df2810cfbf0 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:02.946499 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93081fb-9028-4c8f-9c34-30e1382555eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:02.947287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93081fb-9028-4c8f-9c34-30e1382555eb admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:02.947561 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93081fb-9028-4c8f-9c34-30e1382555eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:02.947829 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93081fb-9028-4c8f-9c34-30e1382555eb admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:02.958205 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93081fb-9028-4c8f-9c34-30e1382555eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:47:02.965675 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-f93081fb-9028-4c8f-9c34-30e1382555eb admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 10 20:47:02.967037 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 535/1078] 10.222.0.31 () {56 vars in 1141 bytes} [Thu Feb 10 20:47:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:47:02.972775 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf576b6-1fc0-4a3f-999f-1d6c19595a27 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:02.982260 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf576b6-1fc0-4a3f-999f-1d6c19595a27 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:02.988076 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f393dd6-2001-4f67-893c-3cd149b69842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:02.988869 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f393dd6-2001-4f67-893c-3cd149b69842 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:02.989140 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f393dd6-2001-4f67-893c-3cd149b69842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:02.989425 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f393dd6-2001-4f67-893c-3cd149b69842 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:02.990174 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f393dd6-2001-4f67-893c-3cd149b69842 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:02.990471 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f393dd6-2001-4f67-893c-3cd149b69842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:02.992047 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f393dd6-2001-4f67-893c-3cd149b69842 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:03.000595 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 544/1079] 10.222.0.31 () {56 vars in 1136 bytes} [Thu Feb 10 20:47:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:03.006396 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93081fb-9028-4c8f-9c34-30e1382555eb admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:03.017146 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93081fb-9028-4c8f-9c34-30e1382555eb admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:03.022509 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3478d-e383-445d-8d5e-2c8da7c4c944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:03.023309 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3478d-e383-445d-8d5e-2c8da7c4c944 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:03.023586 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3478d-e383-445d-8d5e-2c8da7c4c944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:03.023845 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3478d-e383-445d-8d5e-2c8da7c4c944 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:03.035016 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3478d-e383-445d-8d5e-2c8da7c4c944 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:03.036945 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3478d-e383-445d-8d5e-2c8da7c4c944 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:03.053694 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-4ae3478d-e383-445d-8d5e-2c8da7c4c944 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:47:03.054884 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 536/1080] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:47:03.060801 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f393dd6-2001-4f67-893c-3cd149b69842 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:03.071274 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f393dd6-2001-4f67-893c-3cd149b69842 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:03.077507 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d17513-a7fe-4f14-8c24-f822fe37623f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:03.078223 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d17513-a7fe-4f14-8c24-f822fe37623f admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:03.078583 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d17513-a7fe-4f14-8c24-f822fe37623f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:03.078913 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d17513-a7fe-4f14-8c24-f822fe37623f admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:03.079696 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d17513-a7fe-4f14-8c24-f822fe37623f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:03.080056 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d17513-a7fe-4f14-8c24-f822fe37623f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:03.081740 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d17513-a7fe-4f14-8c24-f822fe37623f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:03.096793 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 545/1081] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:03.102656 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3478d-e383-445d-8d5e-2c8da7c4c944 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:03.112534 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3478d-e383-445d-8d5e-2c8da7c4c944 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:03.117471 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3288a-8c30-43a0-a610-235b0a357c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:03.118245 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3288a-8c30-43a0-a610-235b0a357c6b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:03.118516 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3288a-8c30-43a0-a610-235b0a357c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:03.118778 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3288a-8c30-43a0-a610-235b0a357c6b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:03.126255 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3288a-8c30-43a0-a610-235b0a357c6b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:03.128170 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3288a-8c30-43a0-a610-235b0a357c6b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:03.141592 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-d4c3288a-8c30-43a0-a610-235b0a357c6b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 20:47:03.142940 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 537/1082] 10.222.0.31 () {56 vars in 1114 bytes} [Thu Feb 10 20:47:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:47:03.148551 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d17513-a7fe-4f14-8c24-f822fe37623f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:03.158822 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d17513-a7fe-4f14-8c24-f822fe37623f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:03.164757 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640136a-7828-4e39-9e1c-8d7facab6dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:03.165534 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640136a-7828-4e39-9e1c-8d7facab6dbc admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:03.165871 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640136a-7828-4e39-9e1c-8d7facab6dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:03.166145 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640136a-7828-4e39-9e1c-8d7facab6dbc admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:03.166980 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640136a-7828-4e39-9e1c-8d7facab6dbc admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:03.167275 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640136a-7828-4e39-9e1c-8d7facab6dbc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:03.169094 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640136a-7828-4e39-9e1c-8d7facab6dbc admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:03.186620 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 546/1083] 10.222.0.31 () {56 vars in 1154 bytes} [Thu Feb 10 20:47:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:03.192190 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3288a-8c30-43a0-a610-235b0a357c6b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:03.202423 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3288a-8c30-43a0-a610-235b0a357c6b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:03.208210 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15789ff-4cc6-405c-9fce-fd7392a5884b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:03.208825 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15789ff-4cc6-405c-9fce-fd7392a5884b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:03.209096 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15789ff-4cc6-405c-9fce-fd7392a5884b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:03.209389 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15789ff-4cc6-405c-9fce-fd7392a5884b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:03.217830 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15789ff-4cc6-405c-9fce-fd7392a5884b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:03.219571 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15789ff-4cc6-405c-9fce-fd7392a5884b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:03.229577 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 538/1084] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:47:03 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:47:03.235455 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640136a-7828-4e39-9e1c-8d7facab6dbc admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:03.245916 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640136a-7828-4e39-9e1c-8d7facab6dbc admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:03.250951 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c652e7a-cfea-49d6-8edc-2c0b2f76f487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:03.251811 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c652e7a-cfea-49d6-8edc-2c0b2f76f487 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:03.252170 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c652e7a-cfea-49d6-8edc-2c0b2f76f487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:03.252521 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c652e7a-cfea-49d6-8edc-2c0b2f76f487 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:03.263145 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c652e7a-cfea-49d6-8edc-2c0b2f76f487 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:03.264948 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c652e7a-cfea-49d6-8edc-2c0b2f76f487 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:03.281210 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-8c652e7a-cfea-49d6-8edc-2c0b2f76f487 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:47:03.282362 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 547/1085] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:47:03.287969 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15789ff-4cc6-405c-9fce-fd7392a5884b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:03.296774 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15789ff-4cc6-405c-9fce-fd7392a5884b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:03.301781 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a8c10-6d8a-43c1-8b2a-7e2cef6b6336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:03.302406 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a8c10-6d8a-43c1-8b2a-7e2cef6b6336 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:03.302679 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a8c10-6d8a-43c1-8b2a-7e2cef6b6336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:03.302944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a8c10-6d8a-43c1-8b2a-7e2cef6b6336 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:03.303654 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a8c10-6d8a-43c1-8b2a-7e2cef6b6336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:03.303948 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a8c10-6d8a-43c1-8b2a-7e2cef6b6336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:03.305520 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a8c10-6d8a-43c1-8b2a-7e2cef6b6336 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:03.316654 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 539/1086] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:03.322087 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c652e7a-cfea-49d6-8edc-2c0b2f76f487 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:03.332762 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c652e7a-cfea-49d6-8edc-2c0b2f76f487 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:03.338574 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf301fe3-e9dc-4b59-864c-079ca19f8545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:03.339345 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf301fe3-e9dc-4b59-864c-079ca19f8545 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:03.339623 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf301fe3-e9dc-4b59-864c-079ca19f8545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:03.339889 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf301fe3-e9dc-4b59-864c-079ca19f8545 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:03.347350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf301fe3-e9dc-4b59-864c-079ca19f8545 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:03.349279 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf301fe3-e9dc-4b59-864c-079ca19f8545 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:03.362488 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-cf301fe3-e9dc-4b59-864c-079ca19f8545 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:47:03.363601 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 548/1087] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:47:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:47:03.369449 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a8c10-6d8a-43c1-8b2a-7e2cef6b6336 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:03.378851 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a8c10-6d8a-43c1-8b2a-7e2cef6b6336 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:03.386336 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d7d40-1d55-46d4-8e21-f93e41dd3769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:03.387242 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d7d40-1d55-46d4-8e21-f93e41dd3769 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:03.387611 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d7d40-1d55-46d4-8e21-f93e41dd3769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:03.387962 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d7d40-1d55-46d4-8e21-f93e41dd3769 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:03.389166 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d7d40-1d55-46d4-8e21-f93e41dd3769 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:03.389653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d7d40-1d55-46d4-8e21-f93e41dd3769 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:03.392499 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d7d40-1d55-46d4-8e21-f93e41dd3769 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:03.405980 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 540/1088] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:47:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:03.411689 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf301fe3-e9dc-4b59-864c-079ca19f8545 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:03.422431 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf301fe3-e9dc-4b59-864c-079ca19f8545 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:03.429401 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada42be-1980-466d-9e3d-505b15534cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:03.430484 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada42be-1980-466d-9e3d-505b15534cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:03.430983 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada42be-1980-466d-9e3d-505b15534cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:03.431444 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada42be-1980-466d-9e3d-505b15534cfe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:03.432482 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada42be-1980-466d-9e3d-505b15534cfe admin admin] RBAC: Adding query filter params (role.id=7a87b44bd9ae4d0788eeb1ceb7897a47, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=c0d84b0d7e3d423aa972e58be27c772c) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:03.432791 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada42be-1980-466d-9e3d-505b15534cfe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:03.434666 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada42be-1980-466d-9e3d-505b15534cfe admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:03.441147 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 549/1089] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:47:03 2022] GET /identity/v3/role_assignments?user.id=c0d84b0d7e3d423aa972e58be27c772c&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=7a87b44bd9ae4d0788eeb1ceb7897a47 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:04.137923 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed38161-1f15-4a96-8f90-1c319e8c2f21 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:04.138488 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed38161-1f15-4a96-8f90-1c319e8c2f21 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:04.138488 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed38161-1f15-4a96-8f90-1c319e8c2f21 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:04.140202 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 541/1090] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:47:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:47:04.146173 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4150c78-b606-4238-89e7-23049267c974 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:04.146648 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4150c78-b606-4238-89e7-23049267c974 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:04.146738 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4150c78-b606-4238-89e7-23049267c974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:04.166027 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-e4150c78-b606-4238-89e7-23049267c974 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:47:04.167441 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-e4150c78-b606-4238-89e7-23049267c974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:47:04.176556 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 550/1091] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:47:04 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:47:04.199980 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed38161-1f15-4a96-8f90-1c319e8c2f21 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:04.213317 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed38161-1f15-4a96-8f90-1c319e8c2f21 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:04.217731 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd7d57-049d-4de1-8811-8771b3caeeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:04.218511 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd7d57-049d-4de1-8811-8771b3caeeba admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:04.218783 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd7d57-049d-4de1-8811-8771b3caeeba admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:04.219049 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd7d57-049d-4de1-8811-8771b3caeeba admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:04.229977 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd7d57-049d-4de1-8811-8771b3caeeba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:47:04.236613 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-16cd7d57-049d-4de1-8811-8771b3caeeba admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:47:04.237943 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 542/1092] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:47:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:47:04.244875 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4150c78-b606-4238-89e7-23049267c974 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:04.254580 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4150c78-b606-4238-89e7-23049267c974 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:04.259990 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf47af2-ac91-4fb6-a75c-579ae19f3119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:04.260681 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf47af2-ac91-4fb6-a75c-579ae19f3119 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:04.260956 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf47af2-ac91-4fb6-a75c-579ae19f3119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:04.261226 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf47af2-ac91-4fb6-a75c-579ae19f3119 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:04.262013 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf47af2-ac91-4fb6-a75c-579ae19f3119 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:04.262312 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf47af2-ac91-4fb6-a75c-579ae19f3119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:04.263909 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf47af2-ac91-4fb6-a75c-579ae19f3119 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:04.273736 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 551/1093] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:47:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:04.279869 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd7d57-049d-4de1-8811-8771b3caeeba admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:04.289736 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd7d57-049d-4de1-8811-8771b3caeeba admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:04.298884 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf8451-0e1e-4575-b6b8-b01ad99a7e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:04.299741 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf8451-0e1e-4575-b6b8-b01ad99a7e4d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:04.300129 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf8451-0e1e-4575-b6b8-b01ad99a7e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:04.300446 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf8451-0e1e-4575-b6b8-b01ad99a7e4d admin admin] PATH_INFO: `/v3/users/8985e6a45f0c4a39ade7d2fa8bafe030` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:04.301998 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf8451-0e1e-4575-b6b8-b01ad99a7e4d admin admin] RBAC: Authorizing `identity:get_user(user_id=8985e6a45f0c4a39ade7d2fa8bafe030)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:04.304288 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf8451-0e1e-4575-b6b8-b01ad99a7e4d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:04.305914 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 543/1094] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:47:04 2022] GET /identity/v3/users/8985e6a45f0c4a39ade7d2fa8bafe030 => generated 285 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:47:04.314565 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf47af2-ac91-4fb6-a75c-579ae19f3119 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:04.329239 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf47af2-ac91-4fb6-a75c-579ae19f3119 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:04.334885 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad4483-2631-41e2-beed-bdbd2bba9051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:04.335718 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad4483-2631-41e2-beed-bdbd2bba9051 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:04.335994 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad4483-2631-41e2-beed-bdbd2bba9051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:04.336261 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad4483-2631-41e2-beed-bdbd2bba9051 admin admin] PATH_INFO: `/v3/projects/c38f2eeb848b4a74bef0e99388202f6e` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:04.337540 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad4483-2631-41e2-beed-bdbd2bba9051 admin admin] RBAC: Authorizing `identity:get_project(project_id=c38f2eeb848b4a74bef0e99388202f6e)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:04.339549 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad4483-2631-41e2-beed-bdbd2bba9051 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:04.341170 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 552/1095] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:47:04 2022] GET /identity/v3/projects/c38f2eeb848b4a74bef0e99388202f6e => generated 311 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:04.346712 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf8451-0e1e-4575-b6b8-b01ad99a7e4d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:04.477470 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf8451-0e1e-4575-b6b8-b01ad99a7e4d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:04.483248 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9609ab9-0d63-4bb6-bad0-d9f6ec29757f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:04.484108 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9609ab9-0d63-4bb6-bad0-d9f6ec29757f admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:04.484380 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9609ab9-0d63-4bb6-bad0-d9f6ec29757f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:04.484638 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9609ab9-0d63-4bb6-bad0-d9f6ec29757f admin admin] PATH_INFO: `/v3/projects/c38f2eeb848b4a74bef0e99388202f6e/users/8985e6a45f0c4a39ade7d2fa8bafe030/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:04.486871 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9609ab9-0d63-4bb6-bad0-d9f6ec29757f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38f2eeb848b4a74bef0e99388202f6e, user_id=8985e6a45f0c4a39ade7d2fa8bafe030, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:04.489469 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9609ab9-0d63-4bb6-bad0-d9f6ec29757f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:04.506422 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 544/1096] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:47:04 2022] PUT /identity/v3/projects/c38f2eeb848b4a74bef0e99388202f6e/users/8985e6a45f0c4a39ade7d2fa8bafe030/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:47:06.671794 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7c313-cde5-4526-8453-75162125f9b7 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:06.672618 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7c313-cde5-4526-8453-75162125f9b7 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:06.672618 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7c313-cde5-4526-8453-75162125f9b7 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:06.675527 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 553/1097] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:47:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:47:06.683019 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbe6db-e4ad-492a-ab40-54f42c0b7371 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:06.683428 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbe6db-e4ad-492a-ab40-54f42c0b7371 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:06.683597 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbe6db-e4ad-492a-ab40-54f42c0b7371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:06.711536 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-43dbe6db-e4ad-492a-ab40-54f42c0b7371 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:47:06.712713 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-43dbe6db-e4ad-492a-ab40-54f42c0b7371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:47:06.771280 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 545/1098] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:47:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:47:06.795418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7c313-cde5-4526-8453-75162125f9b7 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:06.809972 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7c313-cde5-4526-8453-75162125f9b7 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:06.815905 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba776ad8-0c8d-4c2c-8d93-d66fe4796f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:06.816670 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba776ad8-0c8d-4c2c-8d93-d66fe4796f32 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:06.816948 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba776ad8-0c8d-4c2c-8d93-d66fe4796f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:06.817209 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba776ad8-0c8d-4c2c-8d93-d66fe4796f32 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:06.827994 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba776ad8-0c8d-4c2c-8d93-d66fe4796f32 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:47:06.834667 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-ba776ad8-0c8d-4c2c-8d93-d66fe4796f32 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:47:06.835794 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 554/1099] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:47:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:47:06.841478 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbe6db-e4ad-492a-ab40-54f42c0b7371 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:06.850203 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbe6db-e4ad-492a-ab40-54f42c0b7371 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:06.855788 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e4d7e-2f17-49bc-8727-5ae76c131a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:06.856428 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e4d7e-2f17-49bc-8727-5ae76c131a36 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:06.856702 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e4d7e-2f17-49bc-8727-5ae76c131a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:06.856969 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e4d7e-2f17-49bc-8727-5ae76c131a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:06.857744 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e4d7e-2f17-49bc-8727-5ae76c131a36 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:06.858040 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e4d7e-2f17-49bc-8727-5ae76c131a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:06.859625 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e4d7e-2f17-49bc-8727-5ae76c131a36 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:06.867515 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 546/1100] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:47:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:06.872993 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba776ad8-0c8d-4c2c-8d93-d66fe4796f32 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:06.882998 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba776ad8-0c8d-4c2c-8d93-d66fe4796f32 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:06.891350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5433264-94bf-4529-91ca-176484cfb689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:06.893592 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5433264-94bf-4529-91ca-176484cfb689 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:06.893592 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5433264-94bf-4529-91ca-176484cfb689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:06.893592 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5433264-94bf-4529-91ca-176484cfb689 admin admin] PATH_INFO: `/v3/users/8985e6a45f0c4a39ade7d2fa8bafe030` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:06.895777 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5433264-94bf-4529-91ca-176484cfb689 admin admin] RBAC: Authorizing `identity:get_user(user_id=8985e6a45f0c4a39ade7d2fa8bafe030)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:06.899148 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5433264-94bf-4529-91ca-176484cfb689 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:06.901659 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 555/1101] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:47:06 2022] GET /identity/v3/users/8985e6a45f0c4a39ade7d2fa8bafe030 => generated 285 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:47:06.911054 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e4d7e-2f17-49bc-8727-5ae76c131a36 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:06.927425 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e4d7e-2f17-49bc-8727-5ae76c131a36 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:06.936883 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521058b1-99de-4dc6-91af-736b986a9802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:06.938335 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521058b1-99de-4dc6-91af-736b986a9802 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:06.938786 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521058b1-99de-4dc6-91af-736b986a9802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:06.939641 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521058b1-99de-4dc6-91af-736b986a9802 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:06.953984 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521058b1-99de-4dc6-91af-736b986a9802 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:06.956198 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521058b1-99de-4dc6-91af-736b986a9802 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:06.965642 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 547/1102] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:47:06 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:47:06.971457 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5433264-94bf-4529-91ca-176484cfb689 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:06.982480 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5433264-94bf-4529-91ca-176484cfb689 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:06.988523 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad752cb-6650-4a51-a05a-f877c922f956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:06.989366 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad752cb-6650-4a51-a05a-f877c922f956 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:06.989654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad752cb-6650-4a51-a05a-f877c922f956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:06.989919 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad752cb-6650-4a51-a05a-f877c922f956 admin admin] PATH_INFO: `/v3/projects/c38f2eeb848b4a74bef0e99388202f6e` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:06.991208 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad752cb-6650-4a51-a05a-f877c922f956 admin admin] RBAC: Authorizing `identity:get_project(project_id=c38f2eeb848b4a74bef0e99388202f6e)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:06.993209 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad752cb-6650-4a51-a05a-f877c922f956 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:06.994868 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 556/1103] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:47:06 2022] GET /identity/v3/projects/c38f2eeb848b4a74bef0e99388202f6e => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:07.000397 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521058b1-99de-4dc6-91af-736b986a9802 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:07.009400 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521058b1-99de-4dc6-91af-736b986a9802 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:07.014521 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76afdbf-c655-4769-a61f-f7124c222445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:07.015134 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76afdbf-c655-4769-a61f-f7124c222445 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:07.015405 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76afdbf-c655-4769-a61f-f7124c222445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:07.015665 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76afdbf-c655-4769-a61f-f7124c222445 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:07.016475 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76afdbf-c655-4769-a61f-f7124c222445 admin admin] RBAC: Adding query filter params (role.id=e06447c1c62d465c9f9c58168be71ed8, scope.project.id=c38f2eeb848b4a74bef0e99388202f6e, user.id=8985e6a45f0c4a39ade7d2fa8bafe030) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:07.016775 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76afdbf-c655-4769-a61f-f7124c222445 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:07.018557 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76afdbf-c655-4769-a61f-f7124c222445 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:07.024295 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 548/1104] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:47:06 2022] GET /identity/v3/role_assignments?user.id=8985e6a45f0c4a39ade7d2fa8bafe030&scope.project.id=c38f2eeb848b4a74bef0e99388202f6e&role.id=e06447c1c62d465c9f9c58168be71ed8 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:09.272129 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecc5ea-abba-433c-a2f3-b696fa857ef4 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:09.272985 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecc5ea-abba-433c-a2f3-b696fa857ef4 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:09.272985 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecc5ea-abba-433c-a2f3-b696fa857ef4 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:09.276489 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 557/1105] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:47:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:47:09.283310 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a8382-132a-4a39-9ca6-f00c727b8f06 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:09.283742 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a8382-132a-4a39-9ca6-f00c727b8f06 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:09.283860 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a8382-132a-4a39-9ca6-f00c727b8f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:09.305305 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-bc1a8382-132a-4a39-9ca6-f00c727b8f06 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:47:09.306506 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-bc1a8382-132a-4a39-9ca6-f00c727b8f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:47:09.315274 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 549/1106] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:47:09 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:47:09.341674 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecc5ea-abba-433c-a2f3-b696fa857ef4 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:09.363477 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecc5ea-abba-433c-a2f3-b696fa857ef4 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:09.370923 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8095763-f2db-46a7-8e91-830a9bc6c28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:09.371694 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8095763-f2db-46a7-8e91-830a9bc6c28a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:09.371967 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8095763-f2db-46a7-8e91-830a9bc6c28a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:09.372233 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8095763-f2db-46a7-8e91-830a9bc6c28a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:09.373661 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8095763-f2db-46a7-8e91-830a9bc6c28a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:09.375344 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8095763-f2db-46a7-8e91-830a9bc6c28a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:09.376913 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 558/1107] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:47:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:09.382528 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a8382-132a-4a39-9ca6-f00c727b8f06 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:09.391932 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a8382-132a-4a39-9ca6-f00c727b8f06 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:09.397506 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f18ca-14be-4a9a-8df4-25ec4ff469a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:09.398232 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f18ca-14be-4a9a-8df4-25ec4ff469a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:09.398503 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f18ca-14be-4a9a-8df4-25ec4ff469a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:09.398768 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f18ca-14be-4a9a-8df4-25ec4ff469a3 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:09.399477 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f18ca-14be-4a9a-8df4-25ec4ff469a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:09.401379 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f18ca-14be-4a9a-8df4-25ec4ff469a3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:09.422231 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 550/1108] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 10 20:47:09 2022] POST /identity/v3/users => generated 286 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:47:11.651680 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760fcb2-c3d1-4f3b-a546-07aaf03871c3 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:11.652660 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760fcb2-c3d1-4f3b-a546-07aaf03871c3 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:11.652660 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760fcb2-c3d1-4f3b-a546-07aaf03871c3 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:11.655465 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 559/1109] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:47:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:47:11.661082 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d0922-011e-4cbb-8db9-573144f8a5c3 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:11.661552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d0922-011e-4cbb-8db9-573144f8a5c3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:11.661649 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d0922-011e-4cbb-8db9-573144f8a5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:11.680967 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-021d0922-011e-4cbb-8db9-573144f8a5c3 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:47:11.682155 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-021d0922-011e-4cbb-8db9-573144f8a5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:47:11.690814 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 551/1110] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:47:11 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:47:11.715556 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760fcb2-c3d1-4f3b-a546-07aaf03871c3 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:11.736537 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760fcb2-c3d1-4f3b-a546-07aaf03871c3 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:11.745122 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe9939-675a-4e0f-99bf-3fa25d2cd4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:11.746362 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe9939-675a-4e0f-99bf-3fa25d2cd4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:11.746716 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe9939-675a-4e0f-99bf-3fa25d2cd4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:11.747076 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe9939-675a-4e0f-99bf-3fa25d2cd4f1 admin admin] PATH_INFO: `/v3/roles/fbf072f915fc46ee9a80c656e2bb2b30` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:11.749638 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe9939-675a-4e0f-99bf-3fa25d2cd4f1 admin admin] RBAC: Authorizing `identity:get_role(role_id=fbf072f915fc46ee9a80c656e2bb2b30)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:11.751174 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING py.warnings [None req-4ebe9939-675a-4e0f-99bf-3fa25d2cd4f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:47:11.751174 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: warnings.warn(msg) Feb 10 20:47:11.751174 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: Feb 10 20:47:11.752408 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe9939-675a-4e0f-99bf-3fa25d2cd4f1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:11.754462 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 560/1111] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:47:11 2022] GET /identity/v3/roles/fbf072f915fc46ee9a80c656e2bb2b30 => generated 223 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:11.762511 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d0922-011e-4cbb-8db9-573144f8a5c3 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:11.771738 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d0922-011e-4cbb-8db9-573144f8a5c3 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:11.777816 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869afcf3-f03d-4db5-b53b-63581ec73261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:11.778661 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869afcf3-f03d-4db5-b53b-63581ec73261 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:11.778937 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869afcf3-f03d-4db5-b53b-63581ec73261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:11.779203 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869afcf3-f03d-4db5-b53b-63581ec73261 admin admin] PATH_INFO: `/v3/users/70e3dd4c024f42b8aceb40b7a87fdbb4` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:11.793835 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869afcf3-f03d-4db5-b53b-63581ec73261 admin admin] RBAC: Authorizing `identity:get_user(user_id=70e3dd4c024f42b8aceb40b7a87fdbb4)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:11.795893 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869afcf3-f03d-4db5-b53b-63581ec73261 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:11.797544 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 552/1112] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:47:11 2022] GET /identity/v3/users/70e3dd4c024f42b8aceb40b7a87fdbb4 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:11.803153 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe9939-675a-4e0f-99bf-3fa25d2cd4f1 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:11.813766 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe9939-675a-4e0f-99bf-3fa25d2cd4f1 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:11.819838 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb08dc-dc30-403c-8563-6cc18d968e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:11.820442 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb08dc-dc30-403c-8563-6cc18d968e89 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:11.820717 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb08dc-dc30-403c-8563-6cc18d968e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:11.820980 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb08dc-dc30-403c-8563-6cc18d968e89 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:11.829733 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb08dc-dc30-403c-8563-6cc18d968e89 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:11.831793 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb08dc-dc30-403c-8563-6cc18d968e89 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:11.840929 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 561/1113] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:47:11 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:47:11.846919 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869afcf3-f03d-4db5-b53b-63581ec73261 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:11.863155 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869afcf3-f03d-4db5-b53b-63581ec73261 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:11.870986 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b65a7-d1ad-43c2-af88-af3dfacfe2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:11.871796 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b65a7-d1ad-43c2-af88-af3dfacfe2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:11.872065 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b65a7-d1ad-43c2-af88-af3dfacfe2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:11.872328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b65a7-d1ad-43c2-af88-af3dfacfe2a6 admin admin] PATH_INFO: `/v3/projects/c38f2eeb848b4a74bef0e99388202f6e` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:11.873745 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b65a7-d1ad-43c2-af88-af3dfacfe2a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=c38f2eeb848b4a74bef0e99388202f6e)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:11.875708 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b65a7-d1ad-43c2-af88-af3dfacfe2a6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:11.877308 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 553/1114] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:47:11 2022] GET /identity/v3/projects/c38f2eeb848b4a74bef0e99388202f6e => generated 311 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:11.883473 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb08dc-dc30-403c-8563-6cc18d968e89 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:11.897043 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb08dc-dc30-403c-8563-6cc18d968e89 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:11.903546 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be745b85-8d1e-4273-b118-6da99d610305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:11.904143 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be745b85-8d1e-4273-b118-6da99d610305 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:11.904410 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be745b85-8d1e-4273-b118-6da99d610305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:11.904676 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be745b85-8d1e-4273-b118-6da99d610305 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:11.905517 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be745b85-8d1e-4273-b118-6da99d610305 admin admin] RBAC: Adding query filter params (role.id=fbf072f915fc46ee9a80c656e2bb2b30, scope.project.id=c38f2eeb848b4a74bef0e99388202f6e, user.id=70e3dd4c024f42b8aceb40b7a87fdbb4) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:11.905795 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be745b85-8d1e-4273-b118-6da99d610305 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:11.907584 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be745b85-8d1e-4273-b118-6da99d610305 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:11.913238 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 562/1115] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:47:11 2022] GET /identity/v3/role_assignments?user.id=70e3dd4c024f42b8aceb40b7a87fdbb4&scope.project.id=c38f2eeb848b4a74bef0e99388202f6e&role.id=fbf072f915fc46ee9a80c656e2bb2b30 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:14.078075 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c7b6d-5f33-4b33-852e-b167c8706d7b None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:14.078966 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c7b6d-5f33-4b33-852e-b167c8706d7b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:14.078966 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c7b6d-5f33-4b33-852e-b167c8706d7b None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:14.082216 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 554/1116] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:47:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:47:14.089906 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35830e11-892f-4892-9bef-a8511cb8fe0e None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:14.090306 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35830e11-892f-4892-9bef-a8511cb8fe0e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:14.090458 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35830e11-892f-4892-9bef-a8511cb8fe0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:14.109541 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-35830e11-892f-4892-9bef-a8511cb8fe0e None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:47:14.110726 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-35830e11-892f-4892-9bef-a8511cb8fe0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:47:14.120085 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 563/1117] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:47:14 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:47:14.143734 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c7b6d-5f33-4b33-852e-b167c8706d7b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:14.157740 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c7b6d-5f33-4b33-852e-b167c8706d7b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:14.163202 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9769288-123e-4fe1-a220-ae7b44686e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:14.164036 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9769288-123e-4fe1-a220-ae7b44686e34 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:14.164317 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9769288-123e-4fe1-a220-ae7b44686e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:14.164584 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9769288-123e-4fe1-a220-ae7b44686e34 admin admin] PATH_INFO: `/v3/roles/fbf072f915fc46ee9a80c656e2bb2b30` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:14.166120 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9769288-123e-4fe1-a220-ae7b44686e34 admin admin] RBAC: Authorizing `identity:get_role(role_id=fbf072f915fc46ee9a80c656e2bb2b30)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:14.167132 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-c9769288-123e-4fe1-a220-ae7b44686e34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:47:14.167132 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Feb 10 20:47:14.167132 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: Feb 10 20:47:14.167992 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9769288-123e-4fe1-a220-ae7b44686e34 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:14.169300 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 555/1118] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:47:14 2022] GET /identity/v3/roles/fbf072f915fc46ee9a80c656e2bb2b30 => generated 223 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:14.174836 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35830e11-892f-4892-9bef-a8511cb8fe0e None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:14.183707 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35830e11-892f-4892-9bef-a8511cb8fe0e None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:14.189094 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bef81f-c6ff-49af-9997-cb6c9b499cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:14.189966 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bef81f-c6ff-49af-9997-cb6c9b499cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:14.190240 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bef81f-c6ff-49af-9997-cb6c9b499cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:14.190505 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bef81f-c6ff-49af-9997-cb6c9b499cb9 admin admin] PATH_INFO: `/v3/users/70e3dd4c024f42b8aceb40b7a87fdbb4` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:14.191841 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bef81f-c6ff-49af-9997-cb6c9b499cb9 admin admin] RBAC: Authorizing `identity:get_user(user_id=70e3dd4c024f42b8aceb40b7a87fdbb4)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:14.193992 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bef81f-c6ff-49af-9997-cb6c9b499cb9 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:14.195552 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 564/1119] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:47:14 2022] GET /identity/v3/users/70e3dd4c024f42b8aceb40b7a87fdbb4 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:14.200903 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9769288-123e-4fe1-a220-ae7b44686e34 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:14.211040 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9769288-123e-4fe1-a220-ae7b44686e34 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:14.216808 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bf1d3-1531-4516-b6b5-f7a78c86cab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:14.217640 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bf1d3-1531-4516-b6b5-f7a78c86cab6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:14.217914 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bf1d3-1531-4516-b6b5-f7a78c86cab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:14.218185 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bf1d3-1531-4516-b6b5-f7a78c86cab6 admin admin] PATH_INFO: `/v3/projects/c38f2eeb848b4a74bef0e99388202f6e` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:14.219476 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bf1d3-1531-4516-b6b5-f7a78c86cab6 admin admin] RBAC: Authorizing `identity:get_project(project_id=c38f2eeb848b4a74bef0e99388202f6e)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:14.221482 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bf1d3-1531-4516-b6b5-f7a78c86cab6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:14.223071 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 556/1120] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:47:14 2022] GET /identity/v3/projects/c38f2eeb848b4a74bef0e99388202f6e => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:14.228540 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bef81f-c6ff-49af-9997-cb6c9b499cb9 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:14.237937 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bef81f-c6ff-49af-9997-cb6c9b499cb9 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:14.242895 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5515a66-1d98-44bc-875a-63cbfdf1798c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:14.243744 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5515a66-1d98-44bc-875a-63cbfdf1798c admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:14.244015 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5515a66-1d98-44bc-875a-63cbfdf1798c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:14.244284 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5515a66-1d98-44bc-875a-63cbfdf1798c admin admin] PATH_INFO: `/v3/projects/c38f2eeb848b4a74bef0e99388202f6e/users/70e3dd4c024f42b8aceb40b7a87fdbb4/roles/fbf072f915fc46ee9a80c656e2bb2b30` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:14.246637 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5515a66-1d98-44bc-875a-63cbfdf1798c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38f2eeb848b4a74bef0e99388202f6e, user_id=70e3dd4c024f42b8aceb40b7a87fdbb4, role_id=fbf072f915fc46ee9a80c656e2bb2b30)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:14.249177 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5515a66-1d98-44bc-875a-63cbfdf1798c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:14.265528 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 565/1121] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:47:14 2022] PUT /identity/v3/projects/c38f2eeb848b4a74bef0e99388202f6e/users/70e3dd4c024f42b8aceb40b7a87fdbb4/roles/fbf072f915fc46ee9a80c656e2bb2b30 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:47:16.440188 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aba01-4509-4c2f-a80c-178ba5400a24 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:16.441069 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aba01-4509-4c2f-a80c-178ba5400a24 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:16.441069 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aba01-4509-4c2f-a80c-178ba5400a24 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:16.443902 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 557/1122] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:47:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:47:16.452717 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4496ac-79ef-47af-b676-d2f52f7a3eea None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:16.453125 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4496ac-79ef-47af-b676-d2f52f7a3eea None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:16.453266 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4496ac-79ef-47af-b676-d2f52f7a3eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:16.476707 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-ce4496ac-79ef-47af-b676-d2f52f7a3eea None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:47:16.477911 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ce4496ac-79ef-47af-b676-d2f52f7a3eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:47:16.660456 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 566/1123] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:47:16 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:47:16.684600 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aba01-4509-4c2f-a80c-178ba5400a24 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:16.700217 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aba01-4509-4c2f-a80c-178ba5400a24 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:16.706246 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0717a-cc7d-4238-8033-91d57533bad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:16.707448 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0717a-cc7d-4238-8033-91d57533bad3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:16.707725 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0717a-cc7d-4238-8033-91d57533bad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:16.707994 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0717a-cc7d-4238-8033-91d57533bad3 admin admin] PATH_INFO: `/v3/roles/fbf072f915fc46ee9a80c656e2bb2b30` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:16.709644 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0717a-cc7d-4238-8033-91d57533bad3 admin admin] RBAC: Authorizing `identity:get_role(role_id=fbf072f915fc46ee9a80c656e2bb2b30)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:16.711277 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0717a-cc7d-4238-8033-91d57533bad3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:16.712622 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 558/1124] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:47:16 2022] GET /identity/v3/roles/fbf072f915fc46ee9a80c656e2bb2b30 => generated 223 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:16.718137 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4496ac-79ef-47af-b676-d2f52f7a3eea None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:16.726672 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4496ac-79ef-47af-b676-d2f52f7a3eea None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:16.732087 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ccb05-0cd3-41af-9526-26f306ab41fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:16.732953 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ccb05-0cd3-41af-9526-26f306ab41fe admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:16.733235 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ccb05-0cd3-41af-9526-26f306ab41fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:16.733526 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ccb05-0cd3-41af-9526-26f306ab41fe admin admin] PATH_INFO: `/v3/users/70e3dd4c024f42b8aceb40b7a87fdbb4` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:16.734761 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ccb05-0cd3-41af-9526-26f306ab41fe admin admin] RBAC: Authorizing `identity:get_user(user_id=70e3dd4c024f42b8aceb40b7a87fdbb4)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:16.736835 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ccb05-0cd3-41af-9526-26f306ab41fe admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:16.738401 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 567/1125] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:47:16 2022] GET /identity/v3/users/70e3dd4c024f42b8aceb40b7a87fdbb4 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:16.743559 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0717a-cc7d-4238-8033-91d57533bad3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:16.754391 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0717a-cc7d-4238-8033-91d57533bad3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:16.760332 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd1d3c-53ae-404c-be77-4251e2ad0045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:16.760948 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd1d3c-53ae-404c-be77-4251e2ad0045 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:16.761229 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd1d3c-53ae-404c-be77-4251e2ad0045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:16.761559 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd1d3c-53ae-404c-be77-4251e2ad0045 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:16.770489 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd1d3c-53ae-404c-be77-4251e2ad0045 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:16.772187 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd1d3c-53ae-404c-be77-4251e2ad0045 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:16.782401 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 559/1126] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:47:16 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:47:16.788117 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ccb05-0cd3-41af-9526-26f306ab41fe admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:16.798679 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ccb05-0cd3-41af-9526-26f306ab41fe admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:16.804786 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6e45c-cf81-4cdd-8247-e5973774d5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:16.805639 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6e45c-cf81-4cdd-8247-e5973774d5cd admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:16.805909 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6e45c-cf81-4cdd-8247-e5973774d5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:16.806169 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6e45c-cf81-4cdd-8247-e5973774d5cd admin admin] PATH_INFO: `/v3/projects/c38f2eeb848b4a74bef0e99388202f6e` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:16.807571 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6e45c-cf81-4cdd-8247-e5973774d5cd admin admin] RBAC: Authorizing `identity:get_project(project_id=c38f2eeb848b4a74bef0e99388202f6e)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:16.809600 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6e45c-cf81-4cdd-8247-e5973774d5cd admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:16.811213 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 568/1127] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:47:16 2022] GET /identity/v3/projects/c38f2eeb848b4a74bef0e99388202f6e => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:16.817658 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd1d3c-53ae-404c-be77-4251e2ad0045 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:16.829233 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd1d3c-53ae-404c-be77-4251e2ad0045 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:16.836096 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d541c79-6268-416a-89de-f57931a1f890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:16.836712 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d541c79-6268-416a-89de-f57931a1f890 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:16.836987 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d541c79-6268-416a-89de-f57931a1f890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:16.837255 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d541c79-6268-416a-89de-f57931a1f890 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:16.838118 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d541c79-6268-416a-89de-f57931a1f890 admin admin] RBAC: Adding query filter params (role.id=fbf072f915fc46ee9a80c656e2bb2b30, scope.project.id=c38f2eeb848b4a74bef0e99388202f6e, user.id=70e3dd4c024f42b8aceb40b7a87fdbb4) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:16.838502 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d541c79-6268-416a-89de-f57931a1f890 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:16.840316 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d541c79-6268-416a-89de-f57931a1f890 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:16.846446 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 560/1128] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:47:16 2022] GET /identity/v3/role_assignments?user.id=70e3dd4c024f42b8aceb40b7a87fdbb4&scope.project.id=c38f2eeb848b4a74bef0e99388202f6e&role.id=fbf072f915fc46ee9a80c656e2bb2b30 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:19.067625 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6172d07-2eab-4741-a5e5-cb703b44be2b None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:19.068496 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6172d07-2eab-4741-a5e5-cb703b44be2b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:19.068496 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6172d07-2eab-4741-a5e5-cb703b44be2b None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:19.071189 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 569/1129] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:47:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:47:19.076785 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a6ca4-48cd-4353-b885-fdc43fd4c71e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:19.077198 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a6ca4-48cd-4353-b885-fdc43fd4c71e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:19.077310 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a6ca4-48cd-4353-b885-fdc43fd4c71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:19.096686 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-4c0a6ca4-48cd-4353-b885-fdc43fd4c71e None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:47:19.097887 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4c0a6ca4-48cd-4353-b885-fdc43fd4c71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:47:19.106138 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 561/1130] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:47:19 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:47:19.130762 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6172d07-2eab-4741-a5e5-cb703b44be2b None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:19.152164 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6172d07-2eab-4741-a5e5-cb703b44be2b None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:19.158287 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb95c84-8f45-4b1f-a1b2-b5e245e24ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:19.159040 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb95c84-8f45-4b1f-a1b2-b5e245e24ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:19.159313 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb95c84-8f45-4b1f-a1b2-b5e245e24ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:19.159575 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb95c84-8f45-4b1f-a1b2-b5e245e24ef7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:19.160938 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb95c84-8f45-4b1f-a1b2-b5e245e24ef7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:19.162647 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb95c84-8f45-4b1f-a1b2-b5e245e24ef7 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:19.164188 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 570/1131] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:47:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:19.169833 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a6ca4-48cd-4353-b885-fdc43fd4c71e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:19.179166 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a6ca4-48cd-4353-b885-fdc43fd4c71e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:19.185239 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7b639-e79b-4bac-844f-c7f715a4573e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:19.185904 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7b639-e79b-4bac-844f-c7f715a4573e admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:19.186180 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7b639-e79b-4bac-844f-c7f715a4573e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:19.186446 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7b639-e79b-4bac-844f-c7f715a4573e admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:19.187156 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7b639-e79b-4bac-844f-c7f715a4573e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:19.189018 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7b639-e79b-4bac-844f-c7f715a4573e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:19.223628 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 562/1132] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 10 20:47:19 2022] POST /identity/v3/projects => generated 311 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:47:21.413434 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6004d-61f0-419f-9f97-86b2cf11eca9 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:21.414290 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6004d-61f0-419f-9f97-86b2cf11eca9 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:21.414290 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6004d-61f0-419f-9f97-86b2cf11eca9 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:21.417111 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 571/1133] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:47:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:47:21.426099 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a8ed5-6b99-4937-94f4-a89a6c02794c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:21.426521 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a8ed5-6b99-4937-94f4-a89a6c02794c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:21.426685 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a8ed5-6b99-4937-94f4-a89a6c02794c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:21.447837 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-6d9a8ed5-6b99-4937-94f4-a89a6c02794c None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:47:21.449047 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6d9a8ed5-6b99-4937-94f4-a89a6c02794c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:47:21.507878 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 563/1134] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:47:21 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:47:21.533342 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6004d-61f0-419f-9f97-86b2cf11eca9 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:21.548481 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6004d-61f0-419f-9f97-86b2cf11eca9 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:21.554635 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b923b09-2d09-45d5-9642-7da4d40a8cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:21.555417 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b923b09-2d09-45d5-9642-7da4d40a8cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:21.555690 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b923b09-2d09-45d5-9642-7da4d40a8cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:21.555957 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b923b09-2d09-45d5-9642-7da4d40a8cb2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:21.557270 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b923b09-2d09-45d5-9642-7da4d40a8cb2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:21.559103 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b923b09-2d09-45d5-9642-7da4d40a8cb2 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:21.560646 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 572/1135] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:47:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:21.566685 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a8ed5-6b99-4937-94f4-a89a6c02794c None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:21.580957 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a8ed5-6b99-4937-94f4-a89a6c02794c None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:21.590262 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00164be4-bce7-4e0c-ad0a-7622448e4efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:21.590920 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00164be4-bce7-4e0c-ad0a-7622448e4efc admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:21.591193 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00164be4-bce7-4e0c-ad0a-7622448e4efc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:21.591457 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00164be4-bce7-4e0c-ad0a-7622448e4efc admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:21.592182 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00164be4-bce7-4e0c-ad0a-7622448e4efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:21.594115 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00164be4-bce7-4e0c-ad0a-7622448e4efc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:21.616153 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 564/1136] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 10 20:47:21 2022] POST /identity/v3/users => generated 286 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:47:23.857702 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42675246-4148-490a-adf0-a77a90659285 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:23.858541 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42675246-4148-490a-adf0-a77a90659285 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:23.858541 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42675246-4148-490a-adf0-a77a90659285 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:23.861319 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 573/1137] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:47:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:47:23.870350 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c641e-d4ba-406d-8ef5-71e2daca6cf3 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:23.871068 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c641e-d4ba-406d-8ef5-71e2daca6cf3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:23.871239 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c641e-d4ba-406d-8ef5-71e2daca6cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:23.892029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-cb2c641e-d4ba-406d-8ef5-71e2daca6cf3 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:47:23.893202 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-cb2c641e-d4ba-406d-8ef5-71e2daca6cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:47:23.903264 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 565/1138] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:47:23 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:47:23.927450 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42675246-4148-490a-adf0-a77a90659285 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:23.944737 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42675246-4148-490a-adf0-a77a90659285 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:23.950871 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fd326-e5b3-4eff-bfb1-e2b6a7a8ad2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:23.951630 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fd326-e5b3-4eff-bfb1-e2b6a7a8ad2b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:23.951898 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fd326-e5b3-4eff-bfb1-e2b6a7a8ad2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:23.952165 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fd326-e5b3-4eff-bfb1-e2b6a7a8ad2b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:23.964500 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fd326-e5b3-4eff-bfb1-e2b6a7a8ad2b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:47:23.971346 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-af5fd326-e5b3-4eff-bfb1-e2b6a7a8ad2b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:47:23.972461 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 574/1139] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:47:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:47:23.981129 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c641e-d4ba-406d-8ef5-71e2daca6cf3 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:23.990959 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c641e-d4ba-406d-8ef5-71e2daca6cf3 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:23.996712 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc990599-b3d4-4eee-a2b2-095e15b52dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:23.997390 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc990599-b3d4-4eee-a2b2-095e15b52dfb admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:23.997689 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc990599-b3d4-4eee-a2b2-095e15b52dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:23.997949 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc990599-b3d4-4eee-a2b2-095e15b52dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:23.998694 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc990599-b3d4-4eee-a2b2-095e15b52dfb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:23.998985 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc990599-b3d4-4eee-a2b2-095e15b52dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:24.000567 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc990599-b3d4-4eee-a2b2-095e15b52dfb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:24.009907 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 566/1140] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:47:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:24.016037 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fd326-e5b3-4eff-bfb1-e2b6a7a8ad2b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:24.030851 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fd326-e5b3-4eff-bfb1-e2b6a7a8ad2b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:24.036166 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8766b4-4c54-4429-a0a7-a205368493d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:24.036970 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8766b4-4c54-4429-a0a7-a205368493d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:24.037241 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8766b4-4c54-4429-a0a7-a205368493d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:24.037533 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8766b4-4c54-4429-a0a7-a205368493d3 admin admin] PATH_INFO: `/v3/users/e0c0b43f73c644fcb93f9697a0c59696` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:24.051025 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8766b4-4c54-4429-a0a7-a205368493d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=e0c0b43f73c644fcb93f9697a0c59696)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:24.053214 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8766b4-4c54-4429-a0a7-a205368493d3 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:24.054972 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 575/1141] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:47:24 2022] GET /identity/v3/users/e0c0b43f73c644fcb93f9697a0c59696 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:24.060810 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc990599-b3d4-4eee-a2b2-095e15b52dfb admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:24.070283 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc990599-b3d4-4eee-a2b2-095e15b52dfb admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:24.075261 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5878dd9-c7db-449d-a350-7ad546acc0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:24.075899 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5878dd9-c7db-449d-a350-7ad546acc0bc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:24.076164 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5878dd9-c7db-449d-a350-7ad546acc0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:24.076438 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5878dd9-c7db-449d-a350-7ad546acc0bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:24.084239 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5878dd9-c7db-449d-a350-7ad546acc0bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:24.086338 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5878dd9-c7db-449d-a350-7ad546acc0bc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:24.094939 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 567/1142] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:47:24 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:47:24.101053 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8766b4-4c54-4429-a0a7-a205368493d3 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:24.113339 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8766b4-4c54-4429-a0a7-a205368493d3 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:24.119161 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1514e-1acc-4b75-a00f-f5e312488956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:24.119986 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1514e-1acc-4b75-a00f-f5e312488956 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:24.120262 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1514e-1acc-4b75-a00f-f5e312488956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:24.120525 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1514e-1acc-4b75-a00f-f5e312488956 admin admin] PATH_INFO: `/v3/projects/5ee753c266114a76a0dc784d9d7709cc` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:24.121988 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1514e-1acc-4b75-a00f-f5e312488956 admin admin] RBAC: Authorizing `identity:get_project(project_id=5ee753c266114a76a0dc784d9d7709cc)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:24.124004 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1514e-1acc-4b75-a00f-f5e312488956 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:24.125660 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 576/1143] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:47:24 2022] GET /identity/v3/projects/5ee753c266114a76a0dc784d9d7709cc => generated 311 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:24.131254 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5878dd9-c7db-449d-a350-7ad546acc0bc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:24.139754 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5878dd9-c7db-449d-a350-7ad546acc0bc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:24.144674 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954f310-3c7b-4b6f-84e8-5b8ef87647a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:24.145269 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954f310-3c7b-4b6f-84e8-5b8ef87647a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:24.145578 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954f310-3c7b-4b6f-84e8-5b8ef87647a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:24.145843 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954f310-3c7b-4b6f-84e8-5b8ef87647a7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:24.146625 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954f310-3c7b-4b6f-84e8-5b8ef87647a7 admin admin] RBAC: Adding query filter params (role.id=e06447c1c62d465c9f9c58168be71ed8, scope.project.id=5ee753c266114a76a0dc784d9d7709cc, user.id=e0c0b43f73c644fcb93f9697a0c59696) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:24.146922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954f310-3c7b-4b6f-84e8-5b8ef87647a7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:24.148677 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954f310-3c7b-4b6f-84e8-5b8ef87647a7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:24.154108 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 568/1144] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:47:24 2022] GET /identity/v3/role_assignments?user.id=e0c0b43f73c644fcb93f9697a0c59696&scope.project.id=5ee753c266114a76a0dc784d9d7709cc&role.id=e06447c1c62d465c9f9c58168be71ed8 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:26.292611 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bca447-253c-4b96-a972-8b2448dcedf0 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:26.293566 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bca447-253c-4b96-a972-8b2448dcedf0 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:26.293566 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bca447-253c-4b96-a972-8b2448dcedf0 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:26.295895 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 577/1145] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:47:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:47:26.301329 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963d84b-e0db-41dd-bce9-95ff20484236 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:26.301786 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963d84b-e0db-41dd-bce9-95ff20484236 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:26.301882 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963d84b-e0db-41dd-bce9-95ff20484236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:26.321141 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-c963d84b-e0db-41dd-bce9-95ff20484236 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:47:26.322329 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c963d84b-e0db-41dd-bce9-95ff20484236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:47:26.330903 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 569/1146] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:47:26 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:47:26.364716 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bca447-253c-4b96-a972-8b2448dcedf0 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:26.377421 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bca447-253c-4b96-a972-8b2448dcedf0 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:26.382228 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b52219-7639-46e8-b7ed-d8f15cbb5a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:26.383001 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b52219-7639-46e8-b7ed-d8f15cbb5a0a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:26.383274 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b52219-7639-46e8-b7ed-d8f15cbb5a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:26.383539 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b52219-7639-46e8-b7ed-d8f15cbb5a0a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:26.394193 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b52219-7639-46e8-b7ed-d8f15cbb5a0a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:47:26.400796 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-86b52219-7639-46e8-b7ed-d8f15cbb5a0a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:47:26.401944 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 578/1147] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:47:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:47:26.408358 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963d84b-e0db-41dd-bce9-95ff20484236 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:26.421697 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963d84b-e0db-41dd-bce9-95ff20484236 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:26.427521 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc6559-750b-4639-af9e-0ef52596cf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:26.428171 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc6559-750b-4639-af9e-0ef52596cf1b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:26.428446 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc6559-750b-4639-af9e-0ef52596cf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:26.428708 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc6559-750b-4639-af9e-0ef52596cf1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:26.429498 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc6559-750b-4639-af9e-0ef52596cf1b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:26.429799 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc6559-750b-4639-af9e-0ef52596cf1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:26.431422 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc6559-750b-4639-af9e-0ef52596cf1b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:26.440062 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 570/1148] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:47:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:26.445724 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b52219-7639-46e8-b7ed-d8f15cbb5a0a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:26.455831 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b52219-7639-46e8-b7ed-d8f15cbb5a0a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:26.461079 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed267f-ea9e-46ed-897b-c26a4800f9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:26.461920 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed267f-ea9e-46ed-897b-c26a4800f9ef admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:26.462189 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed267f-ea9e-46ed-897b-c26a4800f9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:26.462449 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed267f-ea9e-46ed-897b-c26a4800f9ef admin admin] PATH_INFO: `/v3/users/e0c0b43f73c644fcb93f9697a0c59696` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:26.463656 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed267f-ea9e-46ed-897b-c26a4800f9ef admin admin] RBAC: Authorizing `identity:get_user(user_id=e0c0b43f73c644fcb93f9697a0c59696)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:26.465772 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed267f-ea9e-46ed-897b-c26a4800f9ef admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:26.467358 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 579/1149] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:47:26 2022] GET /identity/v3/users/e0c0b43f73c644fcb93f9697a0c59696 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:26.472577 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc6559-750b-4639-af9e-0ef52596cf1b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:26.481972 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc6559-750b-4639-af9e-0ef52596cf1b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:26.486925 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5508382-d3fb-4a52-91ff-f8af276010dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:26.487736 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5508382-d3fb-4a52-91ff-f8af276010dc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:26.488016 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5508382-d3fb-4a52-91ff-f8af276010dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:26.488285 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5508382-d3fb-4a52-91ff-f8af276010dc admin admin] PATH_INFO: `/v3/projects/5ee753c266114a76a0dc784d9d7709cc` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:26.489507 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5508382-d3fb-4a52-91ff-f8af276010dc admin admin] RBAC: Authorizing `identity:get_project(project_id=5ee753c266114a76a0dc784d9d7709cc)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:26.491492 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5508382-d3fb-4a52-91ff-f8af276010dc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:26.493074 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 571/1150] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:47:26 2022] GET /identity/v3/projects/5ee753c266114a76a0dc784d9d7709cc => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:47:26.498312 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed267f-ea9e-46ed-897b-c26a4800f9ef admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:26.507221 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed267f-ea9e-46ed-897b-c26a4800f9ef admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:26.512149 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8237b4-dc1d-4d5f-bde0-2908097f3130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:26.512954 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8237b4-dc1d-4d5f-bde0-2908097f3130 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:26.513221 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8237b4-dc1d-4d5f-bde0-2908097f3130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:26.513512 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8237b4-dc1d-4d5f-bde0-2908097f3130 admin admin] PATH_INFO: `/v3/projects/5ee753c266114a76a0dc784d9d7709cc/users/e0c0b43f73c644fcb93f9697a0c59696/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:26.515540 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8237b4-dc1d-4d5f-bde0-2908097f3130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee753c266114a76a0dc784d9d7709cc, user_id=e0c0b43f73c644fcb93f9697a0c59696, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:26.518074 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8237b4-dc1d-4d5f-bde0-2908097f3130 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:26.534478 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 580/1151] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:47:26 2022] PUT /identity/v3/projects/5ee753c266114a76a0dc784d9d7709cc/users/e0c0b43f73c644fcb93f9697a0c59696/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:47:28.714308 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7c75e-eeec-4aae-9994-70ef9daed8d6 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:28.715187 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7c75e-eeec-4aae-9994-70ef9daed8d6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:28.715187 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7c75e-eeec-4aae-9994-70ef9daed8d6 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:28.718107 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 572/1152] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:47:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:47:28.723818 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a089b9-f3ca-49cc-b16b-9d564c0d1e66 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:28.724247 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a089b9-f3ca-49cc-b16b-9d564c0d1e66 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:28.724347 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a089b9-f3ca-49cc-b16b-9d564c0d1e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:28.743540 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-08a089b9-f3ca-49cc-b16b-9d564c0d1e66 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:47:28.744714 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-08a089b9-f3ca-49cc-b16b-9d564c0d1e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:47:28.802732 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 581/1153] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:47:28 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:47:28.827338 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7c75e-eeec-4aae-9994-70ef9daed8d6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:28.847321 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7c75e-eeec-4aae-9994-70ef9daed8d6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:28.852858 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21cfa2-8849-4f15-b164-81b0d5f9237c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:28.853665 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21cfa2-8849-4f15-b164-81b0d5f9237c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:28.853941 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21cfa2-8849-4f15-b164-81b0d5f9237c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:28.854205 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21cfa2-8849-4f15-b164-81b0d5f9237c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:28.864568 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21cfa2-8849-4f15-b164-81b0d5f9237c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:47:28.871275 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-8d21cfa2-8849-4f15-b164-81b0d5f9237c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:47:28.872403 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 573/1154] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:47:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:47:28.881682 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a089b9-f3ca-49cc-b16b-9d564c0d1e66 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:28.896104 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a089b9-f3ca-49cc-b16b-9d564c0d1e66 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:28.905340 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d0226-1ee0-4dff-b23f-af5043ab309c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:28.906016 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d0226-1ee0-4dff-b23f-af5043ab309c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:28.906294 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d0226-1ee0-4dff-b23f-af5043ab309c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:28.906559 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d0226-1ee0-4dff-b23f-af5043ab309c admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:28.907318 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d0226-1ee0-4dff-b23f-af5043ab309c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:28.907623 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d0226-1ee0-4dff-b23f-af5043ab309c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:28.909208 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d0226-1ee0-4dff-b23f-af5043ab309c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:28.918729 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 582/1155] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:47:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:28.925075 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21cfa2-8849-4f15-b164-81b0d5f9237c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:28.940897 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21cfa2-8849-4f15-b164-81b0d5f9237c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:28.946710 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a9170-d47f-4be0-b595-64b565d14628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:28.947533 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a9170-d47f-4be0-b595-64b565d14628 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:28.947804 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a9170-d47f-4be0-b595-64b565d14628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:28.948067 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a9170-d47f-4be0-b595-64b565d14628 admin admin] PATH_INFO: `/v3/users/e0c0b43f73c644fcb93f9697a0c59696` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:28.949448 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a9170-d47f-4be0-b595-64b565d14628 admin admin] RBAC: Authorizing `identity:get_user(user_id=e0c0b43f73c644fcb93f9697a0c59696)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:28.951554 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a9170-d47f-4be0-b595-64b565d14628 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:28.953114 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 574/1156] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:47:28 2022] GET /identity/v3/users/e0c0b43f73c644fcb93f9697a0c59696 => generated 286 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:28.958572 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d0226-1ee0-4dff-b23f-af5043ab309c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:28.968681 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d0226-1ee0-4dff-b23f-af5043ab309c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:28.974025 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f349e-769b-4f55-8976-8fb169073e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:28.974627 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f349e-769b-4f55-8976-8fb169073e65 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:28.974907 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f349e-769b-4f55-8976-8fb169073e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:28.975177 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f349e-769b-4f55-8976-8fb169073e65 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:28.983052 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f349e-769b-4f55-8976-8fb169073e65 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:28.984773 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f349e-769b-4f55-8976-8fb169073e65 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:28.993533 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 583/1157] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:47:28 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:47:28.999181 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a9170-d47f-4be0-b595-64b565d14628 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:29.009735 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a9170-d47f-4be0-b595-64b565d14628 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:29.016111 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d233c-a8ba-4b0e-a266-2307e35d9d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:29.016909 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d233c-a8ba-4b0e-a266-2307e35d9d02 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:29.017186 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d233c-a8ba-4b0e-a266-2307e35d9d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:29.017484 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d233c-a8ba-4b0e-a266-2307e35d9d02 admin admin] PATH_INFO: `/v3/projects/5ee753c266114a76a0dc784d9d7709cc` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:29.018865 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d233c-a8ba-4b0e-a266-2307e35d9d02 admin admin] RBAC: Authorizing `identity:get_project(project_id=5ee753c266114a76a0dc784d9d7709cc)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:29.020848 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d233c-a8ba-4b0e-a266-2307e35d9d02 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:29.022488 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 575/1158] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:47:28 2022] GET /identity/v3/projects/5ee753c266114a76a0dc784d9d7709cc => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:29.028276 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f349e-769b-4f55-8976-8fb169073e65 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:29.036896 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f349e-769b-4f55-8976-8fb169073e65 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:29.042598 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6137b-b814-46e3-8123-54d901075bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:29.043196 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6137b-b814-46e3-8123-54d901075bfc admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:29.043476 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6137b-b814-46e3-8123-54d901075bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:29.043747 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6137b-b814-46e3-8123-54d901075bfc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:29.044557 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6137b-b814-46e3-8123-54d901075bfc admin admin] RBAC: Adding query filter params (role.id=e06447c1c62d465c9f9c58168be71ed8, scope.project.id=5ee753c266114a76a0dc784d9d7709cc, user.id=e0c0b43f73c644fcb93f9697a0c59696) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:29.044865 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6137b-b814-46e3-8123-54d901075bfc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:29.046698 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6137b-b814-46e3-8123-54d901075bfc admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:29.052488 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 584/1159] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:47:29 2022] GET /identity/v3/role_assignments?user.id=e0c0b43f73c644fcb93f9697a0c59696&scope.project.id=5ee753c266114a76a0dc784d9d7709cc&role.id=e06447c1c62d465c9f9c58168be71ed8 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:47:31.249593 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb594fca-a4a9-40e0-bcad-1bedfc41705b None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:31.250244 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb594fca-a4a9-40e0-bcad-1bedfc41705b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:31.250244 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb594fca-a4a9-40e0-bcad-1bedfc41705b None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:31.251981 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 576/1160] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:47:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:47:31.258684 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e68b9-a163-428b-9b05-ef4617b2797d None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:31.259448 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e68b9-a163-428b-9b05-ef4617b2797d None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:31.259596 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e68b9-a163-428b-9b05-ef4617b2797d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:31.286714 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-868e68b9-a163-428b-9b05-ef4617b2797d None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:47:31.287890 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-868e68b9-a163-428b-9b05-ef4617b2797d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:47:31.296960 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 585/1161] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:47:31 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:47:31.318990 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb594fca-a4a9-40e0-bcad-1bedfc41705b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:31.333161 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb594fca-a4a9-40e0-bcad-1bedfc41705b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:31.338915 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e5625-ca96-469c-bd5f-0e46e03836b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:31.339524 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e5625-ca96-469c-bd5f-0e46e03836b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:31.339777 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e5625-ca96-469c-bd5f-0e46e03836b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:31.340038 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e5625-ca96-469c-bd5f-0e46e03836b1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:31.347745 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e5625-ca96-469c-bd5f-0e46e03836b1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:31.349494 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e5625-ca96-469c-bd5f-0e46e03836b1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:31.358299 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 577/1162] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:47:31 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:47:31.365618 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e68b9-a163-428b-9b05-ef4617b2797d None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:31.378479 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e68b9-a163-428b-9b05-ef4617b2797d None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:31.384783 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761871c5-276a-4c32-b0a2-b3903e0d6623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:31.385609 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761871c5-276a-4c32-b0a2-b3903e0d6623 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:31.385888 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761871c5-276a-4c32-b0a2-b3903e0d6623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:31.386149 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761871c5-276a-4c32-b0a2-b3903e0d6623 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:31.394277 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761871c5-276a-4c32-b0a2-b3903e0d6623 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:31.396097 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761871c5-276a-4c32-b0a2-b3903e0d6623 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:31.411562 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-761871c5-276a-4c32-b0a2-b3903e0d6623 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 10 20:47:31.412694 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 586/1163] 10.222.0.31 () {56 vars in 1138 bytes} [Thu Feb 10 20:47:31 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:47:31.422511 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e5625-ca96-469c-bd5f-0e46e03836b1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:31.437164 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e5625-ca96-469c-bd5f-0e46e03836b1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:31.443127 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c2a36-2bfc-44ea-b86e-8a6ac4eeccc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:31.443767 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c2a36-2bfc-44ea-b86e-8a6ac4eeccc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:31.444032 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c2a36-2bfc-44ea-b86e-8a6ac4eeccc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:31.444356 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c2a36-2bfc-44ea-b86e-8a6ac4eeccc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:31.445065 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c2a36-2bfc-44ea-b86e-8a6ac4eeccc0 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:31.445377 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c2a36-2bfc-44ea-b86e-8a6ac4eeccc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:31.446943 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c2a36-2bfc-44ea-b86e-8a6ac4eeccc0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:31.454566 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 578/1164] 10.222.0.31 () {56 vars in 1136 bytes} [Thu Feb 10 20:47:31 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:33.654214 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06c2f3-0e6d-42fb-84ca-f1202b05e988 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:33.655041 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06c2f3-0e6d-42fb-84ca-f1202b05e988 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:33.655041 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06c2f3-0e6d-42fb-84ca-f1202b05e988 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:33.657768 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 587/1165] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:47:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:47:33.663279 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69c3be-bfc4-414a-900b-300fc3582c22 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:33.663696 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69c3be-bfc4-414a-900b-300fc3582c22 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:33.663806 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69c3be-bfc4-414a-900b-300fc3582c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:33.684340 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7a69c3be-bfc4-414a-900b-300fc3582c22 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:47:33.685560 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7a69c3be-bfc4-414a-900b-300fc3582c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:47:33.695048 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 579/1166] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:47:33 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:47:33.718907 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06c2f3-0e6d-42fb-84ca-f1202b05e988 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:33.732034 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06c2f3-0e6d-42fb-84ca-f1202b05e988 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:33.737074 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b93a9c-ca0c-45fd-80ec-0c18ad8997c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:33.737751 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b93a9c-ca0c-45fd-80ec-0c18ad8997c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:33.738031 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b93a9c-ca0c-45fd-80ec-0c18ad8997c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:33.738299 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b93a9c-ca0c-45fd-80ec-0c18ad8997c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:33.739043 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b93a9c-ca0c-45fd-80ec-0c18ad8997c8 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:33.740062 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING py.warnings [None req-a4b93a9c-ca0c-45fd-80ec-0c18ad8997c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:47:33.740062 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: warnings.warn(msg) Feb 10 20:47:33.740062 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: Feb 10 20:47:33.740936 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b93a9c-ca0c-45fd-80ec-0c18ad8997c8 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:33.758042 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 588/1167] 10.222.0.31 () {60 vars in 1159 bytes} [Thu Feb 10 20:47:33 2022] POST /identity/v3/domains => generated 267 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:47:35.940448 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f355dca-f8e1-40bb-89a8-20fbc473b4e8 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:35.940993 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f355dca-f8e1-40bb-89a8-20fbc473b4e8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:35.940993 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f355dca-f8e1-40bb-89a8-20fbc473b4e8 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:35.942707 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 580/1168] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:47:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:47:35.949135 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f1b34-e61d-4501-b700-6c82a2cd05f0 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:35.949882 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f1b34-e61d-4501-b700-6c82a2cd05f0 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:35.950025 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f1b34-e61d-4501-b700-6c82a2cd05f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:35.971174 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-aa7f1b34-e61d-4501-b700-6c82a2cd05f0 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:47:35.972351 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-aa7f1b34-e61d-4501-b700-6c82a2cd05f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:47:36.031388 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 589/1169] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:47:35 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:47:36.061759 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f355dca-f8e1-40bb-89a8-20fbc473b4e8 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:36.075735 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f355dca-f8e1-40bb-89a8-20fbc473b4e8 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:36.081718 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863b250-3706-4465-bce7-596966879d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:36.082561 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863b250-3706-4465-bce7-596966879d9d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:36.082843 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863b250-3706-4465-bce7-596966879d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:36.083105 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863b250-3706-4465-bce7-596966879d9d admin admin] PATH_INFO: `/v3/domains/45f9d7e1b8c74f2c9d9c79ea557c1056` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:36.094599 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863b250-3706-4465-bce7-596966879d9d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=45f9d7e1b8c74f2c9d9c79ea557c1056)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:36.096535 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863b250-3706-4465-bce7-596966879d9d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:36.098147 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 581/1170] 10.222.0.31 () {56 vars in 1204 bytes} [Thu Feb 10 20:47:36 2022] GET /identity/v3/domains/45f9d7e1b8c74f2c9d9c79ea557c1056 => generated 267 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:36.107006 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f1b34-e61d-4501-b700-6c82a2cd05f0 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:36.117837 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f1b34-e61d-4501-b700-6c82a2cd05f0 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:36.123900 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c945215-7304-442c-ab0c-8e5a9340f260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:36.124536 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c945215-7304-442c-ab0c-8e5a9340f260 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:36.124811 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c945215-7304-442c-ab0c-8e5a9340f260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:36.125077 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c945215-7304-442c-ab0c-8e5a9340f260 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:36.125812 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c945215-7304-442c-ab0c-8e5a9340f260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:36.127684 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c945215-7304-442c-ab0c-8e5a9340f260 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:36.158300 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 590/1171] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 10 20:47:36 2022] POST /identity/v3/projects => generated 361 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:47:38.347928 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f958b-2f79-4b40-a196-cf292d64647a None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:38.348480 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f958b-2f79-4b40-a196-cf292d64647a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:38.348480 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f958b-2f79-4b40-a196-cf292d64647a None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:38.351278 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 582/1172] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:47:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:47:38.360077 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c1e19-74bf-4093-8a78-87750d435985 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:38.360458 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c1e19-74bf-4093-8a78-87750d435985 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:38.360706 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c1e19-74bf-4093-8a78-87750d435985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:38.379563 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-f95c1e19-74bf-4093-8a78-87750d435985 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:47:38.380745 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-f95c1e19-74bf-4093-8a78-87750d435985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:47:38.455376 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 591/1173] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:47:38 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:47:38.493051 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f958b-2f79-4b40-a196-cf292d64647a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:38.506552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f958b-2f79-4b40-a196-cf292d64647a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:38.511991 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ae243-951e-46db-83bd-b3efe9d73c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:38.512829 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ae243-951e-46db-83bd-b3efe9d73c3d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:38.513102 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ae243-951e-46db-83bd-b3efe9d73c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:38.513399 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ae243-951e-46db-83bd-b3efe9d73c3d admin admin] PATH_INFO: `/v3/domains/45f9d7e1b8c74f2c9d9c79ea557c1056` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:38.514630 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ae243-951e-46db-83bd-b3efe9d73c3d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=45f9d7e1b8c74f2c9d9c79ea557c1056)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:38.516548 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ae243-951e-46db-83bd-b3efe9d73c3d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:38.518183 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 583/1174] 10.222.0.31 () {56 vars in 1204 bytes} [Thu Feb 10 20:47:38 2022] GET /identity/v3/domains/45f9d7e1b8c74f2c9d9c79ea557c1056 => generated 267 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:38.523922 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c1e19-74bf-4093-8a78-87750d435985 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:38.537636 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c1e19-74bf-4093-8a78-87750d435985 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:38.543445 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b8c9c-84ef-4a09-b97c-52de11978a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:38.544125 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b8c9c-84ef-4a09-b97c-52de11978a30 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:38.544395 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b8c9c-84ef-4a09-b97c-52de11978a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:38.544654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b8c9c-84ef-4a09-b97c-52de11978a30 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:38.545393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b8c9c-84ef-4a09-b97c-52de11978a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:38.547289 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b8c9c-84ef-4a09-b97c-52de11978a30 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:38.570437 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 592/1175] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 10 20:47:38 2022] POST /identity/v3/users => generated 311 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:47:40.764262 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99526590-c682-4b0b-a742-cd303e9d0c29 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:40.765201 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99526590-c682-4b0b-a742-cd303e9d0c29 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:40.765201 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99526590-c682-4b0b-a742-cd303e9d0c29 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:40.768085 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 584/1176] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:47:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:47:40.773790 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19bb46-bec9-4139-ba0b-be130d0b2734 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:40.774228 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19bb46-bec9-4139-ba0b-be130d0b2734 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:40.774326 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19bb46-bec9-4139-ba0b-be130d0b2734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:40.794814 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-9b19bb46-bec9-4139-ba0b-be130d0b2734 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:47:40.795930 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-9b19bb46-bec9-4139-ba0b-be130d0b2734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:47:40.805170 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 593/1177] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:47:40 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:47:40.829708 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99526590-c682-4b0b-a742-cd303e9d0c29 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:40.843472 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99526590-c682-4b0b-a742-cd303e9d0c29 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:40.848424 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673ebfe-3427-4904-a4f7-69e6bc1747c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:40.849193 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673ebfe-3427-4904-a4f7-69e6bc1747c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:40.849500 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673ebfe-3427-4904-a4f7-69e6bc1747c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:40.849769 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673ebfe-3427-4904-a4f7-69e6bc1747c3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:40.860630 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673ebfe-3427-4904-a4f7-69e6bc1747c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:47:40.867330 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-5673ebfe-3427-4904-a4f7-69e6bc1747c3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:47:40.868454 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 585/1178] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:47:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:47:40.877121 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19bb46-bec9-4139-ba0b-be130d0b2734 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:40.886795 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19bb46-bec9-4139-ba0b-be130d0b2734 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:40.892670 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cffbc-82c0-4072-9f2b-8aa11d15530d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:40.893317 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cffbc-82c0-4072-9f2b-8aa11d15530d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:40.893619 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cffbc-82c0-4072-9f2b-8aa11d15530d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:40.893888 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cffbc-82c0-4072-9f2b-8aa11d15530d admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:40.894634 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cffbc-82c0-4072-9f2b-8aa11d15530d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:40.894935 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cffbc-82c0-4072-9f2b-8aa11d15530d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:40.896512 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cffbc-82c0-4072-9f2b-8aa11d15530d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:40.905148 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 594/1179] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:47:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:40.911085 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673ebfe-3427-4904-a4f7-69e6bc1747c3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:40.926144 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673ebfe-3427-4904-a4f7-69e6bc1747c3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:40.935359 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed6a88-0a3a-4266-a6ac-67839e4b4ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:40.936546 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed6a88-0a3a-4266-a6ac-67839e4b4ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:40.936850 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed6a88-0a3a-4266-a6ac-67839e4b4ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:40.937137 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed6a88-0a3a-4266-a6ac-67839e4b4ab3 admin admin] PATH_INFO: `/v3/users/2c0498a125b34b778ef2d1f1a6149eb0` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:40.953219 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed6a88-0a3a-4266-a6ac-67839e4b4ab3 admin admin] RBAC: Authorizing `identity:get_user(user_id=2c0498a125b34b778ef2d1f1a6149eb0)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:40.955371 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed6a88-0a3a-4266-a6ac-67839e4b4ab3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:40.956944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 586/1180] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:47:40 2022] GET /identity/v3/users/2c0498a125b34b778ef2d1f1a6149eb0 => generated 311 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:40.965625 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cffbc-82c0-4072-9f2b-8aa11d15530d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:40.978225 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cffbc-82c0-4072-9f2b-8aa11d15530d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:40.983673 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a0f09-9bd4-4b88-93d9-ab305a24e867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:40.984295 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a0f09-9bd4-4b88-93d9-ab305a24e867 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:40.984571 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a0f09-9bd4-4b88-93d9-ab305a24e867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:40.984836 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a0f09-9bd4-4b88-93d9-ab305a24e867 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:40.993056 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a0f09-9bd4-4b88-93d9-ab305a24e867 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:40.994791 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a0f09-9bd4-4b88-93d9-ab305a24e867 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:41.003810 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 595/1181] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:47:40 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:47:41.009849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed6a88-0a3a-4266-a6ac-67839e4b4ab3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:41.024421 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed6a88-0a3a-4266-a6ac-67839e4b4ab3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:41.033769 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb6063-0339-4faa-886f-c7ed43a9662e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:41.034890 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb6063-0339-4faa-886f-c7ed43a9662e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:41.035164 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb6063-0339-4faa-886f-c7ed43a9662e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:41.035431 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb6063-0339-4faa-886f-c7ed43a9662e admin admin] PATH_INFO: `/v3/projects/8ca90ffb965c4cf59d4f88e05e60e346` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:41.036803 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb6063-0339-4faa-886f-c7ed43a9662e admin admin] RBAC: Authorizing `identity:get_project(project_id=8ca90ffb965c4cf59d4f88e05e60e346)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:41.038815 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb6063-0339-4faa-886f-c7ed43a9662e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:41.040415 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 587/1182] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:47:41 2022] GET /identity/v3/projects/8ca90ffb965c4cf59d4f88e05e60e346 => generated 361 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:47:41.046190 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a0f09-9bd4-4b88-93d9-ab305a24e867 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:41.054885 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a0f09-9bd4-4b88-93d9-ab305a24e867 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:41.060857 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a53313-72ba-4d76-b10b-cc954202df0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:41.061486 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a53313-72ba-4d76-b10b-cc954202df0a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:41.061770 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a53313-72ba-4d76-b10b-cc954202df0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:41.062017 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a53313-72ba-4d76-b10b-cc954202df0a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:41.062820 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a53313-72ba-4d76-b10b-cc954202df0a admin admin] RBAC: Adding query filter params (role.id=e06447c1c62d465c9f9c58168be71ed8, scope.project.id=8ca90ffb965c4cf59d4f88e05e60e346, user.id=2c0498a125b34b778ef2d1f1a6149eb0) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:41.063118 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a53313-72ba-4d76-b10b-cc954202df0a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:41.064876 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a53313-72ba-4d76-b10b-cc954202df0a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:41.070666 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 596/1183] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:47:41 2022] GET /identity/v3/role_assignments?user.id=2c0498a125b34b778ef2d1f1a6149eb0&scope.project.id=8ca90ffb965c4cf59d4f88e05e60e346&role.id=e06447c1c62d465c9f9c58168be71ed8 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:43.204025 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6183d-9c2f-4fbf-b7db-efcb0f80a14e None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:43.204916 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6183d-9c2f-4fbf-b7db-efcb0f80a14e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:43.204916 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6183d-9c2f-4fbf-b7db-efcb0f80a14e None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:43.207880 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 588/1184] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:47:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:47:43.213328 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c45ff-563c-4375-8777-321cca0322c1 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:43.213780 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c45ff-563c-4375-8777-321cca0322c1 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:43.213869 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c45ff-563c-4375-8777-321cca0322c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:43.233507 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-3d9c45ff-563c-4375-8777-321cca0322c1 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:47:43.234664 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-3d9c45ff-563c-4375-8777-321cca0322c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:47:43.243291 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 597/1185] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:47:43 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:47:43.266692 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6183d-9c2f-4fbf-b7db-efcb0f80a14e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:43.286930 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6183d-9c2f-4fbf-b7db-efcb0f80a14e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:43.291715 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42d2ec-fdf1-45f6-8be7-3f55aa077816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:43.292494 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42d2ec-fdf1-45f6-8be7-3f55aa077816 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:43.292770 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42d2ec-fdf1-45f6-8be7-3f55aa077816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:43.293040 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42d2ec-fdf1-45f6-8be7-3f55aa077816 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:43.304806 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42d2ec-fdf1-45f6-8be7-3f55aa077816 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:47:43.311515 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-fb42d2ec-fdf1-45f6-8be7-3f55aa077816 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:47:43.312642 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 589/1186] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:47:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:47:43.318671 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c45ff-563c-4375-8777-321cca0322c1 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:43.327773 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c45ff-563c-4375-8777-321cca0322c1 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:43.333928 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e09cf-901a-472d-a03d-85b7b9c0591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:43.334568 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e09cf-901a-472d-a03d-85b7b9c0591b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:43.334838 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e09cf-901a-472d-a03d-85b7b9c0591b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:43.335101 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e09cf-901a-472d-a03d-85b7b9c0591b admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:43.335848 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e09cf-901a-472d-a03d-85b7b9c0591b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:43.336142 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e09cf-901a-472d-a03d-85b7b9c0591b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:43.337760 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e09cf-901a-472d-a03d-85b7b9c0591b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:43.346788 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 598/1187] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:47:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:43.353094 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42d2ec-fdf1-45f6-8be7-3f55aa077816 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:43.369307 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42d2ec-fdf1-45f6-8be7-3f55aa077816 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:43.378331 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46347b3b-345e-43e3-8180-93bfea810112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:43.379435 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46347b3b-345e-43e3-8180-93bfea810112 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:43.379710 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46347b3b-345e-43e3-8180-93bfea810112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:43.379976 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46347b3b-345e-43e3-8180-93bfea810112 admin admin] PATH_INFO: `/v3/users/2c0498a125b34b778ef2d1f1a6149eb0` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:43.381379 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46347b3b-345e-43e3-8180-93bfea810112 admin admin] RBAC: Authorizing `identity:get_user(user_id=2c0498a125b34b778ef2d1f1a6149eb0)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:43.383501 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46347b3b-345e-43e3-8180-93bfea810112 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:43.385059 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 590/1188] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:47:43 2022] GET /identity/v3/users/2c0498a125b34b778ef2d1f1a6149eb0 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:43.390344 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e09cf-901a-472d-a03d-85b7b9c0591b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:43.400269 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e09cf-901a-472d-a03d-85b7b9c0591b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:43.406289 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514334d-a7c5-4d6d-8847-e3b7cf602284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:43.407098 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514334d-a7c5-4d6d-8847-e3b7cf602284 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:43.407370 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514334d-a7c5-4d6d-8847-e3b7cf602284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:43.407638 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514334d-a7c5-4d6d-8847-e3b7cf602284 admin admin] PATH_INFO: `/v3/projects/8ca90ffb965c4cf59d4f88e05e60e346` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:43.408917 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514334d-a7c5-4d6d-8847-e3b7cf602284 admin admin] RBAC: Authorizing `identity:get_project(project_id=8ca90ffb965c4cf59d4f88e05e60e346)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:43.411026 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514334d-a7c5-4d6d-8847-e3b7cf602284 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:43.412616 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 599/1189] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:47:43 2022] GET /identity/v3/projects/8ca90ffb965c4cf59d4f88e05e60e346 => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:43.417949 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46347b3b-345e-43e3-8180-93bfea810112 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:43.427239 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46347b3b-345e-43e3-8180-93bfea810112 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:43.432627 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4090fd6-13ed-4f15-87ff-a7785cc6c632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:43.433482 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4090fd6-13ed-4f15-87ff-a7785cc6c632 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:43.433759 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4090fd6-13ed-4f15-87ff-a7785cc6c632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:43.434029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4090fd6-13ed-4f15-87ff-a7785cc6c632 admin admin] PATH_INFO: `/v3/projects/8ca90ffb965c4cf59d4f88e05e60e346/users/2c0498a125b34b778ef2d1f1a6149eb0/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:43.436200 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4090fd6-13ed-4f15-87ff-a7785cc6c632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca90ffb965c4cf59d4f88e05e60e346, user_id=2c0498a125b34b778ef2d1f1a6149eb0, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:43.438804 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4090fd6-13ed-4f15-87ff-a7785cc6c632 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:43.454668 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 591/1190] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:47:43 2022] PUT /identity/v3/projects/8ca90ffb965c4cf59d4f88e05e60e346/users/2c0498a125b34b778ef2d1f1a6149eb0/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:47:45.622463 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e9f0f-1578-4a89-a921-835342724909 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:45.622998 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e9f0f-1578-4a89-a921-835342724909 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:45.622998 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e9f0f-1578-4a89-a921-835342724909 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:45.624792 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 600/1191] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:47:45.631978 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392baf46-13ed-4180-84d5-d22ca07bc17b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:45.632691 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392baf46-13ed-4180-84d5-d22ca07bc17b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:45.632840 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392baf46-13ed-4180-84d5-d22ca07bc17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:45.662698 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-392baf46-13ed-4180-84d5-d22ca07bc17b None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:47:45.663880 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-392baf46-13ed-4180-84d5-d22ca07bc17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:47:45.721609 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 592/1192] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:47:45 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:47:45.752414 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e9f0f-1578-4a89-a921-835342724909 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:45.766841 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e9f0f-1578-4a89-a921-835342724909 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:45.772175 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635f55a-37ed-452f-ac33-057b133a67a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:45.772944 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635f55a-37ed-452f-ac33-057b133a67a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:45.773220 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635f55a-37ed-452f-ac33-057b133a67a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:45.773528 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635f55a-37ed-452f-ac33-057b133a67a1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:45.785242 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635f55a-37ed-452f-ac33-057b133a67a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:47:45.791917 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-9635f55a-37ed-452f-ac33-057b133a67a1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:47:45.793150 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 601/1193] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:47:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:47:45.799471 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392baf46-13ed-4180-84d5-d22ca07bc17b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:45.809221 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392baf46-13ed-4180-84d5-d22ca07bc17b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:45.814702 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e36af-6d69-40c1-b709-6f49563ab632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:45.815348 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e36af-6d69-40c1-b709-6f49563ab632 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:45.815618 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e36af-6d69-40c1-b709-6f49563ab632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:45.815880 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e36af-6d69-40c1-b709-6f49563ab632 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:45.816635 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e36af-6d69-40c1-b709-6f49563ab632 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:45.816924 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e36af-6d69-40c1-b709-6f49563ab632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:45.818579 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e36af-6d69-40c1-b709-6f49563ab632 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:45.826797 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 593/1194] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:47:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:45.832168 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635f55a-37ed-452f-ac33-057b133a67a1 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:45.843285 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635f55a-37ed-452f-ac33-057b133a67a1 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:45.848543 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a259b09-a564-4f31-8b97-f813494c4c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:45.849380 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a259b09-a564-4f31-8b97-f813494c4c5c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:45.849682 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a259b09-a564-4f31-8b97-f813494c4c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:45.849940 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a259b09-a564-4f31-8b97-f813494c4c5c admin admin] PATH_INFO: `/v3/users/2c0498a125b34b778ef2d1f1a6149eb0` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:45.851152 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a259b09-a564-4f31-8b97-f813494c4c5c admin admin] RBAC: Authorizing `identity:get_user(user_id=2c0498a125b34b778ef2d1f1a6149eb0)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:45.853236 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a259b09-a564-4f31-8b97-f813494c4c5c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:45.854797 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 602/1195] 10.222.0.31 () {56 vars in 1198 bytes} [Thu Feb 10 20:47:45 2022] GET /identity/v3/users/2c0498a125b34b778ef2d1f1a6149eb0 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:45.860011 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e36af-6d69-40c1-b709-6f49563ab632 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:45.869982 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e36af-6d69-40c1-b709-6f49563ab632 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:45.875592 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b96eac-ac0b-4fac-a80c-7c7ff8fbeec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:45.876180 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b96eac-ac0b-4fac-a80c-7c7ff8fbeec8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:45.876454 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b96eac-ac0b-4fac-a80c-7c7ff8fbeec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:45.876715 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b96eac-ac0b-4fac-a80c-7c7ff8fbeec8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:45.885684 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b96eac-ac0b-4fac-a80c-7c7ff8fbeec8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:45.887394 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b96eac-ac0b-4fac-a80c-7c7ff8fbeec8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:45.897180 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 594/1196] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:47:45 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:47:45.903697 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a259b09-a564-4f31-8b97-f813494c4c5c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:45.918445 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a259b09-a564-4f31-8b97-f813494c4c5c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:45.924136 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6bdb9-7c33-4801-887a-3858d7bf1a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:45.925067 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6bdb9-7c33-4801-887a-3858d7bf1a88 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:45.925424 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6bdb9-7c33-4801-887a-3858d7bf1a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:45.925700 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6bdb9-7c33-4801-887a-3858d7bf1a88 admin admin] PATH_INFO: `/v3/projects/8ca90ffb965c4cf59d4f88e05e60e346` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:45.927131 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6bdb9-7c33-4801-887a-3858d7bf1a88 admin admin] RBAC: Authorizing `identity:get_project(project_id=8ca90ffb965c4cf59d4f88e05e60e346)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:45.929321 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6bdb9-7c33-4801-887a-3858d7bf1a88 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:45.930999 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 603/1197] 10.222.0.31 () {56 vars in 1207 bytes} [Thu Feb 10 20:47:45 2022] GET /identity/v3/projects/8ca90ffb965c4cf59d4f88e05e60e346 => generated 361 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:47:45.936912 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b96eac-ac0b-4fac-a80c-7c7ff8fbeec8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:47:45.946208 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b96eac-ac0b-4fac-a80c-7c7ff8fbeec8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:47:45.951204 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c597a9-b043-436f-8adf-e5724faef793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:47:45.951821 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c597a9-b043-436f-8adf-e5724faef793 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:47:45.952098 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c597a9-b043-436f-8adf-e5724faef793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:47:45.952367 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c597a9-b043-436f-8adf-e5724faef793 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:47:45.953189 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c597a9-b043-436f-8adf-e5724faef793 admin admin] RBAC: Adding query filter params (role.id=e06447c1c62d465c9f9c58168be71ed8, scope.project.id=8ca90ffb965c4cf59d4f88e05e60e346, user.id=2c0498a125b34b778ef2d1f1a6149eb0) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:47:45.953530 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c597a9-b043-436f-8adf-e5724faef793 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:47:45.955333 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c597a9-b043-436f-8adf-e5724faef793 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:47:45.961283 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 595/1198] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:47:45 2022] GET /identity/v3/role_assignments?user.id=2c0498a125b34b778ef2d1f1a6149eb0&scope.project.id=8ca90ffb965c4cf59d4f88e05e60e346&role.id=e06447c1c62d465c9f9c58168be71ed8 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:48:46.266744 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ddfe2-de47-4ca9-afab-bf89f001e9de None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:46.267479 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ddfe2-de47-4ca9-afab-bf89f001e9de None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:46.267479 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ddfe2-de47-4ca9-afab-bf89f001e9de None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:46.270083 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 604/1199] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:48:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:48:46.276098 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870deab5-0bf0-4af0-8781-85aee0145529 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:46.276651 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870deab5-0bf0-4af0-8781-85aee0145529 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:46.276753 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870deab5-0bf0-4af0-8781-85aee0145529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:46.299594 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-870deab5-0bf0-4af0-8781-85aee0145529 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:48:46.300903 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-870deab5-0bf0-4af0-8781-85aee0145529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:48:46.310875 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 596/1200] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:48:46 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:48:46.341870 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ddfe2-de47-4ca9-afab-bf89f001e9de None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:46.357011 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ddfe2-de47-4ca9-afab-bf89f001e9de None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:46.362971 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642c49f-91bb-4a47-93a3-6cebc7251637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:46.363906 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642c49f-91bb-4a47-93a3-6cebc7251637 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:46.364301 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642c49f-91bb-4a47-93a3-6cebc7251637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:46.364573 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642c49f-91bb-4a47-93a3-6cebc7251637 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:46.376603 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642c49f-91bb-4a47-93a3-6cebc7251637 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:46.378697 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642c49f-91bb-4a47-93a3-6cebc7251637 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:46.401271 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-3642c49f-91bb-4a47-93a3-6cebc7251637 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:48:46.408206 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 605/1201] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:48:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:48:46.410207 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870deab5-0bf0-4af0-8781-85aee0145529 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:46.425060 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870deab5-0bf0-4af0-8781-85aee0145529 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:46.430442 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57740b-f574-4a62-88ed-85bcec890784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:46.431101 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57740b-f574-4a62-88ed-85bcec890784 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:46.431374 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57740b-f574-4a62-88ed-85bcec890784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:46.431636 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57740b-f574-4a62-88ed-85bcec890784 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:46.432377 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57740b-f574-4a62-88ed-85bcec890784 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:46.432657 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57740b-f574-4a62-88ed-85bcec890784 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:46.434301 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57740b-f574-4a62-88ed-85bcec890784 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:46.451887 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 597/1202] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:48:46.454228 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642c49f-91bb-4a47-93a3-6cebc7251637 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:46.465431 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642c49f-91bb-4a47-93a3-6cebc7251637 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:46.477137 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c7550-06ee-4180-9aff-dc5c2ede1899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:46.477842 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c7550-06ee-4180-9aff-dc5c2ede1899 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:46.478322 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c7550-06ee-4180-9aff-dc5c2ede1899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:46.478443 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c7550-06ee-4180-9aff-dc5c2ede1899 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:46.479112 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c7550-06ee-4180-9aff-dc5c2ede1899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:46.485375 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c7550-06ee-4180-9aff-dc5c2ede1899 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:46.507096 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 606/1203] 10.222.0.31 () {60 vars in 1153 bytes} [Thu Feb 10 20:48:46 2022] POST /identity/v3/users => generated 251 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:48:49.025475 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d01156-0808-4fff-bf1f-fdaf750d3fa6 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:49.026023 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d01156-0808-4fff-bf1f-fdaf750d3fa6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:49.026023 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d01156-0808-4fff-bf1f-fdaf750d3fa6 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:49.028184 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 598/1204] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:48:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:48:49.034195 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f516947-7155-4ed8-9a04-5fa7fa2ae4c9 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:49.034644 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f516947-7155-4ed8-9a04-5fa7fa2ae4c9 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:49.034739 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f516947-7155-4ed8-9a04-5fa7fa2ae4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:49.054007 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-9f516947-7155-4ed8-9a04-5fa7fa2ae4c9 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:48:49.055245 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-9f516947-7155-4ed8-9a04-5fa7fa2ae4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:48:49.064696 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 607/1205] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:48:49 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:48:49.092132 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d01156-0808-4fff-bf1f-fdaf750d3fa6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:49.106453 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d01156-0808-4fff-bf1f-fdaf750d3fa6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:49.113335 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b65197-8323-4fca-86e1-9d1b3fd8440b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:49.114246 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b65197-8323-4fca-86e1-9d1b3fd8440b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:49.114609 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b65197-8323-4fca-86e1-9d1b3fd8440b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:49.114919 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b65197-8323-4fca-86e1-9d1b3fd8440b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:49.127766 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b65197-8323-4fca-86e1-9d1b3fd8440b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:48:49.136844 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-20b65197-8323-4fca-86e1-9d1b3fd8440b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 20:48:49.140957 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 599/1206] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:48:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:48:49.145744 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f516947-7155-4ed8-9a04-5fa7fa2ae4c9 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:49.156184 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f516947-7155-4ed8-9a04-5fa7fa2ae4c9 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:49.161287 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2c7e0-f048-44ca-9de4-14fbdfea5556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:49.162090 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2c7e0-f048-44ca-9de4-14fbdfea5556 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:49.162383 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2c7e0-f048-44ca-9de4-14fbdfea5556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:49.162640 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2c7e0-f048-44ca-9de4-14fbdfea5556 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:49.163510 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2c7e0-f048-44ca-9de4-14fbdfea5556 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:49.163812 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2c7e0-f048-44ca-9de4-14fbdfea5556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:49.165522 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2c7e0-f048-44ca-9de4-14fbdfea5556 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:49.177393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 608/1207] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 10 20:48:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:48:49.182071 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b65197-8323-4fca-86e1-9d1b3fd8440b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:49.193979 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b65197-8323-4fca-86e1-9d1b3fd8440b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:49.198991 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc100c4-dc4b-4747-acf1-48189e001a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:49.200257 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc100c4-dc4b-4747-acf1-48189e001a88 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:49.200374 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc100c4-dc4b-4747-acf1-48189e001a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:49.200585 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc100c4-dc4b-4747-acf1-48189e001a88 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:49.213716 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc100c4-dc4b-4747-acf1-48189e001a88 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:49.215909 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc100c4-dc4b-4747-acf1-48189e001a88 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:49.235596 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-5dc100c4-dc4b-4747-acf1-48189e001a88 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:48:49.237384 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 600/1208] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:48:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:48:49.243287 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2c7e0-f048-44ca-9de4-14fbdfea5556 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:49.253651 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2c7e0-f048-44ca-9de4-14fbdfea5556 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:49.259539 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb666db8-06ae-4bd5-a8a5-4c3630f2459c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:49.261041 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb666db8-06ae-4bd5-a8a5-4c3630f2459c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:49.261041 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb666db8-06ae-4bd5-a8a5-4c3630f2459c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:49.261041 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb666db8-06ae-4bd5-a8a5-4c3630f2459c admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:49.262038 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb666db8-06ae-4bd5-a8a5-4c3630f2459c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:49.262583 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb666db8-06ae-4bd5-a8a5-4c3630f2459c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:49.264422 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb666db8-06ae-4bd5-a8a5-4c3630f2459c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:49.281034 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 609/1209] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:48:49.286751 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc100c4-dc4b-4747-acf1-48189e001a88 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:49.297581 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc100c4-dc4b-4747-acf1-48189e001a88 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:49.302673 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63a5a6-2f90-4844-abd7-5ea43daecffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:49.303734 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63a5a6-2f90-4844-abd7-5ea43daecffd admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:49.304005 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63a5a6-2f90-4844-abd7-5ea43daecffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:49.304308 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63a5a6-2f90-4844-abd7-5ea43daecffd admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:49.313516 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63a5a6-2f90-4844-abd7-5ea43daecffd admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:49.315563 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63a5a6-2f90-4844-abd7-5ea43daecffd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:49.331432 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-1e63a5a6-2f90-4844-abd7-5ea43daecffd admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 10 20:48:49.332785 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 601/1210] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:48:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:48:49.339687 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb666db8-06ae-4bd5-a8a5-4c3630f2459c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:49.350946 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb666db8-06ae-4bd5-a8a5-4c3630f2459c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:49.356208 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a3266-20ee-49d8-9cd4-1505dbaafa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:49.356908 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a3266-20ee-49d8-9cd4-1505dbaafa88 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:49.357175 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a3266-20ee-49d8-9cd4-1505dbaafa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:49.357487 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a3266-20ee-49d8-9cd4-1505dbaafa88 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:49.358492 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a3266-20ee-49d8-9cd4-1505dbaafa88 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:49.358797 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a3266-20ee-49d8-9cd4-1505dbaafa88 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:49.360921 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a3266-20ee-49d8-9cd4-1505dbaafa88 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:49.380201 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 610/1211] 10.222.0.31 () {56 vars in 1164 bytes} [Thu Feb 10 20:48:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:48:49.387205 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63a5a6-2f90-4844-abd7-5ea43daecffd admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:49.399141 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63a5a6-2f90-4844-abd7-5ea43daecffd admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:49.404249 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a670d1-f738-4d89-b5a3-58b28826f9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:49.404928 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a670d1-f738-4d89-b5a3-58b28826f9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:49.405210 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a670d1-f738-4d89-b5a3-58b28826f9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:49.405528 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a670d1-f738-4d89-b5a3-58b28826f9b3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:49.414381 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a670d1-f738-4d89-b5a3-58b28826f9b3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:49.416394 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a670d1-f738-4d89-b5a3-58b28826f9b3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:49.426670 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 602/1212] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:48:49 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:48:49.434937 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a3266-20ee-49d8-9cd4-1505dbaafa88 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:49.447446 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a3266-20ee-49d8-9cd4-1505dbaafa88 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:49.453009 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7774c9-1194-4dd5-80e9-47e3692cb2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:49.453916 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7774c9-1194-4dd5-80e9-47e3692cb2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:49.454255 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7774c9-1194-4dd5-80e9-47e3692cb2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:49.454584 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7774c9-1194-4dd5-80e9-47e3692cb2a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:49.468104 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7774c9-1194-4dd5-80e9-47e3692cb2a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:49.470358 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7774c9-1194-4dd5-80e9-47e3692cb2a8 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:49.490140 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-0d7774c9-1194-4dd5-80e9-47e3692cb2a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:48:49.491449 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 611/1213] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:48:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:48:49.497579 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a670d1-f738-4d89-b5a3-58b28826f9b3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:49.508492 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a670d1-f738-4d89-b5a3-58b28826f9b3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:49.513281 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f1fdf-8fbd-44ec-9ca6-5b51d4ae9138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:49.514285 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f1fdf-8fbd-44ec-9ca6-5b51d4ae9138 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:49.514741 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f1fdf-8fbd-44ec-9ca6-5b51d4ae9138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:49.515063 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f1fdf-8fbd-44ec-9ca6-5b51d4ae9138 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:49.515997 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f1fdf-8fbd-44ec-9ca6-5b51d4ae9138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:49.516370 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f1fdf-8fbd-44ec-9ca6-5b51d4ae9138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:49.518517 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f1fdf-8fbd-44ec-9ca6-5b51d4ae9138 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:49.536882 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 603/1214] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:48:49.538495 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7774c9-1194-4dd5-80e9-47e3692cb2a8 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:49.552337 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7774c9-1194-4dd5-80e9-47e3692cb2a8 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:49.557417 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3ef79-5188-416b-941f-481deddf1ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:49.558239 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3ef79-5188-416b-941f-481deddf1ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:49.558508 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3ef79-5188-416b-941f-481deddf1ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:49.558773 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3ef79-5188-416b-941f-481deddf1ee2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:49.568032 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3ef79-5188-416b-941f-481deddf1ee2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:49.570225 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3ef79-5188-416b-941f-481deddf1ee2 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:49.584330 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-e0c3ef79-5188-416b-941f-481deddf1ee2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:48:49.585861 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 612/1215] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:48:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:48:49.592520 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f1fdf-8fbd-44ec-9ca6-5b51d4ae9138 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:49.603876 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f1fdf-8fbd-44ec-9ca6-5b51d4ae9138 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:49.609633 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edadd58-e0e7-4f76-bce1-b4bf723431ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:49.610422 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edadd58-e0e7-4f76-bce1-b4bf723431ac admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:49.610882 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edadd58-e0e7-4f76-bce1-b4bf723431ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:49.611243 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edadd58-e0e7-4f76-bce1-b4bf723431ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:49.612276 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edadd58-e0e7-4f76-bce1-b4bf723431ac admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:49.612667 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edadd58-e0e7-4f76-bce1-b4bf723431ac admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:49.614911 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edadd58-e0e7-4f76-bce1-b4bf723431ac admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:49.628633 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 604/1216] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:48:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:48:49.635758 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3ef79-5188-416b-941f-481deddf1ee2 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:49.646911 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3ef79-5188-416b-941f-481deddf1ee2 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:49.651490 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3664188-5098-4ab6-9102-d5a5062b5311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:49.652278 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3664188-5098-4ab6-9102-d5a5062b5311 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:49.652550 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3664188-5098-4ab6-9102-d5a5062b5311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:49.652786 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3664188-5098-4ab6-9102-d5a5062b5311 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:49.653808 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3664188-5098-4ab6-9102-d5a5062b5311 admin admin] RBAC: Adding query filter params (role.id=67325e5669ca4296b3b2c0eb443fda3e, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=9f05eb88abe24af4825259712b497d48) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:49.654109 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3664188-5098-4ab6-9102-d5a5062b5311 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:49.656269 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3664188-5098-4ab6-9102-d5a5062b5311 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:49.662894 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 613/1217] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:48:49 2022] GET /identity/v3/role_assignments?user.id=9f05eb88abe24af4825259712b497d48&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=67325e5669ca4296b3b2c0eb443fda3e => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:48:51.960656 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145ca23-1092-4a1f-8c99-526f8837c8d9 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:51.961251 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145ca23-1092-4a1f-8c99-526f8837c8d9 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:51.961909 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145ca23-1092-4a1f-8c99-526f8837c8d9 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:51.963840 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 605/1218] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:48:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:48:51.970012 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa9e35-4171-45fd-bf78-17782c2e0f7b None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:51.970789 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa9e35-4171-45fd-bf78-17782c2e0f7b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:51.970789 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa9e35-4171-45fd-bf78-17782c2e0f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:51.989835 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-4efa9e35-4171-45fd-bf78-17782c2e0f7b None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:48:51.991494 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4efa9e35-4171-45fd-bf78-17782c2e0f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:48:52.009388 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 614/1219] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:48:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:48:52.032940 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145ca23-1092-4a1f-8c99-526f8837c8d9 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:52.045484 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145ca23-1092-4a1f-8c99-526f8837c8d9 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:52.050149 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d53645-a8db-40e4-9f7f-55604a50f247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:52.050931 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d53645-a8db-40e4-9f7f-55604a50f247 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:52.051204 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d53645-a8db-40e4-9f7f-55604a50f247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:52.051469 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d53645-a8db-40e4-9f7f-55604a50f247 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:52.061927 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d53645-a8db-40e4-9f7f-55604a50f247 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:48:52.068862 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-17d53645-a8db-40e4-9f7f-55604a50f247 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 20:48:52.070067 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 606/1220] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:48:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:48:52.076720 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa9e35-4171-45fd-bf78-17782c2e0f7b None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:52.088674 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa9e35-4171-45fd-bf78-17782c2e0f7b None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:52.094051 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c50d3-01a0-483a-b840-b7fbb9137e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:52.094717 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c50d3-01a0-483a-b840-b7fbb9137e40 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:52.094998 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c50d3-01a0-483a-b840-b7fbb9137e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:52.095270 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c50d3-01a0-483a-b840-b7fbb9137e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:52.096341 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c50d3-01a0-483a-b840-b7fbb9137e40 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:52.096679 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c50d3-01a0-483a-b840-b7fbb9137e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:52.098439 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c50d3-01a0-483a-b840-b7fbb9137e40 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:52.107632 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 615/1221] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 10 20:48:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:48:52.114270 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d53645-a8db-40e4-9f7f-55604a50f247 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:52.126065 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d53645-a8db-40e4-9f7f-55604a50f247 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:52.133413 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e87c60-e451-4cbf-8f6b-9dae717b1835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:52.134325 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e87c60-e451-4cbf-8f6b-9dae717b1835 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:52.134691 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e87c60-e451-4cbf-8f6b-9dae717b1835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:52.135054 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e87c60-e451-4cbf-8f6b-9dae717b1835 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:52.146198 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e87c60-e451-4cbf-8f6b-9dae717b1835 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:52.148203 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e87c60-e451-4cbf-8f6b-9dae717b1835 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:52.166410 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-f6e87c60-e451-4cbf-8f6b-9dae717b1835 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:48:52.167647 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 607/1222] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:48:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:48:52.173836 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c50d3-01a0-483a-b840-b7fbb9137e40 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:52.184774 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c50d3-01a0-483a-b840-b7fbb9137e40 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:52.189857 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304f7fc-3881-428c-a04a-b5428b6df9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:52.190621 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304f7fc-3881-428c-a04a-b5428b6df9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:52.190932 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304f7fc-3881-428c-a04a-b5428b6df9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:52.191209 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304f7fc-3881-428c-a04a-b5428b6df9a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:52.192006 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304f7fc-3881-428c-a04a-b5428b6df9a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:52.192308 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304f7fc-3881-428c-a04a-b5428b6df9a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:52.194071 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304f7fc-3881-428c-a04a-b5428b6df9a5 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:52.208041 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 616/1223] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:48:52.214697 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e87c60-e451-4cbf-8f6b-9dae717b1835 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:52.225271 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e87c60-e451-4cbf-8f6b-9dae717b1835 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:52.230519 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae05fae-b804-4bbb-9969-14908dc58170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:52.231387 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae05fae-b804-4bbb-9969-14908dc58170 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:52.231739 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae05fae-b804-4bbb-9969-14908dc58170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:52.232037 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae05fae-b804-4bbb-9969-14908dc58170 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:52.240745 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae05fae-b804-4bbb-9969-14908dc58170 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:52.242870 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae05fae-b804-4bbb-9969-14908dc58170 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:52.262279 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-0ae05fae-b804-4bbb-9969-14908dc58170 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 10 20:48:52.263684 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 608/1224] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:48:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:48:52.270770 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304f7fc-3881-428c-a04a-b5428b6df9a5 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:52.282289 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304f7fc-3881-428c-a04a-b5428b6df9a5 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:52.287085 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f734ee5-9c5c-44ac-b78e-bceb6135c535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:52.287832 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f734ee5-9c5c-44ac-b78e-bceb6135c535 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:52.288171 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f734ee5-9c5c-44ac-b78e-bceb6135c535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:52.288527 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f734ee5-9c5c-44ac-b78e-bceb6135c535 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:52.289474 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f734ee5-9c5c-44ac-b78e-bceb6135c535 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:52.289880 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f734ee5-9c5c-44ac-b78e-bceb6135c535 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:52.291814 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f734ee5-9c5c-44ac-b78e-bceb6135c535 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:52.313756 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 617/1225] 10.222.0.31 () {56 vars in 1164 bytes} [Thu Feb 10 20:48:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:48:52.319326 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae05fae-b804-4bbb-9969-14908dc58170 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:52.329222 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae05fae-b804-4bbb-9969-14908dc58170 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:52.334259 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcbceb-dfb5-4a6a-923b-fd35133b94dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:52.335103 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcbceb-dfb5-4a6a-923b-fd35133b94dc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:52.335440 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcbceb-dfb5-4a6a-923b-fd35133b94dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:52.335762 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcbceb-dfb5-4a6a-923b-fd35133b94dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:52.349521 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcbceb-dfb5-4a6a-923b-fd35133b94dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:52.351463 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcbceb-dfb5-4a6a-923b-fd35133b94dc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:52.372529 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-b0fcbceb-dfb5-4a6a-923b-fd35133b94dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:48:52.374309 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 609/1226] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:48:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:48:52.380287 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f734ee5-9c5c-44ac-b78e-bceb6135c535 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:52.389951 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f734ee5-9c5c-44ac-b78e-bceb6135c535 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:52.394312 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36b6c7-1be3-4f0d-bcb5-f8616e1d427a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:52.394957 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36b6c7-1be3-4f0d-bcb5-f8616e1d427a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:52.395231 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36b6c7-1be3-4f0d-bcb5-f8616e1d427a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:52.395500 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36b6c7-1be3-4f0d-bcb5-f8616e1d427a admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:52.396221 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36b6c7-1be3-4f0d-bcb5-f8616e1d427a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:52.396517 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36b6c7-1be3-4f0d-bcb5-f8616e1d427a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:52.398513 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36b6c7-1be3-4f0d-bcb5-f8616e1d427a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:52.411778 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 618/1227] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:48:52.417951 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcbceb-dfb5-4a6a-923b-fd35133b94dc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:52.429294 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcbceb-dfb5-4a6a-923b-fd35133b94dc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:52.437392 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074392f2-4d71-44ba-a5a9-bcfc402cbc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:52.438346 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074392f2-4d71-44ba-a5a9-bcfc402cbc9e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:52.438668 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074392f2-4d71-44ba-a5a9-bcfc402cbc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:52.438907 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074392f2-4d71-44ba-a5a9-bcfc402cbc9e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:52.447274 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074392f2-4d71-44ba-a5a9-bcfc402cbc9e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:52.449495 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074392f2-4d71-44ba-a5a9-bcfc402cbc9e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:52.463313 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-074392f2-4d71-44ba-a5a9-bcfc402cbc9e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:48:52.464984 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 610/1228] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:48:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:48:52.471334 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36b6c7-1be3-4f0d-bcb5-f8616e1d427a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:52.482780 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36b6c7-1be3-4f0d-bcb5-f8616e1d427a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:52.487866 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a28c3-2e76-4785-8a14-606a2836ee27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:52.488624 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a28c3-2e76-4785-8a14-606a2836ee27 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:52.488944 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a28c3-2e76-4785-8a14-606a2836ee27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:52.489213 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a28c3-2e76-4785-8a14-606a2836ee27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:52.490055 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a28c3-2e76-4785-8a14-606a2836ee27 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:52.491570 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a28c3-2e76-4785-8a14-606a2836ee27 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:52.492179 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a28c3-2e76-4785-8a14-606a2836ee27 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:52.514707 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 619/1229] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:48:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:48:52.514922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074392f2-4d71-44ba-a5a9-bcfc402cbc9e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:52.533686 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074392f2-4d71-44ba-a5a9-bcfc402cbc9e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:52.539586 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb6e70-cee8-4496-8d23-6377723f6f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:52.540710 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb6e70-cee8-4496-8d23-6377723f6f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:52.541059 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb6e70-cee8-4496-8d23-6377723f6f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:52.541408 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb6e70-cee8-4496-8d23-6377723f6f7f admin admin] PATH_INFO: `/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/9f05eb88abe24af4825259712b497d48/roles/67325e5669ca4296b3b2c0eb443fda3e` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:52.559832 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb6e70-cee8-4496-8d23-6377723f6f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f35ac6d668442a9ea0347f99eb2881, user_id=9f05eb88abe24af4825259712b497d48, role_id=67325e5669ca4296b3b2c0eb443fda3e)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:52.562921 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb6e70-cee8-4496-8d23-6377723f6f7f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:52.580576 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 611/1230] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:48:52 2022] PUT /identity/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/9f05eb88abe24af4825259712b497d48/roles/67325e5669ca4296b3b2c0eb443fda3e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:48:54.979522 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c2496-acf6-43f0-a1ea-3ce654386903 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:54.980397 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c2496-acf6-43f0-a1ea-3ce654386903 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:54.980532 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c2496-acf6-43f0-a1ea-3ce654386903 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:54.983511 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 620/1231] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:48:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:48:54.989524 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f71c8-40e4-4b0b-bd1d-6f43b433eb90 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:54.990045 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f71c8-40e4-4b0b-bd1d-6f43b433eb90 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:54.990045 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f71c8-40e4-4b0b-bd1d-6f43b433eb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:55.011697 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-9f5f71c8-40e4-4b0b-bd1d-6f43b433eb90 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:48:55.013174 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9f5f71c8-40e4-4b0b-bd1d-6f43b433eb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:48:55.082803 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 612/1232] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:48:54 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:48:55.109853 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c2496-acf6-43f0-a1ea-3ce654386903 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:55.124387 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c2496-acf6-43f0-a1ea-3ce654386903 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:55.130850 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98a05f-02e0-4982-982b-db758594c689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:55.131919 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98a05f-02e0-4982-982b-db758594c689 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:55.132203 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98a05f-02e0-4982-982b-db758594c689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:55.132609 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98a05f-02e0-4982-982b-db758594c689 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:55.145624 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98a05f-02e0-4982-982b-db758594c689 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:48:55.152431 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-be98a05f-02e0-4982-982b-db758594c689 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 20:48:55.154039 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 621/1233] 10.222.0.31 () {56 vars in 1123 bytes} [Thu Feb 10 20:48:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:48:55.161385 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f71c8-40e4-4b0b-bd1d-6f43b433eb90 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:55.173310 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f71c8-40e4-4b0b-bd1d-6f43b433eb90 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:55.178049 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e439ca-aaa5-4806-b962-a84c68e35cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:55.178717 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e439ca-aaa5-4806-b962-a84c68e35cbb admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:55.178995 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e439ca-aaa5-4806-b962-a84c68e35cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:55.179264 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e439ca-aaa5-4806-b962-a84c68e35cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:55.180021 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e439ca-aaa5-4806-b962-a84c68e35cbb admin admin] RBAC: Adding query filter params (name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:55.180320 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e439ca-aaa5-4806-b962-a84c68e35cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:55.181945 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e439ca-aaa5-4806-b962-a84c68e35cbb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:55.192511 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 613/1234] 10.222.0.31 () {56 vars in 1124 bytes} [Thu Feb 10 20:48:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:48:55.198360 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98a05f-02e0-4982-982b-db758594c689 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:55.210027 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98a05f-02e0-4982-982b-db758594c689 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:55.216569 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf8258-b795-4ba4-9f46-65584ae6af2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:55.217517 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf8258-b795-4ba4-9f46-65584ae6af2c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:55.217796 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf8258-b795-4ba4-9f46-65584ae6af2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:55.218065 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf8258-b795-4ba4-9f46-65584ae6af2c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:55.229112 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf8258-b795-4ba4-9f46-65584ae6af2c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:55.231175 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf8258-b795-4ba4-9f46-65584ae6af2c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:55.248383 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-bcbf8258-b795-4ba4-9f46-65584ae6af2c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:48:55.249698 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 622/1235] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:48:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:48:55.255629 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e439ca-aaa5-4806-b962-a84c68e35cbb admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:55.267721 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e439ca-aaa5-4806-b962-a84c68e35cbb admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:55.273125 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99393646-a759-4b21-83ff-8a502cb36d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:55.273817 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99393646-a759-4b21-83ff-8a502cb36d6a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:55.274119 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99393646-a759-4b21-83ff-8a502cb36d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:55.274384 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99393646-a759-4b21-83ff-8a502cb36d6a admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:55.275122 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99393646-a759-4b21-83ff-8a502cb36d6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:55.275499 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99393646-a759-4b21-83ff-8a502cb36d6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:55.277498 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99393646-a759-4b21-83ff-8a502cb36d6a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:55.293719 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 614/1236] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:48:55.299414 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf8258-b795-4ba4-9f46-65584ae6af2c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:55.310894 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf8258-b795-4ba4-9f46-65584ae6af2c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:55.316653 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d583310-04e0-4130-8d92-3ef69d554111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:55.317538 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d583310-04e0-4130-8d92-3ef69d554111 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:55.317743 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d583310-04e0-4130-8d92-3ef69d554111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:55.318018 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d583310-04e0-4130-8d92-3ef69d554111 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:55.325726 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d583310-04e0-4130-8d92-3ef69d554111 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:55.327757 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d583310-04e0-4130-8d92-3ef69d554111 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:55.344879 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-8d583310-04e0-4130-8d92-3ef69d554111 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 10 20:48:55.346585 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 623/1237] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:48:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:48:55.352315 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99393646-a759-4b21-83ff-8a502cb36d6a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:55.362750 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99393646-a759-4b21-83ff-8a502cb36d6a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:55.368836 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabfdf2-9a78-4d3f-80db-64bf7f04130a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:55.369556 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabfdf2-9a78-4d3f-80db-64bf7f04130a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:55.369838 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabfdf2-9a78-4d3f-80db-64bf7f04130a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:55.370107 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabfdf2-9a78-4d3f-80db-64bf7f04130a admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:55.370963 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabfdf2-9a78-4d3f-80db-64bf7f04130a admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:55.371267 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabfdf2-9a78-4d3f-80db-64bf7f04130a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:55.373254 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabfdf2-9a78-4d3f-80db-64bf7f04130a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:55.392216 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 615/1238] 10.222.0.31 () {56 vars in 1164 bytes} [Thu Feb 10 20:48:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:48:55.398751 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d583310-04e0-4130-8d92-3ef69d554111 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:55.409756 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d583310-04e0-4130-8d92-3ef69d554111 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:55.415618 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb4a17-f6ac-4639-ae14-58e853aae784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:55.416274 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb4a17-f6ac-4639-ae14-58e853aae784 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:55.416545 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb4a17-f6ac-4639-ae14-58e853aae784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:55.416816 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb4a17-f6ac-4639-ae14-58e853aae784 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:55.425542 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb4a17-f6ac-4639-ae14-58e853aae784 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:55.427469 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb4a17-f6ac-4639-ae14-58e853aae784 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:55.437907 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 624/1239] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:48:55 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:48:55.444879 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabfdf2-9a78-4d3f-80db-64bf7f04130a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:55.456484 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabfdf2-9a78-4d3f-80db-64bf7f04130a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:55.462844 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fc30c-9bcc-4cc7-a0d2-5f9488208b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:55.463768 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fc30c-9bcc-4cc7-a0d2-5f9488208b37 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:55.464090 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fc30c-9bcc-4cc7-a0d2-5f9488208b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:55.464399 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fc30c-9bcc-4cc7-a0d2-5f9488208b37 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:55.476154 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5fc30c-9bcc-4cc7-a0d2-5f9488208b37 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:55.478064 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5fc30c-9bcc-4cc7-a0d2-5f9488208b37 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:55.497120 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-7f5fc30c-9bcc-4cc7-a0d2-5f9488208b37 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:48:55.498647 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 616/1240] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:48:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:48:55.505161 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb4a17-f6ac-4639-ae14-58e853aae784 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:55.514969 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb4a17-f6ac-4639-ae14-58e853aae784 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:55.520940 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d41aed-a260-4029-9039-480e6be95288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:55.521686 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d41aed-a260-4029-9039-480e6be95288 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:55.521964 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d41aed-a260-4029-9039-480e6be95288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:55.522231 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d41aed-a260-4029-9039-480e6be95288 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:55.523010 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d41aed-a260-4029-9039-480e6be95288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:55.523322 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d41aed-a260-4029-9039-480e6be95288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:55.525031 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d41aed-a260-4029-9039-480e6be95288 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:55.540946 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 625/1241] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:48:55.547299 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fc30c-9bcc-4cc7-a0d2-5f9488208b37 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:55.559924 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fc30c-9bcc-4cc7-a0d2-5f9488208b37 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:55.565193 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45971667-3539-412b-98bd-4b7f061152dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:55.566252 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45971667-3539-412b-98bd-4b7f061152dc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:55.566563 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45971667-3539-412b-98bd-4b7f061152dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:55.566871 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45971667-3539-412b-98bd-4b7f061152dc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:55.575097 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45971667-3539-412b-98bd-4b7f061152dc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:55.577326 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45971667-3539-412b-98bd-4b7f061152dc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:55.591772 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-45971667-3539-412b-98bd-4b7f061152dc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:48:55.593058 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 617/1242] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:48:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:48:55.599158 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d41aed-a260-4029-9039-480e6be95288 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:55.609701 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d41aed-a260-4029-9039-480e6be95288 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:55.614668 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b72260-8537-4a60-887f-cdb7d0bbf3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:55.615324 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b72260-8537-4a60-887f-cdb7d0bbf3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:55.615606 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b72260-8537-4a60-887f-cdb7d0bbf3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:55.615874 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b72260-8537-4a60-887f-cdb7d0bbf3c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:55.616712 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b72260-8537-4a60-887f-cdb7d0bbf3c0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:55.617001 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b72260-8537-4a60-887f-cdb7d0bbf3c0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:55.618859 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b72260-8537-4a60-887f-cdb7d0bbf3c0 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:55.631890 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 626/1243] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:48:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:48:55.638559 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45971667-3539-412b-98bd-4b7f061152dc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:55.651481 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45971667-3539-412b-98bd-4b7f061152dc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:55.656574 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664dabc7-ed55-447c-bc53-1d6a49fcdaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:55.657256 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dabc7-ed55-447c-bc53-1d6a49fcdaa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:55.657574 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dabc7-ed55-447c-bc53-1d6a49fcdaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:55.657843 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dabc7-ed55-447c-bc53-1d6a49fcdaa8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:55.658689 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664dabc7-ed55-447c-bc53-1d6a49fcdaa8 admin admin] RBAC: Adding query filter params (role.id=67325e5669ca4296b3b2c0eb443fda3e, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=9f05eb88abe24af4825259712b497d48) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:55.658993 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664dabc7-ed55-447c-bc53-1d6a49fcdaa8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:55.660987 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664dabc7-ed55-447c-bc53-1d6a49fcdaa8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:55.667654 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 618/1244] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:48:55 2022] GET /identity/v3/role_assignments?user.id=9f05eb88abe24af4825259712b497d48&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=67325e5669ca4296b3b2c0eb443fda3e => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:48:58.055530 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd18f9-1897-424b-8662-6097165136b9 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:58.056235 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd18f9-1897-424b-8662-6097165136b9 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:58.056235 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd18f9-1897-424b-8662-6097165136b9 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:58.057867 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 627/1245] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:48:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:48:58.063223 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23c51f-1cca-4af8-b7fd-3cc435c44ac2 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:58.063682 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23c51f-1cca-4af8-b7fd-3cc435c44ac2 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:58.063786 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23c51f-1cca-4af8-b7fd-3cc435c44ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:58.082960 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ff23c51f-1cca-4af8-b7fd-3cc435c44ac2 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:48:58.084431 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ff23c51f-1cca-4af8-b7fd-3cc435c44ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:48:58.093263 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 619/1246] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:48:58 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:48:58.117165 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd18f9-1897-424b-8662-6097165136b9 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:58.129990 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd18f9-1897-424b-8662-6097165136b9 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:58.134584 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3df692-8d02-4b3c-a5e0-205b36e3f143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:58.135462 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3df692-8d02-4b3c-a5e0-205b36e3f143 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:58.135830 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3df692-8d02-4b3c-a5e0-205b36e3f143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:58.136189 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3df692-8d02-4b3c-a5e0-205b36e3f143 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:58.147880 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3df692-8d02-4b3c-a5e0-205b36e3f143 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:48:58.154692 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-7e3df692-8d02-4b3c-a5e0-205b36e3f143 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:48:58.155905 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 628/1247] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:48:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:48:58.161990 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23c51f-1cca-4af8-b7fd-3cc435c44ac2 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:58.171193 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23c51f-1cca-4af8-b7fd-3cc435c44ac2 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:58.176552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a5429-313c-4b38-923b-d1fdb342cba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:58.177235 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a5429-313c-4b38-923b-d1fdb342cba9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:58.177529 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a5429-313c-4b38-923b-d1fdb342cba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:58.177798 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a5429-313c-4b38-923b-d1fdb342cba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:58.178556 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a5429-313c-4b38-923b-d1fdb342cba9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:58.178852 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a5429-313c-4b38-923b-d1fdb342cba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:58.180450 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a5429-313c-4b38-923b-d1fdb342cba9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:58.189339 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 620/1248] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:48:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:48:58.195241 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3df692-8d02-4b3c-a5e0-205b36e3f143 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:58.205981 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3df692-8d02-4b3c-a5e0-205b36e3f143 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:58.210899 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7ccd1-ce5e-46c8-9dfc-af33cc1171a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:58.212107 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7ccd1-ce5e-46c8-9dfc-af33cc1171a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:58.212386 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7ccd1-ce5e-46c8-9dfc-af33cc1171a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:58.212647 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7ccd1-ce5e-46c8-9dfc-af33cc1171a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:58.222940 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7ccd1-ce5e-46c8-9dfc-af33cc1171a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:58.224754 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7ccd1-ce5e-46c8-9dfc-af33cc1171a9 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:58.240749 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-f0c7ccd1-ce5e-46c8-9dfc-af33cc1171a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:48:58.241945 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 629/1249] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:48:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:48:58.247902 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a5429-313c-4b38-923b-d1fdb342cba9 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:58.258187 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a5429-313c-4b38-923b-d1fdb342cba9 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:58.263704 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12032bf3-a951-463e-865e-625f26015301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:58.264364 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12032bf3-a951-463e-865e-625f26015301 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:58.264639 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12032bf3-a951-463e-865e-625f26015301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:58.265002 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12032bf3-a951-463e-865e-625f26015301 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:58.265746 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12032bf3-a951-463e-865e-625f26015301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:58.266040 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12032bf3-a951-463e-865e-625f26015301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:58.267664 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12032bf3-a951-463e-865e-625f26015301 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:58.280188 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 621/1250] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:48:58.285964 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7ccd1-ce5e-46c8-9dfc-af33cc1171a9 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:58.296175 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7ccd1-ce5e-46c8-9dfc-af33cc1171a9 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:58.301224 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f465d-b3bc-48f2-aa1b-9fdba6a63f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:58.302094 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f465d-b3bc-48f2-aa1b-9fdba6a63f6d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:58.302374 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f465d-b3bc-48f2-aa1b-9fdba6a63f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:58.302627 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f465d-b3bc-48f2-aa1b-9fdba6a63f6d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:58.310249 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f465d-b3bc-48f2-aa1b-9fdba6a63f6d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:58.312199 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f465d-b3bc-48f2-aa1b-9fdba6a63f6d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:58.325773 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-f26f465d-b3bc-48f2-aa1b-9fdba6a63f6d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 10 20:48:58.326917 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 630/1251] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:48:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:48:58.332980 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12032bf3-a951-463e-865e-625f26015301 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:58.343464 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12032bf3-a951-463e-865e-625f26015301 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:58.348633 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c9cd5-f907-464c-a1fc-841e46f3eceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:58.349298 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c9cd5-f907-464c-a1fc-841e46f3eceb admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:58.349620 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c9cd5-f907-464c-a1fc-841e46f3eceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:58.349884 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c9cd5-f907-464c-a1fc-841e46f3eceb admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:58.350722 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c9cd5-f907-464c-a1fc-841e46f3eceb admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:58.351025 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c9cd5-f907-464c-a1fc-841e46f3eceb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:58.352896 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c9cd5-f907-464c-a1fc-841e46f3eceb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:58.371834 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 622/1252] 10.222.0.31 () {56 vars in 1164 bytes} [Thu Feb 10 20:48:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:48:58.377776 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f465d-b3bc-48f2-aa1b-9fdba6a63f6d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:58.387860 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f465d-b3bc-48f2-aa1b-9fdba6a63f6d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:58.393757 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a52e0-2033-45bd-a706-588596973933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:58.394409 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a52e0-2033-45bd-a706-588596973933 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:58.394683 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a52e0-2033-45bd-a706-588596973933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:58.394946 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a52e0-2033-45bd-a706-588596973933 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:58.403542 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a52e0-2033-45bd-a706-588596973933 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:58.405374 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a52e0-2033-45bd-a706-588596973933 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:58.414920 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 631/1253] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:48:58 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:48:58.420952 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c9cd5-f907-464c-a1fc-841e46f3eceb admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:58.430973 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c9cd5-f907-464c-a1fc-841e46f3eceb admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:58.436029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61409b36-9824-4913-90b6-a65468c6eb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:58.436790 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61409b36-9824-4913-90b6-a65468c6eb20 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:58.437069 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61409b36-9824-4913-90b6-a65468c6eb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:58.437432 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61409b36-9824-4913-90b6-a65468c6eb20 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:58.447712 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61409b36-9824-4913-90b6-a65468c6eb20 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:58.449632 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61409b36-9824-4913-90b6-a65468c6eb20 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:58.467325 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-61409b36-9824-4913-90b6-a65468c6eb20 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:48:58.468756 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 623/1254] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:48:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:48:58.474971 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a52e0-2033-45bd-a706-588596973933 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:58.485474 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a52e0-2033-45bd-a706-588596973933 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:58.490243 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4551e8-d100-44b9-8c0b-d51506f1b39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:58.490894 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4551e8-d100-44b9-8c0b-d51506f1b39b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:58.491171 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4551e8-d100-44b9-8c0b-d51506f1b39b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:58.491441 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4551e8-d100-44b9-8c0b-d51506f1b39b admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:58.492164 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4551e8-d100-44b9-8c0b-d51506f1b39b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:58.492465 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4551e8-d100-44b9-8c0b-d51506f1b39b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:58.494105 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4551e8-d100-44b9-8c0b-d51506f1b39b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:58.506110 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 632/1255] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:48:58.511900 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61409b36-9824-4913-90b6-a65468c6eb20 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:58.522754 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61409b36-9824-4913-90b6-a65468c6eb20 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:58.528366 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d1b89-8654-414d-a3c0-334522d46b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:58.529265 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d1b89-8654-414d-a3c0-334522d46b30 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:58.529607 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d1b89-8654-414d-a3c0-334522d46b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:58.529896 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d1b89-8654-414d-a3c0-334522d46b30 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:58.539113 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d1b89-8654-414d-a3c0-334522d46b30 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:58.541128 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d1b89-8654-414d-a3c0-334522d46b30 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:58.555960 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-b33d1b89-8654-414d-a3c0-334522d46b30 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:48:58.557178 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 624/1256] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:48:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:48:58.563606 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4551e8-d100-44b9-8c0b-d51506f1b39b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:58.574299 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4551e8-d100-44b9-8c0b-d51506f1b39b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:58.579438 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8d7d8-6c51-4ee6-a72d-aa709ba5ef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:58.580098 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8d7d8-6c51-4ee6-a72d-aa709ba5ef4b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:58.580379 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8d7d8-6c51-4ee6-a72d-aa709ba5ef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:58.580652 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8d7d8-6c51-4ee6-a72d-aa709ba5ef4b admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:58.581476 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8d7d8-6c51-4ee6-a72d-aa709ba5ef4b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:58.581783 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8d7d8-6c51-4ee6-a72d-aa709ba5ef4b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:58.583628 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8d7d8-6c51-4ee6-a72d-aa709ba5ef4b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:58.596781 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 633/1257] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:48:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:48:58.602919 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d1b89-8654-414d-a3c0-334522d46b30 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:48:58.613833 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d1b89-8654-414d-a3c0-334522d46b30 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:48:58.618312 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9937c9-a5e7-47b4-b776-d28267de1e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:48:58.618952 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9937c9-a5e7-47b4-b776-d28267de1e27 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:48:58.619249 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9937c9-a5e7-47b4-b776-d28267de1e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:48:58.619489 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9937c9-a5e7-47b4-b776-d28267de1e27 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:48:58.620329 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9937c9-a5e7-47b4-b776-d28267de1e27 admin admin] RBAC: Adding query filter params (role.id=e06447c1c62d465c9f9c58168be71ed8, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=9f05eb88abe24af4825259712b497d48) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:48:58.620679 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9937c9-a5e7-47b4-b776-d28267de1e27 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:48:58.622611 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9937c9-a5e7-47b4-b776-d28267de1e27 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:48:58.628639 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 625/1258] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:48:58 2022] GET /identity/v3/role_assignments?user.id=9f05eb88abe24af4825259712b497d48&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=e06447c1c62d465c9f9c58168be71ed8 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:49:00.809865 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e565e3-bcfc-4eb6-a1f9-858c361efcfc None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:00.810383 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e565e3-bcfc-4eb6-a1f9-858c361efcfc None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:00.810383 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e565e3-bcfc-4eb6-a1f9-858c361efcfc None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:00.812297 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 634/1259] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:49:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:49:00.817703 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a8bd7-d71a-49f0-a4b2-6348af570f84 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:00.818104 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a8bd7-d71a-49f0-a4b2-6348af570f84 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:00.818238 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a8bd7-d71a-49f0-a4b2-6348af570f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:00.836314 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-793a8bd7-d71a-49f0-a4b2-6348af570f84 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:49:00.837902 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-793a8bd7-d71a-49f0-a4b2-6348af570f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:49:00.846932 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 626/1260] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:49:00 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:49:00.870371 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e565e3-bcfc-4eb6-a1f9-858c361efcfc None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:00.884147 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e565e3-bcfc-4eb6-a1f9-858c361efcfc None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:00.888829 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd703a15-51d9-432c-b53e-7290c135a47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:00.889636 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd703a15-51d9-432c-b53e-7290c135a47e admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:00.889953 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd703a15-51d9-432c-b53e-7290c135a47e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:00.890181 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd703a15-51d9-432c-b53e-7290c135a47e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:00.901182 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd703a15-51d9-432c-b53e-7290c135a47e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:49:00.909435 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-bd703a15-51d9-432c-b53e-7290c135a47e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:49:00.910761 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 635/1261] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:49:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:49:00.916900 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a8bd7-d71a-49f0-a4b2-6348af570f84 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:00.926327 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a8bd7-d71a-49f0-a4b2-6348af570f84 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:00.932748 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565b1a2-449d-4f13-962d-9c38aec7de8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:00.933443 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565b1a2-449d-4f13-962d-9c38aec7de8f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:00.933719 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565b1a2-449d-4f13-962d-9c38aec7de8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:00.933983 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565b1a2-449d-4f13-962d-9c38aec7de8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:00.934740 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565b1a2-449d-4f13-962d-9c38aec7de8f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:49:00.935037 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565b1a2-449d-4f13-962d-9c38aec7de8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:00.936630 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565b1a2-449d-4f13-962d-9c38aec7de8f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:00.945701 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 627/1262] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:49:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:49:00.951868 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd703a15-51d9-432c-b53e-7290c135a47e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:00.963830 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd703a15-51d9-432c-b53e-7290c135a47e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:00.968911 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3beda-2d46-4e7f-a523-6cddce5018c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:00.969690 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3beda-2d46-4e7f-a523-6cddce5018c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:00.969964 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3beda-2d46-4e7f-a523-6cddce5018c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:00.970229 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3beda-2d46-4e7f-a523-6cddce5018c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:00.980933 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3beda-2d46-4e7f-a523-6cddce5018c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:00.982864 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3beda-2d46-4e7f-a523-6cddce5018c0 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:00.999579 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-85d3beda-2d46-4e7f-a523-6cddce5018c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:49:01.000757 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 636/1263] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:49:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:49:01.006573 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565b1a2-449d-4f13-962d-9c38aec7de8f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:01.016411 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565b1a2-449d-4f13-962d-9c38aec7de8f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:01.020924 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cb5ca-53f6-4b91-9c1a-93d879936b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:01.021602 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cb5ca-53f6-4b91-9c1a-93d879936b08 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:01.021878 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cb5ca-53f6-4b91-9c1a-93d879936b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:01.022171 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cb5ca-53f6-4b91-9c1a-93d879936b08 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:01.022869 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cb5ca-53f6-4b91-9c1a-93d879936b08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:49:01.023171 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cb5ca-53f6-4b91-9c1a-93d879936b08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:01.024757 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cb5ca-53f6-4b91-9c1a-93d879936b08 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:01.036773 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 628/1264] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:49:01.042575 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3beda-2d46-4e7f-a523-6cddce5018c0 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:01.053584 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3beda-2d46-4e7f-a523-6cddce5018c0 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:01.058236 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a984a0-9470-45f0-abf5-f53eaa7c3314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:01.059046 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a984a0-9470-45f0-abf5-f53eaa7c3314 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:01.059301 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a984a0-9470-45f0-abf5-f53eaa7c3314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:01.059595 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a984a0-9470-45f0-abf5-f53eaa7c3314 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:01.067231 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a984a0-9470-45f0-abf5-f53eaa7c3314 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:01.069333 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a984a0-9470-45f0-abf5-f53eaa7c3314 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:01.083483 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-d3a984a0-9470-45f0-abf5-f53eaa7c3314 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 10 20:49:01.084707 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 637/1265] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:49:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:49:01.091053 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cb5ca-53f6-4b91-9c1a-93d879936b08 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:01.100855 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cb5ca-53f6-4b91-9c1a-93d879936b08 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:01.105566 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41c972-b4bd-4d85-b13f-9a12916c2aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:01.106256 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41c972-b4bd-4d85-b13f-9a12916c2aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:01.106600 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41c972-b4bd-4d85-b13f-9a12916c2aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:01.106934 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41c972-b4bd-4d85-b13f-9a12916c2aa3 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:01.107785 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41c972-b4bd-4d85-b13f-9a12916c2aa3 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:49:01.108084 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41c972-b4bd-4d85-b13f-9a12916c2aa3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:01.109967 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41c972-b4bd-4d85-b13f-9a12916c2aa3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:01.127973 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 629/1266] 10.222.0.31 () {56 vars in 1164 bytes} [Thu Feb 10 20:49:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:49:01.133699 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a984a0-9470-45f0-abf5-f53eaa7c3314 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:01.143790 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a984a0-9470-45f0-abf5-f53eaa7c3314 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:01.148483 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341fd4d-59dc-4b99-bb46-351d43dbc1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:01.149297 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341fd4d-59dc-4b99-bb46-351d43dbc1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:01.149609 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341fd4d-59dc-4b99-bb46-351d43dbc1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:01.149880 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341fd4d-59dc-4b99-bb46-351d43dbc1e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:01.161871 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341fd4d-59dc-4b99-bb46-351d43dbc1e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:01.163866 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341fd4d-59dc-4b99-bb46-351d43dbc1e6 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:01.182867 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-1341fd4d-59dc-4b99-bb46-351d43dbc1e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:49:01.184142 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 638/1267] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:49:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:49:01.190345 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41c972-b4bd-4d85-b13f-9a12916c2aa3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:01.200764 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41c972-b4bd-4d85-b13f-9a12916c2aa3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:01.205715 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e3829-3ad4-49db-b2a5-3e536d45d588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:01.206396 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e3829-3ad4-49db-b2a5-3e536d45d588 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:01.206668 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e3829-3ad4-49db-b2a5-3e536d45d588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:01.206931 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e3829-3ad4-49db-b2a5-3e536d45d588 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:01.207666 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e3829-3ad4-49db-b2a5-3e536d45d588 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:49:01.207960 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e3829-3ad4-49db-b2a5-3e536d45d588 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:01.209599 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e3829-3ad4-49db-b2a5-3e536d45d588 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:01.222897 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 630/1268] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:49:01.228755 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341fd4d-59dc-4b99-bb46-351d43dbc1e6 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:01.238971 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341fd4d-59dc-4b99-bb46-351d43dbc1e6 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:01.243595 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bcedc-1dc8-4457-aefc-85bec854beb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:01.244393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bcedc-1dc8-4457-aefc-85bec854beb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:01.244673 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bcedc-1dc8-4457-aefc-85bec854beb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:01.244939 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bcedc-1dc8-4457-aefc-85bec854beb2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:01.252515 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bcedc-1dc8-4457-aefc-85bec854beb2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:01.254620 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bcedc-1dc8-4457-aefc-85bec854beb2 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:01.268000 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-f99bcedc-1dc8-4457-aefc-85bec854beb2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:49:01.269227 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 639/1269] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:49:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:49:01.275437 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e3829-3ad4-49db-b2a5-3e536d45d588 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:01.286109 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e3829-3ad4-49db-b2a5-3e536d45d588 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:01.291515 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6bfe0-55cd-401b-93fe-5d8e5aec83a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:01.292184 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6bfe0-55cd-401b-93fe-5d8e5aec83a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:01.292433 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6bfe0-55cd-401b-93fe-5d8e5aec83a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:01.292704 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6bfe0-55cd-401b-93fe-5d8e5aec83a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:01.293520 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6bfe0-55cd-401b-93fe-5d8e5aec83a1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:49:01.293812 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6bfe0-55cd-401b-93fe-5d8e5aec83a1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:01.295786 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6bfe0-55cd-401b-93fe-5d8e5aec83a1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:01.309992 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 631/1270] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:49:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:49:01.315936 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bcedc-1dc8-4457-aefc-85bec854beb2 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:01.328326 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bcedc-1dc8-4457-aefc-85bec854beb2 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:01.332995 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7d442-b0a2-47de-98ea-8ed63e3bfbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:01.333937 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7d442-b0a2-47de-98ea-8ed63e3bfbc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:01.334211 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7d442-b0a2-47de-98ea-8ed63e3bfbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:01.334459 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7d442-b0a2-47de-98ea-8ed63e3bfbc9 admin admin] PATH_INFO: `/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/9f05eb88abe24af4825259712b497d48/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:01.336479 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7d442-b0a2-47de-98ea-8ed63e3bfbc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f35ac6d668442a9ea0347f99eb2881, user_id=9f05eb88abe24af4825259712b497d48, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:01.339504 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7d442-b0a2-47de-98ea-8ed63e3bfbc9 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:01.354578 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 640/1271] 10.222.0.31 () {58 vars in 1460 bytes} [Thu Feb 10 20:49:01 2022] PUT /identity/v3/projects/62f35ac6d668442a9ea0347f99eb2881/users/9f05eb88abe24af4825259712b497d48/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:49:03.704237 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9f480-d8b0-48ac-b032-b3d3ad30a39d None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:03.704814 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9f480-d8b0-48ac-b032-b3d3ad30a39d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:03.704814 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9f480-d8b0-48ac-b032-b3d3ad30a39d None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:03.706665 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 632/1272] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:49:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:49:03.715167 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c6162-e872-411e-9b14-d0b7ac08c3a8 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:03.715633 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c6162-e872-411e-9b14-d0b7ac08c3a8 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:03.715714 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c6162-e872-411e-9b14-d0b7ac08c3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:03.736348 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-9e2c6162-e872-411e-9b14-d0b7ac08c3a8 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:49:03.737821 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-9e2c6162-e872-411e-9b14-d0b7ac08c3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:49:03.802592 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 641/1273] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:49:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:49:03.829849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9f480-d8b0-48ac-b032-b3d3ad30a39d None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:03.843659 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9f480-d8b0-48ac-b032-b3d3ad30a39d None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:03.848864 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139c49e-41e0-44e9-8a09-8a9fe099b11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:03.849692 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139c49e-41e0-44e9-8a09-8a9fe099b11c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:03.849967 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139c49e-41e0-44e9-8a09-8a9fe099b11c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:03.850230 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139c49e-41e0-44e9-8a09-8a9fe099b11c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:03.861438 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139c49e-41e0-44e9-8a09-8a9fe099b11c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 20:49:03.868206 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-e139c49e-41e0-44e9-8a09-8a9fe099b11c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 20:49:03.869614 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 633/1274] 10.222.0.31 () {56 vars in 1117 bytes} [Thu Feb 10 20:49:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 20:49:03.876180 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c6162-e872-411e-9b14-d0b7ac08c3a8 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:03.886652 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c6162-e872-411e-9b14-d0b7ac08c3a8 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:03.893092 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf12877-3fe3-4019-9ca2-fcfe87571a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:03.893817 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf12877-3fe3-4019-9ca2-fcfe87571a3e admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:03.894096 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf12877-3fe3-4019-9ca2-fcfe87571a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:03.894363 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf12877-3fe3-4019-9ca2-fcfe87571a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:03.895117 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf12877-3fe3-4019-9ca2-fcfe87571a3e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:49:03.895415 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf12877-3fe3-4019-9ca2-fcfe87571a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:03.896998 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf12877-3fe3-4019-9ca2-fcfe87571a3e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:03.905876 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 642/1275] 10.222.0.31 () {56 vars in 1120 bytes} [Thu Feb 10 20:49:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:49:03.912936 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139c49e-41e0-44e9-8a09-8a9fe099b11c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:03.924127 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139c49e-41e0-44e9-8a09-8a9fe099b11c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:03.929055 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdf44c-11ca-4651-ae2d-e7749d6a16ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:03.929908 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdf44c-11ca-4651-ae2d-e7749d6a16ca admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:03.930179 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdf44c-11ca-4651-ae2d-e7749d6a16ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:03.930444 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdf44c-11ca-4651-ae2d-e7749d6a16ca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:03.941576 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdf44c-11ca-4651-ae2d-e7749d6a16ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:03.943586 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdf44c-11ca-4651-ae2d-e7749d6a16ca admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:03.961190 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-14cdf44c-11ca-4651-ae2d-e7749d6a16ca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:49:03.963217 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 634/1276] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:49:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:49:03.978121 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf12877-3fe3-4019-9ca2-fcfe87571a3e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:03.988129 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf12877-3fe3-4019-9ca2-fcfe87571a3e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:03.993529 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3a7f1-d4ad-49e3-99bf-2685594021cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:03.994226 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3a7f1-d4ad-49e3-99bf-2685594021cd admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:03.994479 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3a7f1-d4ad-49e3-99bf-2685594021cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:03.994774 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3a7f1-d4ad-49e3-99bf-2685594021cd admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:03.995538 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3a7f1-d4ad-49e3-99bf-2685594021cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:49:03.995840 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3a7f1-d4ad-49e3-99bf-2685594021cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:03.997667 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3a7f1-d4ad-49e3-99bf-2685594021cd admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:04.010152 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 643/1277] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:49:04.016131 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdf44c-11ca-4651-ae2d-e7749d6a16ca admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:04.028291 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdf44c-11ca-4651-ae2d-e7749d6a16ca admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:04.033572 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4fac5-e89a-489b-8ac0-d84ec1bc5975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:04.034418 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4fac5-e89a-489b-8ac0-d84ec1bc5975 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:04.034691 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4fac5-e89a-489b-8ac0-d84ec1bc5975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:04.034955 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4fac5-e89a-489b-8ac0-d84ec1bc5975 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:04.043537 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4fac5-e89a-489b-8ac0-d84ec1bc5975 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:04.046437 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4fac5-e89a-489b-8ac0-d84ec1bc5975 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:04.061271 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-70d4fac5-e89a-489b-8ac0-d84ec1bc5975 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 10 20:49:04.062553 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 635/1278] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:49:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:49:04.068740 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3a7f1-d4ad-49e3-99bf-2685594021cd admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:04.079398 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3a7f1-d4ad-49e3-99bf-2685594021cd admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:04.085698 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8e741-8ea0-4097-a336-afdaeea3bdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:04.087062 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8e741-8ea0-4097-a336-afdaeea3bdbf admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:04.087330 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8e741-8ea0-4097-a336-afdaeea3bdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:04.087753 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8e741-8ea0-4097-a336-afdaeea3bdbf admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:04.088924 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8e741-8ea0-4097-a336-afdaeea3bdbf admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:49:04.089324 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8e741-8ea0-4097-a336-afdaeea3bdbf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:04.092297 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8e741-8ea0-4097-a336-afdaeea3bdbf admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:04.113503 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 644/1279] 10.222.0.31 () {56 vars in 1164 bytes} [Thu Feb 10 20:49:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:49:04.121513 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4fac5-e89a-489b-8ac0-d84ec1bc5975 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:04.132233 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4fac5-e89a-489b-8ac0-d84ec1bc5975 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:04.137612 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f2bcd-0d49-40e5-9e87-6de0a5a0ba04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:04.138429 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f2bcd-0d49-40e5-9e87-6de0a5a0ba04 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:04.138705 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f2bcd-0d49-40e5-9e87-6de0a5a0ba04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:04.138970 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f2bcd-0d49-40e5-9e87-6de0a5a0ba04 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:04.147824 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f2bcd-0d49-40e5-9e87-6de0a5a0ba04 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:04.149633 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f2bcd-0d49-40e5-9e87-6de0a5a0ba04 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:04.160152 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 636/1280] 10.222.0.31 () {58 vars in 1324 bytes} [Thu Feb 10 20:49:04 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:49:04.166601 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8e741-8ea0-4097-a336-afdaeea3bdbf admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:04.177709 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8e741-8ea0-4097-a336-afdaeea3bdbf admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:04.183182 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19731918-f48d-4435-85d0-731bcbb85daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:04.184002 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19731918-f48d-4435-85d0-731bcbb85daa admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:04.184287 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19731918-f48d-4435-85d0-731bcbb85daa admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:04.184561 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19731918-f48d-4435-85d0-731bcbb85daa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:04.196377 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19731918-f48d-4435-85d0-731bcbb85daa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:04.198285 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19731918-f48d-4435-85d0-731bcbb85daa admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:04.217642 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-19731918-f48d-4435-85d0-731bcbb85daa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 20:49:04.218903 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 645/1281] 10.222.0.31 () {56 vars in 1129 bytes} [Thu Feb 10 20:49:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:49:04.225055 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f2bcd-0d49-40e5-9e87-6de0a5a0ba04 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:04.234635 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f2bcd-0d49-40e5-9e87-6de0a5a0ba04 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:04.240564 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e5cd0-ad8b-497b-8534-86f6ef2bf5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:04.241264 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e5cd0-ad8b-497b-8534-86f6ef2bf5ce admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:04.241575 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e5cd0-ad8b-497b-8534-86f6ef2bf5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:04.241845 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e5cd0-ad8b-497b-8534-86f6ef2bf5ce admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:04.242584 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e5cd0-ad8b-497b-8534-86f6ef2bf5ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:49:04.242886 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e5cd0-ad8b-497b-8534-86f6ef2bf5ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:04.244513 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e5cd0-ad8b-497b-8534-86f6ef2bf5ce admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:04.257458 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 637/1282] 10.222.0.31 () {56 vars in 1130 bytes} [Thu Feb 10 20:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:49:04.263600 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19731918-f48d-4435-85d0-731bcbb85daa admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:04.274990 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19731918-f48d-4435-85d0-731bcbb85daa admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:04.280414 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c1733-264e-4c17-92de-7a8595244a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:04.281397 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c1733-264e-4c17-92de-7a8595244a03 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:04.281881 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c1733-264e-4c17-92de-7a8595244a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:04.282050 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c1733-264e-4c17-92de-7a8595244a03 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:04.290737 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c1733-264e-4c17-92de-7a8595244a03 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:04.293055 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c1733-264e-4c17-92de-7a8595244a03 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:04.308999 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING keystone.server.flask.application [None req-8c2c1733-264e-4c17-92de-7a8595244a03 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 20:49:04.310818 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 646/1283] 10.222.0.31 () {56 vars in 1132 bytes} [Thu Feb 10 20:49:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:49:04.317711 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e5cd0-ad8b-497b-8534-86f6ef2bf5ce admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:04.328795 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e5cd0-ad8b-497b-8534-86f6ef2bf5ce admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:04.334144 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae022393-1f1b-46b4-9310-4359b5d02e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:04.334832 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae022393-1f1b-46b4-9310-4359b5d02e76 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:04.335166 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae022393-1f1b-46b4-9310-4359b5d02e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:04.335437 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae022393-1f1b-46b4-9310-4359b5d02e76 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:04.336252 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae022393-1f1b-46b4-9310-4359b5d02e76 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:49:04.336553 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae022393-1f1b-46b4-9310-4359b5d02e76 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:04.338825 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae022393-1f1b-46b4-9310-4359b5d02e76 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:04.352678 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 638/1284] 10.222.0.31 () {56 vars in 1169 bytes} [Thu Feb 10 20:49:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:49:04.359101 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c1733-264e-4c17-92de-7a8595244a03 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:04.370944 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c1733-264e-4c17-92de-7a8595244a03 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:04.375731 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd40b0-609d-4e6c-acbe-6a49272d891f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:04.376386 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd40b0-609d-4e6c-acbe-6a49272d891f admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:04.376663 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd40b0-609d-4e6c-acbe-6a49272d891f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:04.376934 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd40b0-609d-4e6c-acbe-6a49272d891f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:04.377804 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd40b0-609d-4e6c-acbe-6a49272d891f admin admin] RBAC: Adding query filter params (role.id=e06447c1c62d465c9f9c58168be71ed8, scope.project.id=62f35ac6d668442a9ea0347f99eb2881, user.id=9f05eb88abe24af4825259712b497d48) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:49:04.378135 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd40b0-609d-4e6c-acbe-6a49272d891f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:04.379985 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd40b0-609d-4e6c-acbe-6a49272d891f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:04.386919 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 647/1285] 10.222.0.31 () {56 vars in 1395 bytes} [Thu Feb 10 20:49:04 2022] GET /identity/v3/role_assignments?user.id=9f05eb88abe24af4825259712b497d48&scope.project.id=62f35ac6d668442a9ea0347f99eb2881&role.id=e06447c1c62d465c9f9c58168be71ed8 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:49:06.616277 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25056349-4201-4a0f-82f5-7db091b29b54 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:06.617118 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25056349-4201-4a0f-82f5-7db091b29b54 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:06.617118 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25056349-4201-4a0f-82f5-7db091b29b54 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:06.620111 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 639/1286] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:49:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:49:06.627519 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9fa73-8a17-4452-8372-983b84ff73e9 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:06.628228 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9fa73-8a17-4452-8372-983b84ff73e9 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:06.628321 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9fa73-8a17-4452-8372-983b84ff73e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:06.656264 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-6cb9fa73-8a17-4452-8372-983b84ff73e9 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:49:06.657488 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-6cb9fa73-8a17-4452-8372-983b84ff73e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:49:06.666661 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 648/1287] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:49:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:49:06.689068 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25056349-4201-4a0f-82f5-7db091b29b54 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:06.703735 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25056349-4201-4a0f-82f5-7db091b29b54 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:06.709156 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544b62f-c19b-49ab-a392-3cf675c59c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:06.709946 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544b62f-c19b-49ab-a392-3cf675c59c79 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:06.710220 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544b62f-c19b-49ab-a392-3cf675c59c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:06.710481 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544b62f-c19b-49ab-a392-3cf675c59c79 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:06.711130 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544b62f-c19b-49ab-a392-3cf675c59c79 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:06.713091 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544b62f-c19b-49ab-a392-3cf675c59c79 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:06.724335 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-e544b62f-c19b-49ab-a392-3cf675c59c79 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 10 20:49:06.725472 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 640/1288] 10.222.0.31 () {56 vars in 1138 bytes} [Thu Feb 10 20:49:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:49:06.731286 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9fa73-8a17-4452-8372-983b84ff73e9 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:06.740429 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9fa73-8a17-4452-8372-983b84ff73e9 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:06.745181 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355bc34-8e39-46e0-b156-29c57dd370fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:06.745932 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355bc34-8e39-46e0-b156-29c57dd370fc admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:06.746207 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355bc34-8e39-46e0-b156-29c57dd370fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:06.746474 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355bc34-8e39-46e0-b156-29c57dd370fc admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:06.747265 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355bc34-8e39-46e0-b156-29c57dd370fc admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:49:06.747569 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355bc34-8e39-46e0-b156-29c57dd370fc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:06.749144 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355bc34-8e39-46e0-b156-29c57dd370fc admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:06.754371 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 649/1289] 10.222.0.31 () {56 vars in 1137 bytes} [Thu Feb 10 20:49:06 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:49:06.759629 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544b62f-c19b-49ab-a392-3cf675c59c79 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:06.769033 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544b62f-c19b-49ab-a392-3cf675c59c79 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:06.774013 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9afd8e-7260-4299-a86d-3768c5ad4c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:06.774615 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9afd8e-7260-4299-a86d-3768c5ad4c2b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:06.774900 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9afd8e-7260-4299-a86d-3768c5ad4c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:06.775160 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9afd8e-7260-4299-a86d-3768c5ad4c2b admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:06.775847 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9afd8e-7260-4299-a86d-3768c5ad4c2b admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:49:06.776141 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9afd8e-7260-4299-a86d-3768c5ad4c2b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:06.777698 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9afd8e-7260-4299-a86d-3768c5ad4c2b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:06.782165 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 641/1290] 10.222.0.31 () {56 vars in 1137 bytes} [Thu Feb 10 20:49:06 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:49:08.958273 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ade43a-fc09-4e12-818e-18be89731de6 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:08.959099 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ade43a-fc09-4e12-818e-18be89731de6 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:08.959099 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ade43a-fc09-4e12-818e-18be89731de6 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:08.962364 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 650/1291] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:49:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:49:08.968185 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08213b2e-2635-4a55-ba64-b583f11f3c0b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:08.968606 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08213b2e-2635-4a55-ba64-b583f11f3c0b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:08.968715 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08213b2e-2635-4a55-ba64-b583f11f3c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:08.989267 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-08213b2e-2635-4a55-ba64-b583f11f3c0b None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:49:08.990485 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-08213b2e-2635-4a55-ba64-b583f11f3c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:49:09.000746 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 642/1292] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:49:08 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:49:09.028895 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ade43a-fc09-4e12-818e-18be89731de6 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:09.048389 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ade43a-fc09-4e12-818e-18be89731de6 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:09.054546 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45853eb3-3b0d-4ec4-98ae-8b79d3306af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:09.055191 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45853eb3-3b0d-4ec4-98ae-8b79d3306af0 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:09.055480 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45853eb3-3b0d-4ec4-98ae-8b79d3306af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:09.055747 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45853eb3-3b0d-4ec4-98ae-8b79d3306af0 admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:09.056474 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45853eb3-3b0d-4ec4-98ae-8b79d3306af0 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:09.058111 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45853eb3-3b0d-4ec4-98ae-8b79d3306af0 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:09.073990 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 651/1293] 10.222.0.31 () {60 vars in 1162 bytes} [Thu Feb 10 20:49:09 2022] POST /identity/v3/services => generated 246 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:49:11.271866 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe16f0d-300a-421c-9fef-e5cf9ead89c3 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:11.272784 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe16f0d-300a-421c-9fef-e5cf9ead89c3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:11.272784 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe16f0d-300a-421c-9fef-e5cf9ead89c3 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:11.275135 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 643/1294] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:49:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:49:11.282609 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdb859-182f-41f7-bb62-88081b1770c2 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:11.283013 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdb859-182f-41f7-bb62-88081b1770c2 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:11.283134 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdb859-182f-41f7-bb62-88081b1770c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:11.304478 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-dcbdb859-182f-41f7-bb62-88081b1770c2 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:49:11.306011 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-dcbdb859-182f-41f7-bb62-88081b1770c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:49:11.326336 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 652/1295] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:49:11 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:49:11.350549 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe16f0d-300a-421c-9fef-e5cf9ead89c3 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:11.363477 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe16f0d-300a-421c-9fef-e5cf9ead89c3 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:11.368252 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c31006-7dd7-48b8-a9e9-2023c84c0a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:11.369033 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c31006-7dd7-48b8-a9e9-2023c84c0a76 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:11.369306 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c31006-7dd7-48b8-a9e9-2023c84c0a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:11.369600 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c31006-7dd7-48b8-a9e9-2023c84c0a76 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:11.370266 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c31006-7dd7-48b8-a9e9-2023c84c0a76 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:11.371847 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c31006-7dd7-48b8-a9e9-2023c84c0a76 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:11.382800 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-92c31006-7dd7-48b8-a9e9-2023c84c0a76 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 10 20:49:11.383912 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 644/1296] 10.222.0.31 () {56 vars in 1138 bytes} [Thu Feb 10 20:49:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:49:11.390541 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdb859-182f-41f7-bb62-88081b1770c2 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:11.404995 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdb859-182f-41f7-bb62-88081b1770c2 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:11.413583 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4758804-8f7f-4567-a5dd-d7fa7c9f8489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:11.414539 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4758804-8f7f-4567-a5dd-d7fa7c9f8489 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:11.414931 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4758804-8f7f-4567-a5dd-d7fa7c9f8489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:11.415282 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4758804-8f7f-4567-a5dd-d7fa7c9f8489 admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:11.416373 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4758804-8f7f-4567-a5dd-d7fa7c9f8489 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:49:11.416766 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4758804-8f7f-4567-a5dd-d7fa7c9f8489 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:11.419367 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4758804-8f7f-4567-a5dd-d7fa7c9f8489 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:11.426232 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 653/1297] 10.222.0.31 () {56 vars in 1137 bytes} [Thu Feb 10 20:49:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:49:11.433509 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c31006-7dd7-48b8-a9e9-2023c84c0a76 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:11.446264 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c31006-7dd7-48b8-a9e9-2023c84c0a76 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:11.452202 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ff97d-c41a-43f2-aa15-5d7d8be6c6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:11.452838 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ff97d-c41a-43f2-aa15-5d7d8be6c6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:11.453112 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ff97d-c41a-43f2-aa15-5d7d8be6c6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:11.453380 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ff97d-c41a-43f2-aa15-5d7d8be6c6d7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:11.454192 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ff97d-c41a-43f2-aa15-5d7d8be6c6d7 admin admin] RBAC: Adding query filter params (interface=public, service_id=e40d605e292f4a1fb8837b3fdeef2890, region_id=RegionOne) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:49:11.454502 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ff97d-c41a-43f2-aa15-5d7d8be6c6d7 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:11.456079 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ff97d-c41a-43f2-aa15-5d7d8be6c6d7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:11.461449 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 645/1298] 10.222.0.31 () {56 vars in 1272 bytes} [Thu Feb 10 20:49:11 2022] GET /identity/v3/endpoints?service_id=e40d605e292f4a1fb8837b3fdeef2890&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:49:11.467617 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4758804-8f7f-4567-a5dd-d7fa7c9f8489 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:11.477656 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4758804-8f7f-4567-a5dd-d7fa7c9f8489 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:11.483052 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3237dea-79e2-4c21-9cfc-7f8ce548a1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:11.483692 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3237dea-79e2-4c21-9cfc-7f8ce548a1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:11.483967 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3237dea-79e2-4c21-9cfc-7f8ce548a1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:11.484235 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3237dea-79e2-4c21-9cfc-7f8ce548a1d1 admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:11.484912 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3237dea-79e2-4c21-9cfc-7f8ce548a1d1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:11.486521 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3237dea-79e2-4c21-9cfc-7f8ce548a1d1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:11.493518 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 654/1299] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 10 20:49:11 2022] GET /identity/v3/services => generated 2191 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:49:13.681713 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd03ca1-bf7a-4e29-951a-a820ccd1528e None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:13.682356 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd03ca1-bf7a-4e29-951a-a820ccd1528e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:13.682356 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd03ca1-bf7a-4e29-951a-a820ccd1528e None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:13.684045 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 646/1300] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:49:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:49:13.690507 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae87fe6-1abf-4f62-940d-c7ed57edc158 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:13.691241 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae87fe6-1abf-4f62-940d-c7ed57edc158 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:13.691383 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae87fe6-1abf-4f62-940d-c7ed57edc158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:13.713346 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-fae87fe6-1abf-4f62-940d-c7ed57edc158 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:49:13.714556 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-fae87fe6-1abf-4f62-940d-c7ed57edc158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:49:13.722999 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 655/1301] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:49:13 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:49:13.746085 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd03ca1-bf7a-4e29-951a-a820ccd1528e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:13.759726 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd03ca1-bf7a-4e29-951a-a820ccd1528e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:13.765300 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353d845-dc59-4794-a8d6-9691773b8a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:13.766104 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353d845-dc59-4794-a8d6-9691773b8a2d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:13.766381 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353d845-dc59-4794-a8d6-9691773b8a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:13.766652 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353d845-dc59-4794-a8d6-9691773b8a2d admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:13.767300 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353d845-dc59-4794-a8d6-9691773b8a2d admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:13.768884 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353d845-dc59-4794-a8d6-9691773b8a2d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:13.780398 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-8353d845-dc59-4794-a8d6-9691773b8a2d admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 10 20:49:13.781514 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 647/1302] 10.222.0.31 () {56 vars in 1138 bytes} [Thu Feb 10 20:49:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 20:49:13.787928 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae87fe6-1abf-4f62-940d-c7ed57edc158 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:13.799502 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae87fe6-1abf-4f62-940d-c7ed57edc158 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:13.805302 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65b5df-8cc4-4ccb-8285-a30fe906ba0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:13.805966 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65b5df-8cc4-4ccb-8285-a30fe906ba0d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:13.806242 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65b5df-8cc4-4ccb-8285-a30fe906ba0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:13.806508 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65b5df-8cc4-4ccb-8285-a30fe906ba0d admin admin] PATH_INFO: `/v3/services` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:13.807210 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65b5df-8cc4-4ccb-8285-a30fe906ba0d admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:49:13.807505 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65b5df-8cc4-4ccb-8285-a30fe906ba0d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:13.809091 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65b5df-8cc4-4ccb-8285-a30fe906ba0d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:13.814300 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 656/1303] 10.222.0.31 () {56 vars in 1137 bytes} [Thu Feb 10 20:49:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:49:13.819604 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353d845-dc59-4794-a8d6-9691773b8a2d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:49:13.829632 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353d845-dc59-4794-a8d6-9691773b8a2d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:49:13.834577 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca0e58-ef7f-4103-b3c8-10bf781d8f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:49:13.835175 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca0e58-ef7f-4103-b3c8-10bf781d8f65 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:49:13.835453 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca0e58-ef7f-4103-b3c8-10bf781d8f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:49:13.835721 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca0e58-ef7f-4103-b3c8-10bf781d8f65 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:49:13.836454 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca0e58-ef7f-4103-b3c8-10bf781d8f65 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:49:13.838402 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca0e58-ef7f-4103-b3c8-10bf781d8f65 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:49:13.859173 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 648/1304] 10.222.0.31 () {60 vars in 1165 bytes} [Thu Feb 10 20:49:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:50:16.546167 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25539a-4ce8-41ab-af34-f2b9a9d13a6f None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:16.546707 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25539a-4ce8-41ab-af34-f2b9a9d13a6f None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:16.546707 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25539a-4ce8-41ab-af34-f2b9a9d13a6f None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:16.548483 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 657/1305] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:50:16.553826 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f15bf9-b75e-4351-95e3-e7e55982f955 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:16.554268 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f15bf9-b75e-4351-95e3-e7e55982f955 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:16.554367 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f15bf9-b75e-4351-95e3-e7e55982f955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:16.636240 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-13f15bf9-b75e-4351-95e3-e7e55982f955 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:50:16.637460 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-13f15bf9-b75e-4351-95e3-e7e55982f955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:16.736246 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 649/1306] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:50:16.758628 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25539a-4ce8-41ab-af34-f2b9a9d13a6f None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:50:16.760433 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-df25539a-4ce8-41ab-af34-f2b9a9d13a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:16.892948 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25539a-4ce8-41ab-af34-f2b9a9d13a6f None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:50:17.007733 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a3dce-90c2-4b21-8114-c13598aad347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:50:17.008223 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a3dce-90c2-4b21-8114-c13598aad347 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:17.008532 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a3dce-90c2-4b21-8114-c13598aad347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:17.008839 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a3dce-90c2-4b21-8114-c13598aad347 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:17.009563 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a3dce-90c2-4b21-8114-c13598aad347 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:50:17.011409 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a3dce-90c2-4b21-8114-c13598aad347 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:50:17.032042 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 658/1307] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 10 20:50:16 2022] GET /identity/v3/projects => generated 2553 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 20:50:19.281549 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a299ee-3ac8-4681-a2c9-10a3530c78e4 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:19.282097 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a299ee-3ac8-4681-a2c9-10a3530c78e4 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:19.282097 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a299ee-3ac8-4681-a2c9-10a3530c78e4 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:19.283938 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 650/1308] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:50:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:50:19.289918 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ccb42-0ea9-41b2-b9ee-28aa184a6f1a None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:19.290429 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ccb42-0ea9-41b2-b9ee-28aa184a6f1a None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:19.290509 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ccb42-0ea9-41b2-b9ee-28aa184a6f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:19.360061 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-2f6ccb42-0ea9-41b2-b9ee-28aa184a6f1a None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:50:19.361263 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-2f6ccb42-0ea9-41b2-b9ee-28aa184a6f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:19.456585 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 659/1309] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:50:19.511770 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da577677-3a47-4fd8-bd5a-c4107b9084a3 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:19.512054 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da577677-3a47-4fd8-bd5a-c4107b9084a3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:19.512328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da577677-3a47-4fd8-bd5a-c4107b9084a3 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:19.514187 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 651/1310] 10.222.0.31 () {54 vars in 964 bytes} [Thu Feb 10 20:50:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:50:19.520285 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11e4ac-3148-43e9-bfff-c07e9163facb None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:19.520577 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11e4ac-3148-43e9-bfff-c07e9163facb None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:19.520850 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11e4ac-3148-43e9-bfff-c07e9163facb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:19.596373 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-4f11e4ac-3148-43e9-bfff-c07e9163facb None None] MFA Rules not processed for user `b07a9ae7262b44ce88e1338c83360356`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:50:19.597509 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4f11e4ac-3148-43e9-bfff-c07e9163facb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:19.671447 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 660/1311] 10.222.0.31 () {58 vars in 1061 bytes} [Thu Feb 10 20:50:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:50:19.680916 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da577677-3a47-4fd8-bd5a-c4107b9084a3 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:50:19.682744 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-da577677-3a47-4fd8-bd5a-c4107b9084a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:19.789900 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da577677-3a47-4fd8-bd5a-c4107b9084a3 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:50:19.866904 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e5b43-8921-41f4-90d5-21a01a775b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:50:19.867445 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e5b43-8921-41f4-90d5-21a01a775b29 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:19.867722 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e5b43-8921-41f4-90d5-21a01a775b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:19.867978 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e5b43-8921-41f4-90d5-21a01a775b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:19.869649 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7e0e5b43-8921-41f4-90d5-21a01a775b29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:19.975449 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e5b43-8921-41f4-90d5-21a01a775b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:50:19.976904 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e5b43-8921-41f4-90d5-21a01a775b29 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:50:19.994590 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 652/1312] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:50:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:50:22.481634 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cff68e-3750-41aa-a923-9638120e6ae9 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:22.482199 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cff68e-3750-41aa-a923-9638120e6ae9 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:22.482199 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cff68e-3750-41aa-a923-9638120e6ae9 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:22.484414 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 661/1313] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:50:22.490341 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51104018-ea12-402a-9b84-0e4b9a261961 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:22.491327 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51104018-ea12-402a-9b84-0e4b9a261961 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:22.491830 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51104018-ea12-402a-9b84-0e4b9a261961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:22.569850 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-51104018-ea12-402a-9b84-0e4b9a261961 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:50:22.571237 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-51104018-ea12-402a-9b84-0e4b9a261961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:22.674274 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 653/1314] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:50:22.712059 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cff68e-3750-41aa-a923-9638120e6ae9 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:50:22.713913 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b0cff68e-3750-41aa-a923-9638120e6ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:22.819312 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cff68e-3750-41aa-a923-9638120e6ae9 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:50:22.895610 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab3061-4590-4dd9-8382-086f88b7ddc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:50:22.896616 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab3061-4590-4dd9-8382-086f88b7ddc8 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:22.896616 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab3061-4590-4dd9-8382-086f88b7ddc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:22.896783 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab3061-4590-4dd9-8382-086f88b7ddc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:22.898440 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-7cab3061-4590-4dd9-8382-086f88b7ddc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:23.008444 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab3061-4590-4dd9-8382-086f88b7ddc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:50:23.009837 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab3061-4590-4dd9-8382-086f88b7ddc8 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:50:23.027562 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 662/1315] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:50:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:50:25.544538 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ad255-c5b3-4cb6-8753-fb424b1405ff None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:25.545013 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ad255-c5b3-4cb6-8753-fb424b1405ff None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:25.545121 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ad255-c5b3-4cb6-8753-fb424b1405ff None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:25.546902 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 654/1316] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:50:25.553169 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076b800-eee5-497a-8245-6caa93bef688 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:25.553892 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076b800-eee5-497a-8245-6caa93bef688 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:25.554005 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076b800-eee5-497a-8245-6caa93bef688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:25.628199 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-4076b800-eee5-497a-8245-6caa93bef688 None None] MFA Rules not processed for user `8b22c33745c54882af2b0d91049e3e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:50:25.629393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4076b800-eee5-497a-8245-6caa93bef688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:25.731271 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 663/1317] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:50:25 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:50:25.780196 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ad255-c5b3-4cb6-8753-fb424b1405ff None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:50:25.782623 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c90ad255-c5b3-4cb6-8753-fb424b1405ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:25.901956 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ad255-c5b3-4cb6-8753-fb424b1405ff None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:50:25.974951 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04965864-8807-494e-85c6-acfb09f725d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:50:25.975587 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04965864-8807-494e-85c6-acfb09f725d5 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:25.975893 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04965864-8807-494e-85c6-acfb09f725d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:25.976135 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04965864-8807-494e-85c6-acfb09f725d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:25.977820 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-04965864-8807-494e-85c6-acfb09f725d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:26.084823 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04965864-8807-494e-85c6-acfb09f725d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:50:26.086288 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04965864-8807-494e-85c6-acfb09f725d5 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:50:26.105846 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 655/1318] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:50:25 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:50:28.831588 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc0605-5677-430d-b1c5-8fb7eb404945 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:28.832118 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc0605-5677-430d-b1c5-8fb7eb404945 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:28.832118 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc0605-5677-430d-b1c5-8fb7eb404945 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:28.833874 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 664/1319] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:50:28.840388 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ba009-d8f8-4f73-ba07-b33c69cb109c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:28.841062 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ba009-d8f8-4f73-ba07-b33c69cb109c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:28.841287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ba009-d8f8-4f73-ba07-b33c69cb109c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:28.911715 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-956ba009-d8f8-4f73-ba07-b33c69cb109c None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:50:28.912903 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-956ba009-d8f8-4f73-ba07-b33c69cb109c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:29.009138 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 656/1320] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:50:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:50:29.080412 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430e906-16c2-4b13-9371-277032c3f74e None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:29.080693 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430e906-16c2-4b13-9371-277032c3f74e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:29.080963 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430e906-16c2-4b13-9371-277032c3f74e None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:29.082871 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 665/1321] 10.222.0.31 () {54 vars in 964 bytes} [Thu Feb 10 20:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:50:29.089514 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bd53b-8f17-4726-8875-cf2f0621e55b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:29.089783 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bd53b-8f17-4726-8875-cf2f0621e55b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:29.090107 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bd53b-8f17-4726-8875-cf2f0621e55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:29.174287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-bc8bd53b-8f17-4726-8875-cf2f0621e55b None None] MFA Rules not processed for user `b07a9ae7262b44ce88e1338c83360356`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:50:29.175517 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-bc8bd53b-8f17-4726-8875-cf2f0621e55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:29.266523 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 657/1322] 10.222.0.31 () {58 vars in 1061 bytes} [Thu Feb 10 20:50:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:50:29.279414 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430e906-16c2-4b13-9371-277032c3f74e None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:50:29.280952 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-1430e906-16c2-4b13-9371-277032c3f74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:29.391427 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430e906-16c2-4b13-9371-277032c3f74e None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:50:29.475481 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3079ce-79ce-435a-af3d-55496c689065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:50:29.476128 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3079ce-79ce-435a-af3d-55496c689065 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:29.476401 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3079ce-79ce-435a-af3d-55496c689065 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:29.476666 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3079ce-79ce-435a-af3d-55496c689065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:29.478364 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-9b3079ce-79ce-435a-af3d-55496c689065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:29.587684 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3079ce-79ce-435a-af3d-55496c689065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:50:29.589132 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3079ce-79ce-435a-af3d-55496c689065 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:50:29.607490 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 666/1323] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:50:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:50:32.919340 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5afd1e-2f14-4662-8bb9-00c110c1d647 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:32.920230 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5afd1e-2f14-4662-8bb9-00c110c1d647 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:32.920509 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5afd1e-2f14-4662-8bb9-00c110c1d647 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:32.922525 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 658/1324] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:50:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:50:32.928016 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b6607-43ed-4752-ae80-f703888a61d3 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:32.928442 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b6607-43ed-4752-ae80-f703888a61d3 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:32.928679 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b6607-43ed-4752-ae80-f703888a61d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:32.997706 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-705b6607-43ed-4752-ae80-f703888a61d3 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:50:32.998898 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-705b6607-43ed-4752-ae80-f703888a61d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:33.096563 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 667/1325] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:50:33.133135 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5afd1e-2f14-4662-8bb9-00c110c1d647 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:50:33.134694 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ef5afd1e-2f14-4662-8bb9-00c110c1d647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:33.239211 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5afd1e-2f14-4662-8bb9-00c110c1d647 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:50:33.312515 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc606f-ecbb-4566-b618-32693047a2c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:50:33.313159 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc606f-ecbb-4566-b618-32693047a2c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:33.313474 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc606f-ecbb-4566-b618-32693047a2c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:33.313741 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc606f-ecbb-4566-b618-32693047a2c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:33.315452 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a0dc606f-ecbb-4566-b618-32693047a2c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:33.426576 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc606f-ecbb-4566-b618-32693047a2c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:50:33.428001 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc606f-ecbb-4566-b618-32693047a2c2 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:50:33.446283 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 659/1326] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:50:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:50:35.705600 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30d49a-115c-4bb2-a5fc-d9c81130c7f2 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:35.706130 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30d49a-115c-4bb2-a5fc-d9c81130c7f2 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:35.706130 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30d49a-115c-4bb2-a5fc-d9c81130c7f2 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:35.707970 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 668/1327] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:50:35.713861 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9488ce2-6387-4772-8a28-42887de77cfe None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:35.714379 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9488ce2-6387-4772-8a28-42887de77cfe None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:35.714379 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9488ce2-6387-4772-8a28-42887de77cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:35.780209 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-d9488ce2-6387-4772-8a28-42887de77cfe None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:50:35.781392 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d9488ce2-6387-4772-8a28-42887de77cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:35.874525 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 660/1328] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:50:35.910089 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30d49a-115c-4bb2-a5fc-d9c81130c7f2 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:50:35.911711 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-8d30d49a-115c-4bb2-a5fc-d9c81130c7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:36.015609 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30d49a-115c-4bb2-a5fc-d9c81130c7f2 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:50:36.091872 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34b7bd-00e1-4020-bd36-16be71bc5a4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:50:36.092525 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34b7bd-00e1-4020-bd36-16be71bc5a4a service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:36.092795 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34b7bd-00e1-4020-bd36-16be71bc5a4a service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:36.093060 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34b7bd-00e1-4020-bd36-16be71bc5a4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:36.094726 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-fb34b7bd-00e1-4020-bd36-16be71bc5a4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:36.202546 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34b7bd-00e1-4020-bd36-16be71bc5a4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:50:36.204015 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34b7bd-00e1-4020-bd36-16be71bc5a4a service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:50:36.221588 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 669/1329] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:50:38.468511 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc5f36-ce73-4115-b354-d0ae9ba73819 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:38.469107 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc5f36-ce73-4115-b354-d0ae9ba73819 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:38.469107 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc5f36-ce73-4115-b354-d0ae9ba73819 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:38.470885 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 661/1330] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:50:38.476671 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a499d-9418-473d-9902-be055d8cb992 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:38.477122 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a499d-9418-473d-9902-be055d8cb992 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:38.477321 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a499d-9418-473d-9902-be055d8cb992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:38.543661 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-981a499d-9418-473d-9902-be055d8cb992 None None] MFA Rules not processed for user `8b22c33745c54882af2b0d91049e3e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:50:38.545021 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-981a499d-9418-473d-9902-be055d8cb992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:38.643254 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 670/1331] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:50:38 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:50:38.680286 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc5f36-ce73-4115-b354-d0ae9ba73819 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:50:38.681974 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3cdc5f36-ce73-4115-b354-d0ae9ba73819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:38.787501 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc5f36-ce73-4115-b354-d0ae9ba73819 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:50:38.863386 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a1943-79a4-4f1e-a6ca-ce70cc07200e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:50:38.864046 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a1943-79a4-4f1e-a6ca-ce70cc07200e service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:38.864297 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a1943-79a4-4f1e-a6ca-ce70cc07200e service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:38.864562 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a1943-79a4-4f1e-a6ca-ce70cc07200e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:38.866295 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-878a1943-79a4-4f1e-a6ca-ce70cc07200e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:38.981944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a1943-79a4-4f1e-a6ca-ce70cc07200e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:50:38.983402 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a1943-79a4-4f1e-a6ca-ce70cc07200e service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:50:39.001464 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 662/1332] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:50:38 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:50:41.437800 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a1ff2-cf05-46b2-8be0-9f23982f0fa1 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:41.438364 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a1ff2-cf05-46b2-8be0-9f23982f0fa1 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:41.438364 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a1ff2-cf05-46b2-8be0-9f23982f0fa1 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:41.440163 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 671/1333] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:50:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:50:41.446558 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82448ea-1514-4519-b677-687843572388 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:41.447096 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82448ea-1514-4519-b677-687843572388 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:41.447096 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82448ea-1514-4519-b677-687843572388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:41.518226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e82448ea-1514-4519-b677-687843572388 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:50:41.519667 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e82448ea-1514-4519-b677-687843572388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:41.619096 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 663/1334] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:50:41.654655 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a1ff2-cf05-46b2-8be0-9f23982f0fa1 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:50:41.656423 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b91a1ff2-cf05-46b2-8be0-9f23982f0fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:41.760346 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a1ff2-cf05-46b2-8be0-9f23982f0fa1 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:50:41.837663 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0198d9-2f7c-43db-ad7b-1fc0ebf7de79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:50:41.838310 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0198d9-2f7c-43db-ad7b-1fc0ebf7de79 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:41.838587 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0198d9-2f7c-43db-ad7b-1fc0ebf7de79 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:41.838858 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0198d9-2f7c-43db-ad7b-1fc0ebf7de79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:41.840500 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-cc0198d9-2f7c-43db-ad7b-1fc0ebf7de79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:41.945565 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0198d9-2f7c-43db-ad7b-1fc0ebf7de79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:50:41.946919 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0198d9-2f7c-43db-ad7b-1fc0ebf7de79 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:50:41.964621 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 672/1335] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:50:44.193848 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaa618-146e-426d-90c8-393a2780eaa4 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:44.194827 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaa618-146e-426d-90c8-393a2780eaa4 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:44.194827 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaa618-146e-426d-90c8-393a2780eaa4 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:44.197641 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 664/1336] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:50:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:50:44.206373 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e4a2e-3d5b-49b9-8cb4-7ffd5552d4cd None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:44.207083 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e4a2e-3d5b-49b9-8cb4-7ffd5552d4cd None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:44.207169 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e4a2e-3d5b-49b9-8cb4-7ffd5552d4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:44.282709 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-0b3e4a2e-3d5b-49b9-8cb4-7ffd5552d4cd None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:50:44.283918 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-0b3e4a2e-3d5b-49b9-8cb4-7ffd5552d4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:44.384467 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 673/1337] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:50:44.431922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aaa618-146e-426d-90c8-393a2780eaa4 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:50:44.433449 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-12aaa618-146e-426d-90c8-393a2780eaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:44.551341 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aaa618-146e-426d-90c8-393a2780eaa4 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:50:44.626959 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363dc3f-eb33-4ec1-a404-d9e83b338bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:50:44.627601 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363dc3f-eb33-4ec1-a404-d9e83b338bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:44.627879 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363dc3f-eb33-4ec1-a404-d9e83b338bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:44.628145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363dc3f-eb33-4ec1-a404-d9e83b338bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:44.629808 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b363dc3f-eb33-4ec1-a404-d9e83b338bf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:44.738727 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363dc3f-eb33-4ec1-a404-d9e83b338bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:50:44.740144 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363dc3f-eb33-4ec1-a404-d9e83b338bf9 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:50:44.761176 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 665/1338] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:50:47.275075 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3716a-e502-42a3-908c-6147d900fa08 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:47.275655 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3716a-e502-42a3-908c-6147d900fa08 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:47.275655 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3716a-e502-42a3-908c-6147d900fa08 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:47.279340 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 674/1339] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:50:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:50:47.286204 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef987a6a-3447-4f9d-92da-87dc0bcb1456 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:47.286618 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef987a6a-3447-4f9d-92da-87dc0bcb1456 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:47.286790 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef987a6a-3447-4f9d-92da-87dc0bcb1456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:47.362656 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ef987a6a-3447-4f9d-92da-87dc0bcb1456 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:50:47.363884 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ef987a6a-3447-4f9d-92da-87dc0bcb1456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:47.471706 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 666/1340] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:50:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:50:47.511194 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3716a-e502-42a3-908c-6147d900fa08 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:50:47.513900 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-1fc3716a-e502-42a3-908c-6147d900fa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:47.618004 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3716a-e502-42a3-908c-6147d900fa08 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:50:47.622162 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f68d66-f48c-4654-a7f3-5f6b9df72262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:50:47.622807 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f68d66-f48c-4654-a7f3-5f6b9df72262 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:47.623083 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f68d66-f48c-4654-a7f3-5f6b9df72262 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:47.623348 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f68d66-f48c-4654-a7f3-5f6b9df72262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:47.633185 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f68d66-f48c-4654-a7f3-5f6b9df72262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:50:47.634691 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f68d66-f48c-4654-a7f3-5f6b9df72262 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:50:47.644351 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 675/1341] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:50:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:50:51.922317 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fec94f-846e-49ba-a87f-ea8fbb978730 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:51.922894 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fec94f-846e-49ba-a87f-ea8fbb978730 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:51.922894 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fec94f-846e-49ba-a87f-ea8fbb978730 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:51.924742 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 667/1342] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:50:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:50:51.930160 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2cf37-f996-4cb3-be1b-235a7ff87e9e None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:51.930625 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2cf37-f996-4cb3-be1b-235a7ff87e9e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:51.930728 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2cf37-f996-4cb3-be1b-235a7ff87e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:51.959523 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-39e2cf37-f996-4cb3-be1b-235a7ff87e9e None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:50:51.960705 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-39e2cf37-f996-4cb3-be1b-235a7ff87e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:52.037140 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 676/1343] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:50:52.075125 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fec94f-846e-49ba-a87f-ea8fbb978730 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:50:52.077025 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-17fec94f-846e-49ba-a87f-ea8fbb978730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:52.090589 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fec94f-846e-49ba-a87f-ea8fbb978730 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:50:52.094512 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18722653-5883-497b-9c13-ad8013bf1998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:50:52.095137 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18722653-5883-497b-9c13-ad8013bf1998 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:52.095413 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18722653-5883-497b-9c13-ad8013bf1998 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:52.095676 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18722653-5883-497b-9c13-ad8013bf1998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:52.104890 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18722653-5883-497b-9c13-ad8013bf1998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:50:52.106344 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18722653-5883-497b-9c13-ad8013bf1998 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:50:52.115460 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 668/1344] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:50:54.954015 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897ef98-8346-4f59-ae58-23f3ed46e641 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:54.954570 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897ef98-8346-4f59-ae58-23f3ed46e641 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:54.954570 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897ef98-8346-4f59-ae58-23f3ed46e641 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:54.956553 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 677/1345] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:50:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:50:54.962283 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35369927-11b0-4cc2-8266-4a61d08ed8c6 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:54.962748 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35369927-11b0-4cc2-8266-4a61d08ed8c6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:54.962849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35369927-11b0-4cc2-8266-4a61d08ed8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:54.982048 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-35369927-11b0-4cc2-8266-4a61d08ed8c6 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:50:54.983221 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-35369927-11b0-4cc2-8266-4a61d08ed8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:54.992399 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 669/1346] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:50:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:50:55.029957 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897ef98-8346-4f59-ae58-23f3ed46e641 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:50:55.042172 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897ef98-8346-4f59-ae58-23f3ed46e641 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:50:55.046240 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56515fe7-07ff-43b5-91b1-18c00d9f4bb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:50:55.047070 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56515fe7-07ff-43b5-91b1-18c00d9f4bb1 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:55.047415 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56515fe7-07ff-43b5-91b1-18c00d9f4bb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:55.047753 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56515fe7-07ff-43b5-91b1-18c00d9f4bb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:55.057008 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56515fe7-07ff-43b5-91b1-18c00d9f4bb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:50:55.058478 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56515fe7-07ff-43b5-91b1-18c00d9f4bb1 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:50:55.067977 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 678/1347] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:50:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:50:59.496581 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8499bc-b830-4006-ba94-8809b86badf3 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:59.497160 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8499bc-b830-4006-ba94-8809b86badf3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:59.497160 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8499bc-b830-4006-ba94-8809b86badf3 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:59.498947 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 670/1348] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:50:59.504561 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4f73b-d0e3-46ab-bf14-1d75217a950f None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:59.505011 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4f73b-d0e3-46ab-bf14-1d75217a950f None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:59.505103 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4f73b-d0e3-46ab-bf14-1d75217a950f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:59.523643 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-c6c4f73b-d0e3-46ab-bf14-1d75217a950f None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:50:59.524873 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-c6c4f73b-d0e3-46ab-bf14-1d75217a950f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:50:59.534265 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 679/1349] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:50:59.571930 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8499bc-b830-4006-ba94-8809b86badf3 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:50:59.583322 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8499bc-b830-4006-ba94-8809b86badf3 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:50:59.587267 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0da98-fdb5-4a7d-bb31-15377c159731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:50:59.587969 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0da98-fdb5-4a7d-bb31-15377c159731 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:50:59.588311 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0da98-fdb5-4a7d-bb31-15377c159731 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:50:59.588645 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0da98-fdb5-4a7d-bb31-15377c159731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:50:59.597516 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0da98-fdb5-4a7d-bb31-15377c159731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:50:59.598993 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0da98-fdb5-4a7d-bb31-15377c159731 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:50:59.608762 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 671/1350] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:51:04.600470 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bd687-06b5-491f-8bb6-98623b86f61d None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:04.600904 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bd687-06b5-491f-8bb6-98623b86f61d None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:04.601008 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bd687-06b5-491f-8bb6-98623b86f61d None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:04.603142 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 680/1351] 10.222.0.31 () {54 vars in 921 bytes} [Thu Feb 10 20:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:51:04.612387 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdb62a-a3d0-469e-a153-ebcb5bd02886 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:04.612836 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdb62a-a3d0-469e-a153-ebcb5bd02886 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:04.612927 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdb62a-a3d0-469e-a153-ebcb5bd02886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:04.731528 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-b3bdb62a-a3d0-469e-a153-ebcb5bd02886 None None] MFA Rules not processed for user `9f05eb88abe24af4825259712b497d48`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:04.733083 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b3bdb62a-a3d0-469e-a153-ebcb5bd02886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:04.815361 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 672/1352] 10.222.0.31 () {58 vars in 1018 bytes} [Thu Feb 10 20:51:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:51:08.987612 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bc4db-2b13-4e77-8c46-fe4f0ec19174 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:08.988138 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bc4db-2b13-4e77-8c46-fe4f0ec19174 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:08.988610 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bc4db-2b13-4e77-8c46-fe4f0ec19174 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:08.990625 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 681/1353] 10.222.0.31 () {54 vars in 921 bytes} [Thu Feb 10 20:51:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:51:08.995994 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40068f3-0b3e-42e2-8efd-0a651cf8faf8 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:08.996455 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40068f3-0b3e-42e2-8efd-0a651cf8faf8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:08.996749 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40068f3-0b3e-42e2-8efd-0a651cf8faf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:09.015591 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e40068f3-0b3e-42e2-8efd-0a651cf8faf8 None None] MFA Rules not processed for user `9f05eb88abe24af4825259712b497d48`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:09.016934 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e40068f3-0b3e-42e2-8efd-0a651cf8faf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:09.025717 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 673/1354] 10.222.0.31 () {58 vars in 1018 bytes} [Thu Feb 10 20:51:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:51:10.491299 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0371cbf-317c-4fbd-9111-0459c0dbf9d9 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:10.491867 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0371cbf-317c-4fbd-9111-0459c0dbf9d9 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:10.491867 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0371cbf-317c-4fbd-9111-0459c0dbf9d9 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:10.493677 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 682/1355] 10.222.0.31 () {54 vars in 921 bytes} [Thu Feb 10 20:51:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:51:10.498758 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ee603-1143-4a63-9696-a4e367c2cd50 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:10.499181 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ee603-1143-4a63-9696-a4e367c2cd50 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:10.499641 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ee603-1143-4a63-9696-a4e367c2cd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:10.518495 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-6d2ee603-1143-4a63-9696-a4e367c2cd50 None None] MFA Rules not processed for user `9f05eb88abe24af4825259712b497d48`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:10.519702 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6d2ee603-1143-4a63-9696-a4e367c2cd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:10.531601 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 674/1356] 10.222.0.31 () {58 vars in 1018 bytes} [Thu Feb 10 20:51:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:51:14.385074 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00120398-5258-4b44-a0ba-95cd2432f06f None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:14.385837 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00120398-5258-4b44-a0ba-95cd2432f06f None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:14.385837 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00120398-5258-4b44-a0ba-95cd2432f06f None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:14.387690 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 683/1357] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:51:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:51:14.393180 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e333d2b-6387-4988-9b3d-930163d13170 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:14.393666 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e333d2b-6387-4988-9b3d-930163d13170 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:14.393976 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e333d2b-6387-4988-9b3d-930163d13170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:14.413021 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-4e333d2b-6387-4988-9b3d-930163d13170 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:14.414249 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4e333d2b-6387-4988-9b3d-930163d13170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:14.422193 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 675/1358] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:51:14.469168 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f069da-f192-4a21-a9ea-4d029a775ecd None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:14.469449 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f069da-f192-4a21-a9ea-4d029a775ecd None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:14.469919 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f069da-f192-4a21-a9ea-4d029a775ecd None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:14.471670 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 684/1359] 10.222.0.31 () {54 vars in 961 bytes} [Thu Feb 10 20:51:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:51:14.477171 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa608ed-40b1-4fee-a9a3-4832003d5a7a None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:14.477594 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa608ed-40b1-4fee-a9a3-4832003d5a7a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:14.477962 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa608ed-40b1-4fee-a9a3-4832003d5a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:14.529685 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-9fa608ed-40b1-4fee-a9a3-4832003d5a7a None None] MFA Rules not processed for user `c0d84b0d7e3d423aa972e58be27c772c`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:14.531077 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9fa608ed-40b1-4fee-a9a3-4832003d5a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:14.614331 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 676/1360] 10.222.0.31 () {58 vars in 1058 bytes} [Thu Feb 10 20:51:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:51:14.622477 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f069da-f192-4a21-a9ea-4d029a775ecd None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:51:14.637675 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f069da-f192-4a21-a9ea-4d029a775ecd None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:51:14.644355 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c194d0b-6db4-4c52-87be-6add58716c73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:51:14.645021 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c194d0b-6db4-4c52-87be-6add58716c73 service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:14.645325 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c194d0b-6db4-4c52-87be-6add58716c73 service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:14.645620 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c194d0b-6db4-4c52-87be-6add58716c73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:14.664683 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c194d0b-6db4-4c52-87be-6add58716c73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:51:14.666435 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c194d0b-6db4-4c52-87be-6add58716c73 service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:51:14.686064 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 685/1361] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:51:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:51:17.103094 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380d7e8-0263-436c-9bfe-fb637cbd7105 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:17.103094 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380d7e8-0263-436c-9bfe-fb637cbd7105 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:17.103094 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380d7e8-0263-436c-9bfe-fb637cbd7105 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:17.105673 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 677/1362] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:51:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:51:17.110682 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b1ac5-2245-43c6-a82a-a0e6f83915a4 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:17.111115 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b1ac5-2245-43c6-a82a-a0e6f83915a4 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:17.111199 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b1ac5-2245-43c6-a82a-a0e6f83915a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:17.129329 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-a85b1ac5-2245-43c6-a82a-a0e6f83915a4 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:17.130562 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-a85b1ac5-2245-43c6-a82a-a0e6f83915a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:17.141769 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 686/1363] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:51:17.182537 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380d7e8-0263-436c-9bfe-fb637cbd7105 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:51:17.198712 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380d7e8-0263-436c-9bfe-fb637cbd7105 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:51:17.204708 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df4960-df89-4f31-83f8-9d817ca7e149 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:51:17.205581 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df4960-df89-4f31-83f8-9d817ca7e149 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:17.206099 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df4960-df89-4f31-83f8-9d817ca7e149 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:17.206548 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df4960-df89-4f31-83f8-9d817ca7e149 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:17.215851 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df4960-df89-4f31-83f8-9d817ca7e149 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:51:17.217788 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df4960-df89-4f31-83f8-9d817ca7e149 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:51:17.228066 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 678/1364] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:51:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:51:19.727741 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6d970-0b3e-4e6c-bb29-9a9d4c1735b6 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:19.728277 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6d970-0b3e-4e6c-bb29-9a9d4c1735b6 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:19.728277 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6d970-0b3e-4e6c-bb29-9a9d4c1735b6 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:19.730397 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 687/1365] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:51:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:51:19.738832 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1de9e-94af-440d-b160-0c15f179e372 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:19.739573 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1de9e-94af-440d-b160-0c15f179e372 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:19.739991 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1de9e-94af-440d-b160-0c15f179e372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:19.761120 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-12d1de9e-94af-440d-b160-0c15f179e372 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:19.766852 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-12d1de9e-94af-440d-b160-0c15f179e372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:19.781795 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 679/1366] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:51:19.821759 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f05ee-d392-445c-8e8c-62e640162963 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:19.822044 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f05ee-d392-445c-8e8c-62e640162963 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:19.822316 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f05ee-d392-445c-8e8c-62e640162963 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:19.824123 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 688/1367] 10.222.0.31 () {54 vars in 961 bytes} [Thu Feb 10 20:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:51:19.830305 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e99a7-370a-43fc-becb-41a6b7c76a5c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:19.830597 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e99a7-370a-43fc-becb-41a6b7c76a5c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:19.830865 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e99a7-370a-43fc-becb-41a6b7c76a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:19.849959 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-697e99a7-370a-43fc-becb-41a6b7c76a5c None None] MFA Rules not processed for user `c0d84b0d7e3d423aa972e58be27c772c`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:19.851114 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-697e99a7-370a-43fc-becb-41a6b7c76a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:19.860973 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 680/1368] 10.222.0.31 () {58 vars in 1058 bytes} [Thu Feb 10 20:51:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:51:19.869720 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f05ee-d392-445c-8e8c-62e640162963 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:51:19.884656 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f05ee-d392-445c-8e8c-62e640162963 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:51:19.890399 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d1777-de1e-4c3c-a03c-15c69ef638ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:51:19.891016 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d1777-de1e-4c3c-a03c-15c69ef638ac service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:19.891291 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d1777-de1e-4c3c-a03c-15c69ef638ac service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:19.891556 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d1777-de1e-4c3c-a03c-15c69ef638ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:19.899413 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d1777-de1e-4c3c-a03c-15c69ef638ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:51:19.900974 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d1777-de1e-4c3c-a03c-15c69ef638ac service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:51:19.909922 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 689/1369] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:51:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:51:22.176162 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88ddbe-afb0-4fb0-aa08-c93354dbf475 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:22.176856 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88ddbe-afb0-4fb0-aa08-c93354dbf475 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:22.176856 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88ddbe-afb0-4fb0-aa08-c93354dbf475 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:22.178631 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 681/1370] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:51:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:51:22.185129 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004c2aa-9eff-46f7-8552-7503da0bbd54 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:22.185713 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004c2aa-9eff-46f7-8552-7503da0bbd54 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:22.185713 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004c2aa-9eff-46f7-8552-7503da0bbd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:22.209512 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-e004c2aa-9eff-46f7-8552-7503da0bbd54 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:22.210747 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-e004c2aa-9eff-46f7-8552-7503da0bbd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:22.219413 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 690/1371] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:51:22.267436 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88ddbe-afb0-4fb0-aa08-c93354dbf475 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:51:22.283723 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88ddbe-afb0-4fb0-aa08-c93354dbf475 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:51:22.290036 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da06de-7688-40ce-a651-7bb3a48897e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:51:22.290947 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da06de-7688-40ce-a651-7bb3a48897e1 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:22.291380 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da06de-7688-40ce-a651-7bb3a48897e1 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:22.291791 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da06de-7688-40ce-a651-7bb3a48897e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:22.303047 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da06de-7688-40ce-a651-7bb3a48897e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:51:22.304643 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da06de-7688-40ce-a651-7bb3a48897e1 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:51:22.314703 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 682/1372] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:51:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:51:22.461162 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d54633-52c8-41a4-b58b-7b70a926979e None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:22.461461 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d54633-52c8-41a4-b58b-7b70a926979e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:22.461749 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d54633-52c8-41a4-b58b-7b70a926979e None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:22.463602 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 691/1373] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:51:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:51:22.469691 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfe4a5-0427-45a8-bda7-a67b902ab168 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:22.470270 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfe4a5-0427-45a8-bda7-a67b902ab168 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:22.470529 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfe4a5-0427-45a8-bda7-a67b902ab168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:22.490423 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-04dfe4a5-0427-45a8-bda7-a67b902ab168 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:22.491909 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-04dfe4a5-0427-45a8-bda7-a67b902ab168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:22.500631 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 683/1374] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:51:22.762187 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616918a7-8c10-4aac-b3f8-e5d12c61e35a None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:22.762408 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616918a7-8c10-4aac-b3f8-e5d12c61e35a None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:22.762612 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616918a7-8c10-4aac-b3f8-e5d12c61e35a None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:22.764868 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 692/1375] 10.222.0.31 () {54 vars in 963 bytes} [Thu Feb 10 20:51:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:51:22.770207 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fd422-f08a-4541-bf73-1f2f10c20323 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:22.770599 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fd422-f08a-4541-bf73-1f2f10c20323 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:22.771118 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fd422-f08a-4541-bf73-1f2f10c20323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:22.820153 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-4c7fd422-f08a-4541-bf73-1f2f10c20323 None None] MFA Rules not processed for user `ce66e520f6f84eab9e85c81022a0c743`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:22.821331 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4c7fd422-f08a-4541-bf73-1f2f10c20323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:22.879293 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 684/1376] 10.222.0.31 () {58 vars in 1060 bytes} [Thu Feb 10 20:51:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:51:22.886801 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616918a7-8c10-4aac-b3f8-e5d12c61e35a None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:51:22.897867 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616918a7-8c10-4aac-b3f8-e5d12c61e35a None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:51:22.901845 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663466b-f599-4091-8ccb-cb9115d1048d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:51:22.902479 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663466b-f599-4091-8ccb-cb9115d1048d service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:22.902760 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663466b-f599-4091-8ccb-cb9115d1048d service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:22.903033 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663466b-f599-4091-8ccb-cb9115d1048d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:22.912722 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663466b-f599-4091-8ccb-cb9115d1048d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:51:22.914193 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663466b-f599-4091-8ccb-cb9115d1048d service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:51:22.924215 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 693/1377] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:51:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:51:24.547413 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980ebb4-35cc-4414-8f22-8be23c1ccf19 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:24.547868 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980ebb4-35cc-4414-8f22-8be23c1ccf19 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:24.547969 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980ebb4-35cc-4414-8f22-8be23c1ccf19 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:24.549881 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 685/1378] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:51:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:51:24.555374 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed454c92-d6b4-482e-884d-6b40ff74c29a None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:24.555837 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed454c92-d6b4-482e-884d-6b40ff74c29a None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:24.555931 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed454c92-d6b4-482e-884d-6b40ff74c29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:24.574051 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-ed454c92-d6b4-482e-884d-6b40ff74c29a None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:24.575267 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ed454c92-d6b4-482e-884d-6b40ff74c29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:24.583015 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 694/1379] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:51:24.631266 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980ebb4-35cc-4414-8f22-8be23c1ccf19 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:51:24.647016 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980ebb4-35cc-4414-8f22-8be23c1ccf19 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:51:24.653572 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd368635-f124-4cd1-b769-2ac504577827 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:51:24.654216 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd368635-f124-4cd1-b769-2ac504577827 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:24.654496 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd368635-f124-4cd1-b769-2ac504577827 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:24.654765 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd368635-f124-4cd1-b769-2ac504577827 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:24.664327 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd368635-f124-4cd1-b769-2ac504577827 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:51:24.666161 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd368635-f124-4cd1-b769-2ac504577827 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:51:24.676287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 686/1380] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:51:26.891421 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d15b9-7260-4363-aaa6-17064e142762 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:26.891947 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d15b9-7260-4363-aaa6-17064e142762 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:26.891947 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d15b9-7260-4363-aaa6-17064e142762 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:26.893799 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 695/1381] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:51:26.899308 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5f452-65b0-440a-b6dc-042b16677a28 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:26.899789 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5f452-65b0-440a-b6dc-042b16677a28 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:26.899789 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5f452-65b0-440a-b6dc-042b16677a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:26.919381 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ceb5f452-65b0-440a-b6dc-042b16677a28 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:26.921115 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ceb5f452-65b0-440a-b6dc-042b16677a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:26.931272 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 687/1382] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:51:26.975168 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d15b9-7260-4363-aaa6-17064e142762 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:51:26.990405 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d15b9-7260-4363-aaa6-17064e142762 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:51:26.996246 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c23da1-a8a4-4891-8bac-005ad921f41c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:51:26.997022 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c23da1-a8a4-4891-8bac-005ad921f41c service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:26.997428 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c23da1-a8a4-4891-8bac-005ad921f41c service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:26.997798 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c23da1-a8a4-4891-8bac-005ad921f41c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:27.007148 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c23da1-a8a4-4891-8bac-005ad921f41c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:51:27.008834 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c23da1-a8a4-4891-8bac-005ad921f41c service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:51:27.019040 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 696/1383] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:51:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:51:29.237685 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1af5b-c3ac-452b-a302-dd245da12532 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:29.238251 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1af5b-c3ac-452b-a302-dd245da12532 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:29.238251 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1af5b-c3ac-452b-a302-dd245da12532 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:29.240581 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 688/1384] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:51:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:51:29.246278 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb593c-bc8a-4ac9-8e8e-48c11708e6d1 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:29.246740 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb593c-bc8a-4ac9-8e8e-48c11708e6d1 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:29.246848 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb593c-bc8a-4ac9-8e8e-48c11708e6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:29.269525 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-d3bb593c-bc8a-4ac9-8e8e-48c11708e6d1 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:29.270980 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d3bb593c-bc8a-4ac9-8e8e-48c11708e6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:29.280366 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 697/1385] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:51:29.324578 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1af5b-c3ac-452b-a302-dd245da12532 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:51:29.340272 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1af5b-c3ac-452b-a302-dd245da12532 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:51:29.345862 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d100a-80c6-4b54-8d2a-cc0fbed9076a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:51:29.346509 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d100a-80c6-4b54-8d2a-cc0fbed9076a service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:29.346791 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d100a-80c6-4b54-8d2a-cc0fbed9076a service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:29.347061 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d100a-80c6-4b54-8d2a-cc0fbed9076a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:29.355980 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d100a-80c6-4b54-8d2a-cc0fbed9076a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:51:29.357599 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d100a-80c6-4b54-8d2a-cc0fbed9076a service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:51:29.368074 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 689/1386] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:51:31.601952 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61371c-8864-46f3-8601-52dce14eba00 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:31.602863 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61371c-8864-46f3-8601-52dce14eba00 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:31.603181 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61371c-8864-46f3-8601-52dce14eba00 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:31.605173 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 698/1387] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:51:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:51:31.611255 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00927977-8000-458e-bece-4bcb8ab84615 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:31.611723 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00927977-8000-458e-bece-4bcb8ab84615 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:31.611831 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00927977-8000-458e-bece-4bcb8ab84615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:31.630932 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-00927977-8000-458e-bece-4bcb8ab84615 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:31.632328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-00927977-8000-458e-bece-4bcb8ab84615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:31.640841 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 690/1388] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:51:31.690313 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61371c-8864-46f3-8601-52dce14eba00 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:51:31.706452 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61371c-8864-46f3-8601-52dce14eba00 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:51:31.712094 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187f4e9-6f7e-493a-82dd-c8543d8e5740 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:51:31.712756 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187f4e9-6f7e-493a-82dd-c8543d8e5740 service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:31.713037 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187f4e9-6f7e-493a-82dd-c8543d8e5740 service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:31.713299 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187f4e9-6f7e-493a-82dd-c8543d8e5740 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:31.721938 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187f4e9-6f7e-493a-82dd-c8543d8e5740 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:51:31.723584 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187f4e9-6f7e-493a-82dd-c8543d8e5740 service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:51:31.733608 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 699/1389] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:51:34.417181 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebeac6-3b14-4d2a-9825-f82a5a246fe8 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:34.417836 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebeac6-3b14-4d2a-9825-f82a5a246fe8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:34.417937 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebeac6-3b14-4d2a-9825-f82a5a246fe8 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:34.420786 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 691/1390] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:51:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:51:34.426893 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb6c5a-ef3f-462a-a3b0-095138cd0921 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:34.427453 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb6c5a-ef3f-462a-a3b0-095138cd0921 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:34.427453 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb6c5a-ef3f-462a-a3b0-095138cd0921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:34.449695 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-fddb6c5a-ef3f-462a-a3b0-095138cd0921 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:34.450969 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-fddb6c5a-ef3f-462a-a3b0-095138cd0921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:34.459264 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 700/1391] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:51:34.505463 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeebeac6-3b14-4d2a-9825-f82a5a246fe8 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:51:34.526015 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeebeac6-3b14-4d2a-9825-f82a5a246fe8 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:51:34.534347 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85365165-de8d-4540-829a-dd907b3a7eb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:51:34.535260 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85365165-de8d-4540-829a-dd907b3a7eb3 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:34.535592 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85365165-de8d-4540-829a-dd907b3a7eb3 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:34.535953 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85365165-de8d-4540-829a-dd907b3a7eb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:34.548030 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85365165-de8d-4540-829a-dd907b3a7eb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:51:34.550282 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85365165-de8d-4540-829a-dd907b3a7eb3 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:51:34.562251 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 692/1392] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:51:37.037252 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c57e3c-4730-4151-9d00-cb2288de14b1 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:37.037887 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c57e3c-4730-4151-9d00-cb2288de14b1 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:37.037887 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c57e3c-4730-4151-9d00-cb2288de14b1 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:37.039642 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 701/1393] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:51:37.045291 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326cc83-2a08-44f9-b071-2662b320d052 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:37.045774 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326cc83-2a08-44f9-b071-2662b320d052 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:37.045893 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326cc83-2a08-44f9-b071-2662b320d052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:37.063787 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-2326cc83-2a08-44f9-b071-2662b320d052 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:37.064944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2326cc83-2a08-44f9-b071-2662b320d052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:37.073433 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 693/1394] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:51:37.117180 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c57e3c-4730-4151-9d00-cb2288de14b1 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:51:37.131501 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c57e3c-4730-4151-9d00-cb2288de14b1 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:51:37.137227 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f404544-d40b-467c-af1a-9410ed9bd1c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:51:37.138153 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f404544-d40b-467c-af1a-9410ed9bd1c1 service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:37.138300 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f404544-d40b-467c-af1a-9410ed9bd1c1 service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:37.138629 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f404544-d40b-467c-af1a-9410ed9bd1c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:37.147536 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f404544-d40b-467c-af1a-9410ed9bd1c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:51:37.149172 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f404544-d40b-467c-af1a-9410ed9bd1c1 service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:51:37.158618 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 702/1395] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:51:37.818059 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea016c9-40c1-474e-bfc0-be1c3855bc7a None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:37.818278 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea016c9-40c1-474e-bfc0-be1c3855bc7a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:37.818523 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea016c9-40c1-474e-bfc0-be1c3855bc7a None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:37.820340 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 694/1396] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:51:37.825798 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e633c2-17b7-4ccf-a536-4f638dc10ba1 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:37.826079 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e633c2-17b7-4ccf-a536-4f638dc10ba1 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:37.826347 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e633c2-17b7-4ccf-a536-4f638dc10ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:37.845524 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-45e633c2-17b7-4ccf-a536-4f638dc10ba1 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:37.846721 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-45e633c2-17b7-4ccf-a536-4f638dc10ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:37.855896 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 703/1397] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:51:37.910518 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16d6eb-926d-4b39-8d22-bfeeef79e2df None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:37.910801 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16d6eb-926d-4b39-8d22-bfeeef79e2df None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:37.911069 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16d6eb-926d-4b39-8d22-bfeeef79e2df None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:37.912891 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 695/1398] 10.222.0.31 () {54 vars in 962 bytes} [Thu Feb 10 20:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:51:37.918124 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cccee-bab1-4a83-b3a9-a67e828be986 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:37.918414 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cccee-bab1-4a83-b3a9-a67e828be986 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:37.918696 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cccee-bab1-4a83-b3a9-a67e828be986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:37.969256 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-f03cccee-bab1-4a83-b3a9-a67e828be986 None None] MFA Rules not processed for user `256860d94eb142c6b2175ae89f977e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:37.970528 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-f03cccee-bab1-4a83-b3a9-a67e828be986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:38.031865 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 704/1399] 10.222.0.31 () {58 vars in 1059 bytes} [Thu Feb 10 20:51:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:51:38.039596 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16d6eb-926d-4b39-8d22-bfeeef79e2df None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:51:38.051094 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16d6eb-926d-4b39-8d22-bfeeef79e2df None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:51:38.055168 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29575e3-4af2-49ae-b01b-817a5e2e812f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '256860d94eb142c6b2175ae89f977e4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:51:38.055873 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29575e3-4af2-49ae-b01b-817a5e2e812f service glance] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:38.056217 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29575e3-4af2-49ae-b01b-817a5e2e812f service glance] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:38.056545 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29575e3-4af2-49ae-b01b-817a5e2e812f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:38.066013 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29575e3-4af2-49ae-b01b-817a5e2e812f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:51:38.067423 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29575e3-4af2-49ae-b01b-817a5e2e812f service glance] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:51:38.077733 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 696/1400] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:51:38.500005 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a050c-beeb-4a15-9c16-f53e3823033a None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:38.500473 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a050c-beeb-4a15-9c16-f53e3823033a None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:38.500693 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a050c-beeb-4a15-9c16-f53e3823033a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:38.556528 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-2c7a050c-beeb-4a15-9c16-f53e3823033a None None] MFA Rules not processed for user `de790a1a69994f7498834ded10480e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:38.557782 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-2c7a050c-beeb-4a15-9c16-f53e3823033a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:38.620271 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 705/1401] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 10 20:51:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:51:38.665667 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f323d23-0c6b-4a42-b22b-df592bbcd960 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:38.665958 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f323d23-0c6b-4a42-b22b-df592bbcd960 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:38.666230 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f323d23-0c6b-4a42-b22b-df592bbcd960 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:38.668084 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 697/1402] 10.222.0.31 () {54 vars in 942 bytes} [Thu Feb 10 20:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:51:38.674405 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64adcf0-8829-4800-9e79-4318a4e197f7 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:38.674687 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64adcf0-8829-4800-9e79-4318a4e197f7 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:38.675126 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64adcf0-8829-4800-9e79-4318a4e197f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:38.723436 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-d64adcf0-8829-4800-9e79-4318a4e197f7 None None] MFA Rules not processed for user `6f09689635e54a4e85c0ef0e3539d911`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:38.724612 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d64adcf0-8829-4800-9e79-4318a4e197f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:38.797798 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 706/1403] 10.222.0.31 () {58 vars in 1039 bytes} [Thu Feb 10 20:51:38 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:51:38.807142 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f323d23-0c6b-4a42-b22b-df592bbcd960 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:51:38.821192 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f323d23-0c6b-4a42-b22b-df592bbcd960 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:51:38.826374 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0ba79-4fe9-48d8-8caa-d5e0fadb0604 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f09689635e54a4e85c0ef0e3539d911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:51:38.827000 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0ba79-4fe9-48d8-8caa-d5e0fadb0604 service swift] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:38.827280 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0ba79-4fe9-48d8-8caa-d5e0fadb0604 service swift] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:38.827550 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0ba79-4fe9-48d8-8caa-d5e0fadb0604 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:38.835633 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0ba79-4fe9-48d8-8caa-d5e0fadb0604 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:51:38.837373 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0ba79-4fe9-48d8-8caa-d5e0fadb0604 service swift] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:51:38.845178 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 698/1404] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 10 20:51:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:51:39.414058 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51370c-3518-4989-8470-da883e598839 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:39.414366 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51370c-3518-4989-8470-da883e598839 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:39.414630 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51370c-3518-4989-8470-da883e598839 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:39.420318 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 707/1405] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:51:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:51:39.421785 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a976dc-cd1b-4544-beda-2a5c4f567958 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:39.422246 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a976dc-cd1b-4544-beda-2a5c4f567958 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:39.422346 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a976dc-cd1b-4544-beda-2a5c4f567958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:39.442327 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-82a976dc-cd1b-4544-beda-2a5c4f567958 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:39.443543 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-82a976dc-cd1b-4544-beda-2a5c4f567958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:39.451618 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 699/1406] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:51:39.499572 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51370c-3518-4989-8470-da883e598839 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:51:39.514191 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51370c-3518-4989-8470-da883e598839 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:51:39.520964 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6500e68-a8fc-4f80-b81d-b21b3b5076be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:51:39.521743 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6500e68-a8fc-4f80-b81d-b21b3b5076be service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:39.522099 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6500e68-a8fc-4f80-b81d-b21b3b5076be service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:39.522430 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6500e68-a8fc-4f80-b81d-b21b3b5076be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:39.531914 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6500e68-a8fc-4f80-b81d-b21b3b5076be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:51:39.533611 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6500e68-a8fc-4f80-b81d-b21b3b5076be service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:51:39.549291 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 708/1407] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:51:41.800125 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c58eea-3ef2-497a-bc1b-1f181606fb94 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:41.800690 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c58eea-3ef2-497a-bc1b-1f181606fb94 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:41.800690 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c58eea-3ef2-497a-bc1b-1f181606fb94 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:41.802407 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 700/1408] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:51:41.809218 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c774166-cc2e-4be1-87b2-d05db108126e None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:41.809697 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c774166-cc2e-4be1-87b2-d05db108126e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:41.809785 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c774166-cc2e-4be1-87b2-d05db108126e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:41.828179 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-5c774166-cc2e-4be1-87b2-d05db108126e None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:51:41.829533 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-5c774166-cc2e-4be1-87b2-d05db108126e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:51:41.849445 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 709/1409] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:51:41.883940 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c58eea-3ef2-497a-bc1b-1f181606fb94 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:51:41.898405 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c58eea-3ef2-497a-bc1b-1f181606fb94 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:51:41.903961 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1b9db-ccac-464e-9364-8301689399d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:51:41.904694 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1b9db-ccac-464e-9364-8301689399d9 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:51:41.905050 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1b9db-ccac-464e-9364-8301689399d9 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:51:41.905414 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1b9db-ccac-464e-9364-8301689399d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:51:41.915284 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1b9db-ccac-464e-9364-8301689399d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:51:41.916865 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1b9db-ccac-464e-9364-8301689399d9 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:51:41.926944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 701/1410] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:52:00.851218 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b201782-8a44-4932-925f-58b5b1916465 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:00.851798 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b201782-8a44-4932-925f-58b5b1916465 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:00.851798 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b201782-8a44-4932-925f-58b5b1916465 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:00.854062 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 710/1411] 10.222.0.31 () {54 vars in 918 bytes} [Thu Feb 10 20:52:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:00.863047 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b6ced-6ab4-42c9-af18-745c0d18d931 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:00.863553 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b6ced-6ab4-42c9-af18-745c0d18d931 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:00.863553 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b6ced-6ab4-42c9-af18-745c0d18d931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:00.884679 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ee7b6ced-6ab4-42c9-af18-745c0d18d931 None None] MFA Rules not processed for user `9f05eb88abe24af4825259712b497d48`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:00.885911 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ee7b6ced-6ab4-42c9-af18-745c0d18d931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:00.895225 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 702/1412] 10.222.0.31 () {58 vars in 1015 bytes} [Thu Feb 10 20:52:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:52:00.910688 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930efd72-ff94-48da-97b4-e6e8428768f5 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:00.911018 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930efd72-ff94-48da-97b4-e6e8428768f5 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:00.911355 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930efd72-ff94-48da-97b4-e6e8428768f5 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:00.914151 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 711/1413] 10.222.0.31 () {54 vars in 918 bytes} [Thu Feb 10 20:52:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:00.920654 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b270d-58b2-496c-8cf3-b3f2db29d6a8 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:00.920940 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b270d-58b2-496c-8cf3-b3f2db29d6a8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:00.921213 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b270d-58b2-496c-8cf3-b3f2db29d6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:00.939311 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ac5b270d-58b2-496c-8cf3-b3f2db29d6a8 None None] MFA Rules not processed for user `c0d84b0d7e3d423aa972e58be27c772c`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:00.940472 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ac5b270d-58b2-496c-8cf3-b3f2db29d6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:00.950751 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 703/1414] 10.222.0.31 () {58 vars in 1015 bytes} [Thu Feb 10 20:52:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:52:03.587460 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff29142-748b-4f12-bb34-914b6dc810a4 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:03.588028 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff29142-748b-4f12-bb34-914b6dc810a4 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:03.588028 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff29142-748b-4f12-bb34-914b6dc810a4 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:03.589763 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 712/1415] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 20:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:03.596151 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6268934-5923-4102-bb6b-720907f02f1c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:03.596881 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6268934-5923-4102-bb6b-720907f02f1c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:03.597061 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6268934-5923-4102-bb6b-720907f02f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:03.625712 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-b6268934-5923-4102-bb6b-720907f02f1c None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:03.626883 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b6268934-5923-4102-bb6b-720907f02f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:03.634941 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 704/1416] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 20:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:52:03.679193 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff29142-748b-4f12-bb34-914b6dc810a4 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:52:03.696838 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff29142-748b-4f12-bb34-914b6dc810a4 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:52:03.703469 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7bc61-658c-4da0-84cc-eb278d95780f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:52:03.704107 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7bc61-658c-4da0-84cc-eb278d95780f service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:03.704386 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7bc61-658c-4da0-84cc-eb278d95780f service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:03.704662 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7bc61-658c-4da0-84cc-eb278d95780f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:03.713394 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7bc61-658c-4da0-84cc-eb278d95780f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:52:03.714977 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7bc61-658c-4da0-84cc-eb278d95780f service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:52:03.724780 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 713/1417] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:52:05.071854 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832392ee-2bd2-437e-bcbb-61503176bce7 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:05.072733 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832392ee-2bd2-437e-bcbb-61503176bce7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:05.072733 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832392ee-2bd2-437e-bcbb-61503176bce7 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:05.075665 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 705/1418] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 20:52:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:05.084063 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479449a-0c69-4788-9e03-72538d2c2ab6 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:05.084480 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479449a-0c69-4788-9e03-72538d2c2ab6 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:05.084622 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479449a-0c69-4788-9e03-72538d2c2ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:05.106611 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-e479449a-0c69-4788-9e03-72538d2c2ab6 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:05.107840 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-e479449a-0c69-4788-9e03-72538d2c2ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:05.116693 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 714/1419] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 20:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:52:05.266972 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832392ee-2bd2-437e-bcbb-61503176bce7 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:52:05.292877 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832392ee-2bd2-437e-bcbb-61503176bce7 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:52:05.300608 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6df165-8208-4db9-b531-bf552da824c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:52:05.301237 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6df165-8208-4db9-b531-bf552da824c9 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:05.301543 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6df165-8208-4db9-b531-bf552da824c9 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:05.301803 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6df165-8208-4db9-b531-bf552da824c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:05.310380 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6df165-8208-4db9-b531-bf552da824c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:52:05.311995 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6df165-8208-4db9-b531-bf552da824c9 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:52:05.321676 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 706/1420] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:52:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:52:06.650375 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c75f2-36b0-4ae5-b0af-adfabbc4899a None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:06.651237 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c75f2-36b0-4ae5-b0af-adfabbc4899a None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:06.651237 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c75f2-36b0-4ae5-b0af-adfabbc4899a None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:06.654317 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 715/1421] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 20:52:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:06.660434 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ed4cb-d9db-4b72-8505-4e20378f6b7d None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:06.661188 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ed4cb-d9db-4b72-8505-4e20378f6b7d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:06.661392 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ed4cb-d9db-4b72-8505-4e20378f6b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:06.696668 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-810ed4cb-d9db-4b72-8505-4e20378f6b7d None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:06.698316 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-810ed4cb-d9db-4b72-8505-4e20378f6b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:06.708356 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 707/1422] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 20:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:52:06.867749 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c75f2-36b0-4ae5-b0af-adfabbc4899a None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:52:06.891937 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c75f2-36b0-4ae5-b0af-adfabbc4899a None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:52:06.898245 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfde8c-6507-4263-8bf5-bc393b932e55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:52:06.898882 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfde8c-6507-4263-8bf5-bc393b932e55 service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:06.899165 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfde8c-6507-4263-8bf5-bc393b932e55 service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:06.899441 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfde8c-6507-4263-8bf5-bc393b932e55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:06.907684 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfde8c-6507-4263-8bf5-bc393b932e55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:52:06.909296 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfde8c-6507-4263-8bf5-bc393b932e55 service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:52:06.918602 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 716/1423] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:52:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:52:08.211461 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1307c6c-3c7e-4eba-90a1-495641395b65 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:08.212054 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1307c6c-3c7e-4eba-90a1-495641395b65 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:08.212054 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1307c6c-3c7e-4eba-90a1-495641395b65 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:08.214850 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 708/1424] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 20:52:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:08.223228 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46eafe6-af4b-4428-bdd3-22f25cc044e2 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:08.223629 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46eafe6-af4b-4428-bdd3-22f25cc044e2 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:08.223821 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46eafe6-af4b-4428-bdd3-22f25cc044e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:08.246742 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-d46eafe6-af4b-4428-bdd3-22f25cc044e2 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:08.247930 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d46eafe6-af4b-4428-bdd3-22f25cc044e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:08.257008 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 717/1425] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 20:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:52:08.417000 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1307c6c-3c7e-4eba-90a1-495641395b65 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:52:08.433378 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1307c6c-3c7e-4eba-90a1-495641395b65 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:52:08.439737 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb7f73-e2cd-414d-84d8-8658cd95a51a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:52:08.440372 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb7f73-e2cd-414d-84d8-8658cd95a51a service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:08.440646 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb7f73-e2cd-414d-84d8-8658cd95a51a service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:08.440914 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb7f73-e2cd-414d-84d8-8658cd95a51a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:08.449618 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb7f73-e2cd-414d-84d8-8658cd95a51a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:52:08.451247 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb7f73-e2cd-414d-84d8-8658cd95a51a service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:52:08.460428 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 709/1426] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:52:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:52:09.760632 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c661a-35e4-467f-a0ed-48054f6ba35c None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:09.761553 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c661a-35e4-467f-a0ed-48054f6ba35c None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:09.761553 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c661a-35e4-467f-a0ed-48054f6ba35c None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:09.764424 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 718/1427] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 20:52:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:09.770113 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a405bd-a0af-4169-8df7-7c1bf5cd2281 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:09.770528 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a405bd-a0af-4169-8df7-7c1bf5cd2281 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:09.770652 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a405bd-a0af-4169-8df7-7c1bf5cd2281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:09.789275 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-18a405bd-a0af-4169-8df7-7c1bf5cd2281 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:09.790502 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-18a405bd-a0af-4169-8df7-7c1bf5cd2281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:09.799809 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 710/1428] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 20:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:52:09.952645 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c661a-35e4-467f-a0ed-48054f6ba35c None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:52:09.968833 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c661a-35e4-467f-a0ed-48054f6ba35c None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:52:09.974917 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87012ae9-2953-4489-acff-59a9be4ab1f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:52:09.975554 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87012ae9-2953-4489-acff-59a9be4ab1f6 service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:09.975828 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87012ae9-2953-4489-acff-59a9be4ab1f6 service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:09.976081 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87012ae9-2953-4489-acff-59a9be4ab1f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:09.984654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87012ae9-2953-4489-acff-59a9be4ab1f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:52:09.986274 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87012ae9-2953-4489-acff-59a9be4ab1f6 service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:52:09.995950 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 719/1429] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:52:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:52:11.266245 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f750217-08cc-442d-a338-1202f4d15000 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:11.266785 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f750217-08cc-442d-a338-1202f4d15000 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:11.266785 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f750217-08cc-442d-a338-1202f4d15000 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:11.269562 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 711/1430] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 20:52:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:11.277966 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9513e8a-fea6-4901-b99d-31b6e24b32bc None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:11.278387 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9513e8a-fea6-4901-b99d-31b6e24b32bc None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:11.278540 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9513e8a-fea6-4901-b99d-31b6e24b32bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:11.302914 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-e9513e8a-fea6-4901-b99d-31b6e24b32bc None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:11.304122 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-e9513e8a-fea6-4901-b99d-31b6e24b32bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:11.313507 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 720/1431] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 20:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:52:11.471249 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f750217-08cc-442d-a338-1202f4d15000 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:52:11.491406 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f750217-08cc-442d-a338-1202f4d15000 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:52:11.498143 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa903f-bac7-46e3-9626-2877666e655a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:52:11.498772 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa903f-bac7-46e3-9626-2877666e655a service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:11.499045 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa903f-bac7-46e3-9626-2877666e655a service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:11.499309 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa903f-bac7-46e3-9626-2877666e655a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:11.508990 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa903f-bac7-46e3-9626-2877666e655a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:52:11.510640 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa903f-bac7-46e3-9626-2877666e655a service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:52:11.520409 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 712/1432] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:52:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:52:12.759206 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf4e32-5b2f-438d-8861-0f4a0f369f03 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:12.759803 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf4e32-5b2f-438d-8861-0f4a0f369f03 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:12.759803 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf4e32-5b2f-438d-8861-0f4a0f369f03 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:12.762665 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 721/1433] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 20:52:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:12.768907 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa970b-17ff-4b7b-a3ad-a3b57f16d8bf None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:12.769422 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa970b-17ff-4b7b-a3ad-a3b57f16d8bf None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:12.769531 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa970b-17ff-4b7b-a3ad-a3b57f16d8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:12.788397 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e0fa970b-17ff-4b7b-a3ad-a3b57f16d8bf None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:12.789612 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e0fa970b-17ff-4b7b-a3ad-a3b57f16d8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:12.798404 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 713/1434] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 20:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:52:12.956256 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf4e32-5b2f-438d-8861-0f4a0f369f03 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:52:12.971266 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf4e32-5b2f-438d-8861-0f4a0f369f03 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:52:12.978385 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45028fbe-601c-4055-935b-27d59de4c308 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:52:12.979029 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45028fbe-601c-4055-935b-27d59de4c308 service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:12.979307 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45028fbe-601c-4055-935b-27d59de4c308 service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:12.979576 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45028fbe-601c-4055-935b-27d59de4c308 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:12.989077 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45028fbe-601c-4055-935b-27d59de4c308 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:52:12.990698 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45028fbe-601c-4055-935b-27d59de4c308 service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:52:13.000925 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 722/1435] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:52:14.272726 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efd66c-9386-4b41-b7e7-ede3e7acfe3a None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:14.273714 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efd66c-9386-4b41-b7e7-ede3e7acfe3a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:14.273714 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efd66c-9386-4b41-b7e7-ede3e7acfe3a None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:14.276764 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 714/1436] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 20:52:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:14.282800 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a35836-c9d4-4743-bc70-718a4bef773b None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:14.283257 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a35836-c9d4-4743-bc70-718a4bef773b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:14.283408 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a35836-c9d4-4743-bc70-718a4bef773b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:14.307275 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-50a35836-c9d4-4743-bc70-718a4bef773b None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:14.308470 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-50a35836-c9d4-4743-bc70-718a4bef773b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:14.317582 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 723/1437] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 20:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:52:14.472226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efd66c-9386-4b41-b7e7-ede3e7acfe3a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:52:14.491982 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efd66c-9386-4b41-b7e7-ede3e7acfe3a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:52:14.499182 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba11910-9f9f-4319-8e07-64f18b71e43e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:52:14.499836 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba11910-9f9f-4319-8e07-64f18b71e43e service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:14.500113 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba11910-9f9f-4319-8e07-64f18b71e43e service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:14.500384 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba11910-9f9f-4319-8e07-64f18b71e43e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:14.509181 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba11910-9f9f-4319-8e07-64f18b71e43e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:52:14.510793 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba11910-9f9f-4319-8e07-64f18b71e43e service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:52:14.521119 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 715/1438] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:52:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:52:15.773505 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbebfa-c11b-4795-a461-b9f37db87b96 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:15.774115 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbebfa-c11b-4795-a461-b9f37db87b96 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:15.774115 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbebfa-c11b-4795-a461-b9f37db87b96 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:15.775866 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 724/1439] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 20:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:15.782099 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449d472-8ea1-4447-bbe9-896bd51c0ccd None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:15.783046 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449d472-8ea1-4447-bbe9-896bd51c0ccd None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:15.783046 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449d472-8ea1-4447-bbe9-896bd51c0ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:15.809083 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-b449d472-8ea1-4447-bbe9-896bd51c0ccd None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:15.810223 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b449d472-8ea1-4447-bbe9-896bd51c0ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:15.819649 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 716/1440] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 20:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:52:15.972727 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbebfa-c11b-4795-a461-b9f37db87b96 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:52:15.987108 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbebfa-c11b-4795-a461-b9f37db87b96 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:52:15.992727 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314d9f6-5283-4d90-a5e0-ef942f9bf15e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:52:15.993362 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314d9f6-5283-4d90-a5e0-ef942f9bf15e service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:15.994036 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314d9f6-5283-4d90-a5e0-ef942f9bf15e service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:15.994307 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314d9f6-5283-4d90-a5e0-ef942f9bf15e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:16.002273 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314d9f6-5283-4d90-a5e0-ef942f9bf15e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:52:16.003882 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314d9f6-5283-4d90-a5e0-ef942f9bf15e service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:52:16.013337 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 725/1441] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:52:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:52:18.126141 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252f476-aa66-4659-bda5-5e0a2d0a2f7b None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:18.127053 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252f476-aa66-4659-bda5-5e0a2d0a2f7b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:18.127053 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252f476-aa66-4659-bda5-5e0a2d0a2f7b None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:18.129989 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 717/1442] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 20:52:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:18.135661 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673a732-a12c-40fe-9c3b-7d1e91cf3201 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:18.136107 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673a732-a12c-40fe-9c3b-7d1e91cf3201 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:18.136200 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673a732-a12c-40fe-9c3b-7d1e91cf3201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:18.156291 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-d673a732-a12c-40fe-9c3b-7d1e91cf3201 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:18.157514 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d673a732-a12c-40fe-9c3b-7d1e91cf3201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:18.166815 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 726/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 20:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:52:18.206527 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252f476-aa66-4659-bda5-5e0a2d0a2f7b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:52:18.223750 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252f476-aa66-4659-bda5-5e0a2d0a2f7b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:52:18.228804 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b82de9-32ad-4c57-8833-b0abcd6c95ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:52:18.229491 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b82de9-32ad-4c57-8833-b0abcd6c95ca service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:18.229762 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b82de9-32ad-4c57-8833-b0abcd6c95ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:18.230024 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b82de9-32ad-4c57-8833-b0abcd6c95ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:18.239507 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b82de9-32ad-4c57-8833-b0abcd6c95ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:52:18.240932 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b82de9-32ad-4c57-8833-b0abcd6c95ca service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:52:18.250430 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 718/1444] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:52:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:52:20.613801 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8a9f1-baf8-4196-8d6c-3dc220b0c518 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:20.614683 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8a9f1-baf8-4196-8d6c-3dc220b0c518 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:20.614683 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8a9f1-baf8-4196-8d6c-3dc220b0c518 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:20.617588 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 727/1445] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 20:52:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:20.624351 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9315c01-a4fa-4fcb-b5de-4f80729dd3b6 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:20.624799 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9315c01-a4fa-4fcb-b5de-4f80729dd3b6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:20.624914 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9315c01-a4fa-4fcb-b5de-4f80729dd3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:20.643726 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-f9315c01-a4fa-4fcb-b5de-4f80729dd3b6 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:20.644944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f9315c01-a4fa-4fcb-b5de-4f80729dd3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:20.653145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 719/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 20:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:52:20.695657 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8a9f1-baf8-4196-8d6c-3dc220b0c518 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:52:20.708887 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8a9f1-baf8-4196-8d6c-3dc220b0c518 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:52:20.713517 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb01c7a-530d-4434-804a-c44790202ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:52:20.714175 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb01c7a-530d-4434-804a-c44790202ffc service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:20.714449 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb01c7a-530d-4434-804a-c44790202ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:20.714715 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb01c7a-530d-4434-804a-c44790202ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:20.724262 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb01c7a-530d-4434-804a-c44790202ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:52:20.725717 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb01c7a-530d-4434-804a-c44790202ffc service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:52:20.734940 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 728/1447] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:52:23.275579 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab52cf3-c560-44c6-b4a4-5309687acd74 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:23.276097 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab52cf3-c560-44c6-b4a4-5309687acd74 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:23.276097 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab52cf3-c560-44c6-b4a4-5309687acd74 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:23.278794 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 720/1448] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 20:52:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:23.284484 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77255f-8593-48a5-9ecc-a450f95628da None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:23.284993 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77255f-8593-48a5-9ecc-a450f95628da None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:23.284993 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77255f-8593-48a5-9ecc-a450f95628da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:23.304070 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-5e77255f-8593-48a5-9ecc-a450f95628da None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:23.305250 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-5e77255f-8593-48a5-9ecc-a450f95628da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:23.313548 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 729/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 20:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:52:23.354925 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab52cf3-c560-44c6-b4a4-5309687acd74 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:52:23.368372 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab52cf3-c560-44c6-b4a4-5309687acd74 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:52:23.372649 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9f694-9a80-478d-858a-183bfabee62e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:52:23.373277 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9f694-9a80-478d-858a-183bfabee62e service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:23.373588 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9f694-9a80-478d-858a-183bfabee62e service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:23.373849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9f694-9a80-478d-858a-183bfabee62e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:23.382990 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9f694-9a80-478d-858a-183bfabee62e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:52:23.384457 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9f694-9a80-478d-858a-183bfabee62e service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:52:23.394070 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 721/1450] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:52:25.788050 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a880e7-f74b-4d4b-a321-26d5cfd99dd5 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:25.788691 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a880e7-f74b-4d4b-a321-26d5cfd99dd5 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:25.788691 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a880e7-f74b-4d4b-a321-26d5cfd99dd5 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:25.790436 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 730/1451] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 20:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:25.796766 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704d189-8cb8-4260-bf5d-579b7fbe290c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:25.797210 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704d189-8cb8-4260-bf5d-579b7fbe290c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:25.797210 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704d189-8cb8-4260-bf5d-579b7fbe290c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:25.821310 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-c704d189-8cb8-4260-bf5d-579b7fbe290c None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:25.822536 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c704d189-8cb8-4260-bf5d-579b7fbe290c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:25.831553 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 722/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 20:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:52:25.872474 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a880e7-f74b-4d4b-a321-26d5cfd99dd5 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:52:25.883757 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a880e7-f74b-4d4b-a321-26d5cfd99dd5 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:52:25.887740 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c446222-df8a-4979-a491-9f674846ed13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:52:25.888371 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c446222-df8a-4979-a491-9f674846ed13 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:25.888643 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c446222-df8a-4979-a491-9f674846ed13 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:25.888914 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c446222-df8a-4979-a491-9f674846ed13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:25.898208 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c446222-df8a-4979-a491-9f674846ed13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:52:25.899629 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c446222-df8a-4979-a491-9f674846ed13 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:52:25.908965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 731/1453] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:52:28.163861 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b00b23-cac0-4c04-aab2-a3457e5e1d69 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:28.164456 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b00b23-cac0-4c04-aab2-a3457e5e1d69 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:28.164456 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b00b23-cac0-4c04-aab2-a3457e5e1d69 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:28.166252 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 723/1454] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 20:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:28.172788 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb1ac5-a17e-4386-872c-63a3e5cd5e5c None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:28.173526 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb1ac5-a17e-4386-872c-63a3e5cd5e5c None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:28.173685 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb1ac5-a17e-4386-872c-63a3e5cd5e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:28.198301 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-afbb1ac5-a17e-4386-872c-63a3e5cd5e5c None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:28.199494 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-afbb1ac5-a17e-4386-872c-63a3e5cd5e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:28.208046 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 732/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 20:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:52:28.248645 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b00b23-cac0-4c04-aab2-a3457e5e1d69 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:52:28.260254 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b00b23-cac0-4c04-aab2-a3457e5e1d69 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:52:28.264654 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb90aa-11f8-4625-ad23-96494f13b93a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:52:28.265283 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb90aa-11f8-4625-ad23-96494f13b93a service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:28.265597 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb90aa-11f8-4625-ad23-96494f13b93a service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:28.265866 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb90aa-11f8-4625-ad23-96494f13b93a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:28.275107 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb90aa-11f8-4625-ad23-96494f13b93a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:52:28.276530 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb90aa-11f8-4625-ad23-96494f13b93a service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:52:28.286500 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 724/1456] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:52:30.524333 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b53b05-e8a1-4342-95be-bdb3a97f150b None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:30.524932 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b53b05-e8a1-4342-95be-bdb3a97f150b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:30.524932 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b53b05-e8a1-4342-95be-bdb3a97f150b None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:30.527662 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 733/1457] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 20:52:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:30.535753 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2390fd-e108-42d2-94a5-fe0a8cd617a4 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:30.536232 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2390fd-e108-42d2-94a5-fe0a8cd617a4 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:30.536232 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2390fd-e108-42d2-94a5-fe0a8cd617a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:30.554688 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-eb2390fd-e108-42d2-94a5-fe0a8cd617a4 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:30.555855 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-eb2390fd-e108-42d2-94a5-fe0a8cd617a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:30.565222 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 725/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 20:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:52:30.606280 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b53b05-e8a1-4342-95be-bdb3a97f150b None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:52:30.621613 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b53b05-e8a1-4342-95be-bdb3a97f150b None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:52:30.628744 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156686e-08ef-45b3-959c-bf0de1842c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:52:30.629412 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156686e-08ef-45b3-959c-bf0de1842c7d service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:30.629725 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156686e-08ef-45b3-959c-bf0de1842c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:30.629989 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156686e-08ef-45b3-959c-bf0de1842c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:30.639952 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156686e-08ef-45b3-959c-bf0de1842c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:52:30.641407 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156686e-08ef-45b3-959c-bf0de1842c7d service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:52:30.651020 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 734/1459] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:52:33.015246 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a45fc3-4ccb-461a-8da2-df149ea6fb8a None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:33.015741 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a45fc3-4ccb-461a-8da2-df149ea6fb8a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:33.015741 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a45fc3-4ccb-461a-8da2-df149ea6fb8a None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:33.017619 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 726/1460] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 20:52:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:33.023910 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b316c-4d64-4b36-9298-5ee2f0222a4d None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:33.024373 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b316c-4d64-4b36-9298-5ee2f0222a4d None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:33.024468 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b316c-4d64-4b36-9298-5ee2f0222a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:33.051963 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-306b316c-4d64-4b36-9298-5ee2f0222a4d None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:33.053133 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-306b316c-4d64-4b36-9298-5ee2f0222a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:33.062539 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 735/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 20:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:52:33.103135 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a45fc3-4ccb-461a-8da2-df149ea6fb8a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:52:33.119328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a45fc3-4ccb-461a-8da2-df149ea6fb8a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:52:33.124117 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbe040-7ed7-4f4f-b719-32cc25a78317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:52:33.124749 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbe040-7ed7-4f4f-b719-32cc25a78317 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:33.125021 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbe040-7ed7-4f4f-b719-32cc25a78317 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:33.125285 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbe040-7ed7-4f4f-b719-32cc25a78317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:33.134957 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbe040-7ed7-4f4f-b719-32cc25a78317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:52:33.136379 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbe040-7ed7-4f4f-b719-32cc25a78317 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:52:33.145883 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 727/1462] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:52:35.385551 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad74ad-6fe6-4af2-8232-c0d53cb84239 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:35.386389 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad74ad-6fe6-4af2-8232-c0d53cb84239 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:35.386389 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad74ad-6fe6-4af2-8232-c0d53cb84239 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:35.389078 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 736/1463] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 20:52:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:35.394834 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ab7e2-7614-4528-97c1-23b95a1717cb None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:35.395275 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ab7e2-7614-4528-97c1-23b95a1717cb None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:35.395375 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ab7e2-7614-4528-97c1-23b95a1717cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:35.419732 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-071ab7e2-7614-4528-97c1-23b95a1717cb None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:35.420904 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-071ab7e2-7614-4528-97c1-23b95a1717cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:35.429982 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 728/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 20:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:52:35.470091 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad74ad-6fe6-4af2-8232-c0d53cb84239 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:52:35.488426 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad74ad-6fe6-4af2-8232-c0d53cb84239 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:52:35.493018 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d662e9-5044-4324-a599-35f82791d48d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:52:35.493690 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d662e9-5044-4324-a599-35f82791d48d service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:35.493965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d662e9-5044-4324-a599-35f82791d48d service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:35.494229 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d662e9-5044-4324-a599-35f82791d48d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:35.503725 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d662e9-5044-4324-a599-35f82791d48d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:52:35.505137 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d662e9-5044-4324-a599-35f82791d48d service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:52:35.514238 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 737/1465] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:52:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:52:37.699290 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0912b2-b681-4f42-ba39-fe97ec6646bf None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:37.699964 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0912b2-b681-4f42-ba39-fe97ec6646bf None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:37.699964 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0912b2-b681-4f42-ba39-fe97ec6646bf None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:37.701641 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 729/1466] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 20:52:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:37.708145 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edcce7-b5a2-4912-b741-d6156e9676e3 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:37.708611 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edcce7-b5a2-4912-b741-d6156e9676e3 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:37.708749 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edcce7-b5a2-4912-b741-d6156e9676e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:37.727785 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-65edcce7-b5a2-4912-b741-d6156e9676e3 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:37.728998 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-65edcce7-b5a2-4912-b741-d6156e9676e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:37.738652 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 738/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 20:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:52:37.787487 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0912b2-b681-4f42-ba39-fe97ec6646bf None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:52:37.798919 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0912b2-b681-4f42-ba39-fe97ec6646bf None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:52:37.803021 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e687a39-35c7-45d4-b48d-2f4bfd3f4d69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:52:37.803643 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e687a39-35c7-45d4-b48d-2f4bfd3f4d69 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:37.803919 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e687a39-35c7-45d4-b48d-2f4bfd3f4d69 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:37.804183 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e687a39-35c7-45d4-b48d-2f4bfd3f4d69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:37.813739 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e687a39-35c7-45d4-b48d-2f4bfd3f4d69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:52:37.815149 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e687a39-35c7-45d4-b48d-2f4bfd3f4d69 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:52:37.824482 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 730/1468] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:52:40.031128 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0ce94-d9e4-4dbe-b41d-4fb358f647c5 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:40.031706 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0ce94-d9e4-4dbe-b41d-4fb358f647c5 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:40.031706 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0ce94-d9e4-4dbe-b41d-4fb358f647c5 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:40.034494 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 739/1469] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 20:52:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:40.040943 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfd112-e202-427a-b015-fb0a15837597 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:40.041312 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfd112-e202-427a-b015-fb0a15837597 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:40.041518 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfd112-e202-427a-b015-fb0a15837597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:40.060016 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7abfd112-e202-427a-b015-fb0a15837597 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:40.061244 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7abfd112-e202-427a-b015-fb0a15837597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:40.069943 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 731/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 20:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:52:40.106084 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0ce94-d9e4-4dbe-b41d-4fb358f647c5 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:52:40.119573 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0ce94-d9e4-4dbe-b41d-4fb358f647c5 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:52:40.124809 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ae210-9937-4e8d-a33f-43bad2f19d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:52:40.125466 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ae210-9937-4e8d-a33f-43bad2f19d53 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:40.125741 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ae210-9937-4e8d-a33f-43bad2f19d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:40.126005 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ae210-9937-4e8d-a33f-43bad2f19d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:40.136051 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ae210-9937-4e8d-a33f-43bad2f19d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:52:40.137512 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ae210-9937-4e8d-a33f-43bad2f19d53 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:52:40.146904 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 740/1471] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:52:56.274076 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01132c0d-bab2-4e3d-8ca5-6cf00e4456dd None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:56.275065 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01132c0d-bab2-4e3d-8ca5-6cf00e4456dd None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:56.275065 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01132c0d-bab2-4e3d-8ca5-6cf00e4456dd None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:56.277790 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 732/1472] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:52:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:56.286634 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91572fb8-e453-4a8a-956d-87c49d9a651b None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:56.287082 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91572fb8-e453-4a8a-956d-87c49d9a651b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:56.287295 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91572fb8-e453-4a8a-956d-87c49d9a651b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:56.313607 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-91572fb8-e453-4a8a-956d-87c49d9a651b None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:56.314802 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-91572fb8-e453-4a8a-956d-87c49d9a651b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:56.324504 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 741/1473] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:52:56.377616 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e3d36-d495-4b9e-adb1-b283a640a9c9 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:56.378334 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e3d36-d495-4b9e-adb1-b283a640a9c9 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:56.378608 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e3d36-d495-4b9e-adb1-b283a640a9c9 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:56.380394 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 733/1474] 10.222.0.31 () {54 vars in 962 bytes} [Thu Feb 10 20:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:56.385344 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec730db-a380-43a0-81f6-dc6bd26f093d None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:56.385660 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec730db-a380-43a0-81f6-dc6bd26f093d None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:56.385934 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec730db-a380-43a0-81f6-dc6bd26f093d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:56.404637 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-5ec730db-a380-43a0-81f6-dc6bd26f093d None None] MFA Rules not processed for user `256860d94eb142c6b2175ae89f977e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:56.405858 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-5ec730db-a380-43a0-81f6-dc6bd26f093d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:56.413579 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 742/1475] 10.222.0.31 () {58 vars in 1059 bytes} [Thu Feb 10 20:52:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:52:56.420833 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e3d36-d495-4b9e-adb1-b283a640a9c9 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:52:56.432944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e3d36-d495-4b9e-adb1-b283a640a9c9 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:52:56.437052 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5015978-af5c-489f-a229-c698594cbdba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '256860d94eb142c6b2175ae89f977e4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:52:56.437721 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5015978-af5c-489f-a229-c698594cbdba service glance] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:56.438002 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5015978-af5c-489f-a229-c698594cbdba service glance] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:56.438267 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5015978-af5c-489f-a229-c698594cbdba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:56.447753 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5015978-af5c-489f-a229-c698594cbdba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:52:56.449160 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5015978-af5c-489f-a229-c698594cbdba service glance] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:52:56.458637 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 734/1476] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:52:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:52:58.757928 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1bc69-bf13-4ce1-bec0-c59c684a1aec None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:58.758812 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1bc69-bf13-4ce1-bec0-c59c684a1aec None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:58.758812 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1bc69-bf13-4ce1-bec0-c59c684a1aec None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:58.761883 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 743/1477] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:52:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:52:58.771015 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781d760-538f-4263-bf36-7f876cef50d2 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:58.771784 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781d760-538f-4263-bf36-7f876cef50d2 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:58.772001 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781d760-538f-4263-bf36-7f876cef50d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:58.792105 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7781d760-538f-4263-bf36-7f876cef50d2 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:52:58.793385 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7781d760-538f-4263-bf36-7f876cef50d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:52:58.803357 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 735/1478] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:52:58.827341 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1bc69-bf13-4ce1-bec0-c59c684a1aec None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:52:58.848279 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1bc69-bf13-4ce1-bec0-c59c684a1aec None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:52:58.854585 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3a12a-b904-44ad-acc3-50f62cb12e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:52:58.855234 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3a12a-b904-44ad-acc3-50f62cb12e34 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:52:58.855515 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3a12a-b904-44ad-acc3-50f62cb12e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:52:58.855785 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3a12a-b904-44ad-acc3-50f62cb12e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:52:58.856527 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3a12a-b904-44ad-acc3-50f62cb12e34 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:52:58.858425 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3a12a-b904-44ad-acc3-50f62cb12e34 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:52:58.872191 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 744/1479] 10.222.0.31 () {56 vars in 1108 bytes} [Thu Feb 10 20:52:58 2022] GET /identity/v3/projects => generated 2553 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:53:01.110408 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dce06e-eef2-419c-9f2d-51c7276f3139 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:53:01.111292 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dce06e-eef2-419c-9f2d-51c7276f3139 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:53:01.111292 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dce06e-eef2-419c-9f2d-51c7276f3139 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:53:01.114214 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 736/1480] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:53:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:53:01.120573 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0640d-8828-4a69-9436-2c0ebc8676f6 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:53:01.121376 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0640d-8828-4a69-9436-2c0ebc8676f6 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:53:01.121549 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0640d-8828-4a69-9436-2c0ebc8676f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:53:01.145568 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-a1b0640d-8828-4a69-9436-2c0ebc8676f6 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:53:01.146771 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-a1b0640d-8828-4a69-9436-2c0ebc8676f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:53:01.155981 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 745/1481] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:53:01.197801 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dce06e-eef2-419c-9f2d-51c7276f3139 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:53:01.216760 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dce06e-eef2-419c-9f2d-51c7276f3139 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:53:01.224152 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba0fc2-c82b-4dbd-8d8c-d4934a02cbb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:53:01.224775 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba0fc2-c82b-4dbd-8d8c-d4934a02cbb0 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:53:01.225049 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba0fc2-c82b-4dbd-8d8c-d4934a02cbb0 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:53:01.225318 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba0fc2-c82b-4dbd-8d8c-d4934a02cbb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:53:01.234346 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba0fc2-c82b-4dbd-8d8c-d4934a02cbb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:53:01.235920 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba0fc2-c82b-4dbd-8d8c-d4934a02cbb0 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:53:01.245735 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 737/1482] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:53:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:53:03.605414 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320177a-d25e-4070-85a9-6ae3ef0eb83f None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:53:03.605999 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320177a-d25e-4070-85a9-6ae3ef0eb83f None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:53:03.605999 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320177a-d25e-4070-85a9-6ae3ef0eb83f None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:53:03.607989 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 746/1483] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:53:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:53:03.613562 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ce428-7082-447b-b6ea-a2d83048ea67 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:53:03.614046 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ce428-7082-447b-b6ea-a2d83048ea67 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:53:03.614141 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ce428-7082-447b-b6ea-a2d83048ea67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:53:03.633241 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-1f9ce428-7082-447b-b6ea-a2d83048ea67 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:53:03.634463 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1f9ce428-7082-447b-b6ea-a2d83048ea67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:53:03.643064 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 738/1484] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:53:03.678305 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320177a-d25e-4070-85a9-6ae3ef0eb83f None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:53:03.689114 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320177a-d25e-4070-85a9-6ae3ef0eb83f None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:53:03.692714 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c987bc6-5aff-4863-90fd-c9b00e4fb60c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:53:03.693337 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c987bc6-5aff-4863-90fd-c9b00e4fb60c service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:53:03.693641 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c987bc6-5aff-4863-90fd-c9b00e4fb60c service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:53:03.693907 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c987bc6-5aff-4863-90fd-c9b00e4fb60c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:53:03.703363 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c987bc6-5aff-4863-90fd-c9b00e4fb60c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:53:03.704781 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c987bc6-5aff-4863-90fd-c9b00e4fb60c service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:53:03.714157 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 747/1485] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:53:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:53:05.942776 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801deb2-4b1c-45a6-8b52-a7c5c2cae91a None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:53:05.943607 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801deb2-4b1c-45a6-8b52-a7c5c2cae91a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:53:05.943607 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801deb2-4b1c-45a6-8b52-a7c5c2cae91a None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:53:05.946380 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 739/1486] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:53:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:53:05.955418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e9eec-6fb3-4559-9277-0f95fbd6ee04 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:53:05.955830 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e9eec-6fb3-4559-9277-0f95fbd6ee04 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:53:05.956028 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e9eec-6fb3-4559-9277-0f95fbd6ee04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:53:05.977046 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-de0e9eec-6fb3-4559-9277-0f95fbd6ee04 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:53:05.978292 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-de0e9eec-6fb3-4559-9277-0f95fbd6ee04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:53:05.986622 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 748/1487] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:53:06.024402 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801deb2-4b1c-45a6-8b52-a7c5c2cae91a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:53:06.037158 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801deb2-4b1c-45a6-8b52-a7c5c2cae91a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:53:06.043308 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76415e0-8259-48b2-b652-0c8309b773e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:53:06.044236 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76415e0-8259-48b2-b652-0c8309b773e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:53:06.044572 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76415e0-8259-48b2-b652-0c8309b773e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:53:06.044861 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76415e0-8259-48b2-b652-0c8309b773e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:53:06.059181 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76415e0-8259-48b2-b652-0c8309b773e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:53:06.060645 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76415e0-8259-48b2-b652-0c8309b773e9 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:53:06.070171 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 740/1488] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:53:08.442550 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c7c3a-af08-4cf1-8df1-6d2b1d808ff1 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:53:08.443146 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c7c3a-af08-4cf1-8df1-6d2b1d808ff1 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:53:08.443146 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c7c3a-af08-4cf1-8df1-6d2b1d808ff1 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:53:08.445116 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 749/1489] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:53:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:53:08.450843 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca31feb-e696-4246-91ab-bcb94184aa6c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:53:08.451399 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca31feb-e696-4246-91ab-bcb94184aa6c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:53:08.451399 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca31feb-e696-4246-91ab-bcb94184aa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:53:08.470924 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-2ca31feb-e696-4246-91ab-bcb94184aa6c None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:53:08.472136 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2ca31feb-e696-4246-91ab-bcb94184aa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:53:08.480972 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 741/1490] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:53:08.522347 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c7c3a-af08-4cf1-8df1-6d2b1d808ff1 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:53:08.535174 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c7c3a-af08-4cf1-8df1-6d2b1d808ff1 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:53:08.543789 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b450db-4cb7-41d2-aaaf-0086916dfa05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:53:08.544289 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b450db-4cb7-41d2-aaaf-0086916dfa05 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:53:08.544567 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b450db-4cb7-41d2-aaaf-0086916dfa05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:53:08.544830 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b450db-4cb7-41d2-aaaf-0086916dfa05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:53:08.555572 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b450db-4cb7-41d2-aaaf-0086916dfa05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:53:08.557038 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b450db-4cb7-41d2-aaaf-0086916dfa05 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:53:08.568124 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 750/1491] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:53:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:53:10.946241 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35e612-ac38-490c-8df9-aeac10019300 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:53:10.947174 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35e612-ac38-490c-8df9-aeac10019300 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:53:10.947174 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35e612-ac38-490c-8df9-aeac10019300 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:53:10.949845 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 742/1492] 10.222.0.31 () {54 vars in 926 bytes} [Thu Feb 10 20:53:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:53:10.957473 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f8422-82e0-4c1b-80d9-cdcc7cd57f43 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:53:10.957916 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f8422-82e0-4c1b-80d9-cdcc7cd57f43 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:53:10.958017 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f8422-82e0-4c1b-80d9-cdcc7cd57f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:53:10.977413 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-654f8422-82e0-4c1b-80d9-cdcc7cd57f43 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:53:10.978610 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-654f8422-82e0-4c1b-80d9-cdcc7cd57f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:53:10.988152 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 751/1493] 10.222.0.31 () {58 vars in 1023 bytes} [Thu Feb 10 20:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:53:11.028630 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35e612-ac38-490c-8df9-aeac10019300 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:53:11.040548 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35e612-ac38-490c-8df9-aeac10019300 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:53:11.044740 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff9034-5ad9-46c6-b3f1-2726cdadeb7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:53:11.045407 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff9034-5ad9-46c6-b3f1-2726cdadeb7d service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:53:11.045666 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff9034-5ad9-46c6-b3f1-2726cdadeb7d service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:53:11.045932 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff9034-5ad9-46c6-b3f1-2726cdadeb7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:53:11.055545 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff9034-5ad9-46c6-b3f1-2726cdadeb7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:53:11.056964 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff9034-5ad9-46c6-b3f1-2726cdadeb7d service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:53:11.066786 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 743/1494] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:54:29.569091 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d0f2b-3041-4cc5-a315-80fad9b218b8 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:54:29.569698 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d0f2b-3041-4cc5-a315-80fad9b218b8 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:54:29.569698 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d0f2b-3041-4cc5-a315-80fad9b218b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:54:29.589595 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-4c5d0f2b-3041-4cc5-a315-80fad9b218b8 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:54:29.590785 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4c5d0f2b-3041-4cc5-a315-80fad9b218b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:54:29.599887 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 752/1495] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:54:29.607975 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e2737-7775-4aec-8fa4-09fec74b8468 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:54:29.608469 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e2737-7775-4aec-8fa4-09fec74b8468 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:54:29.608469 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e2737-7775-4aec-8fa4-09fec74b8468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:54:29.628038 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-754e2737-7775-4aec-8fa4-09fec74b8468 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:54:29.629212 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-754e2737-7775-4aec-8fa4-09fec74b8468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:54:29.639065 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 744/1496] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:54:29.643855 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d0f2b-3041-4cc5-a315-80fad9b218b8 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:54:29.654030 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d0f2b-3041-4cc5-a315-80fad9b218b8 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:54:29.660089 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602b807-f822-4415-a777-47e8c52ec0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:54:29.660738 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602b807-f822-4415-a777-47e8c52ec0cf admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:54:29.661048 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602b807-f822-4415-a777-47e8c52ec0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:54:29.661287 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602b807-f822-4415-a777-47e8c52ec0cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:54:29.662069 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602b807-f822-4415-a777-47e8c52ec0cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:54:29.662364 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602b807-f822-4415-a777-47e8c52ec0cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:54:29.664568 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602b807-f822-4415-a777-47e8c52ec0cf admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:54:29.681996 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 753/1497] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:54:29.691084 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e2737-7775-4aec-8fa4-09fec74b8468 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:54:29.706683 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e2737-7775-4aec-8fa4-09fec74b8468 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:54:29.716225 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b2026-38a8-4a27-a0c4-dbe471fb8619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:54:29.717232 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b2026-38a8-4a27-a0c4-dbe471fb8619 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:54:29.717713 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b2026-38a8-4a27-a0c4-dbe471fb8619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:54:29.718144 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b2026-38a8-4a27-a0c4-dbe471fb8619 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:54:29.719267 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b2026-38a8-4a27-a0c4-dbe471fb8619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:54:29.722276 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b2026-38a8-4a27-a0c4-dbe471fb8619 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:54:29.766555 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 745/1498] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:54:29 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:54:29.771558 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602b807-f822-4415-a777-47e8c52ec0cf admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:54:29.785648 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602b807-f822-4415-a777-47e8c52ec0cf admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:54:29.839128 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ea7a7-dc90-4159-95d8-d82733c346ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:54:29.839703 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ea7a7-dc90-4159-95d8-d82733c346ed admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:54:29.839972 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ea7a7-dc90-4159-95d8-d82733c346ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:54:29.840234 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ea7a7-dc90-4159-95d8-d82733c346ed admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:54:29.840908 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ea7a7-dc90-4159-95d8-d82733c346ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:54:29.842804 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ea7a7-dc90-4159-95d8-d82733c346ed admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:54:29.864537 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 754/1499] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:54:29 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:54:29.868960 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b2026-38a8-4a27-a0c4-dbe471fb8619 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:54:29.879144 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b2026-38a8-4a27-a0c4-dbe471fb8619 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:54:29.884530 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242eed0-809d-4b97-8c30-9f86ee0036d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:54:29.885185 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242eed0-809d-4b97-8c30-9f86ee0036d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:54:29.885501 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242eed0-809d-4b97-8c30-9f86ee0036d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:54:29.885763 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242eed0-809d-4b97-8c30-9f86ee0036d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:54:29.886618 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242eed0-809d-4b97-8c30-9f86ee0036d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:54:29.888223 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242eed0-809d-4b97-8c30-9f86ee0036d2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:54:29.900993 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 746/1500] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 20:54:29.904898 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ea7a7-dc90-4159-95d8-d82733c346ed admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:54:29.914503 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ea7a7-dc90-4159-95d8-d82733c346ed admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:54:29.921474 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91671fc-9129-4185-a026-9bca2e9b2b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:54:29.922121 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91671fc-9129-4185-a026-9bca2e9b2b38 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:54:29.922418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91671fc-9129-4185-a026-9bca2e9b2b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:54:29.922686 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91671fc-9129-4185-a026-9bca2e9b2b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:54:29.923430 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91671fc-9129-4185-a026-9bca2e9b2b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:54:29.925120 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91671fc-9129-4185-a026-9bca2e9b2b38 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:54:29.938854 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 755/1501] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:54:29.943121 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242eed0-809d-4b97-8c30-9f86ee0036d2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:54:29.953326 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242eed0-809d-4b97-8c30-9f86ee0036d2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:54:29.960493 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c4c05-76ac-4883-bc67-4a040041bbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:54:29.961369 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c4c05-76ac-4883-bc67-4a040041bbdc admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:54:29.961669 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c4c05-76ac-4883-bc67-4a040041bbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:54:29.961922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c4c05-76ac-4883-bc67-4a040041bbdc admin admin] PATH_INFO: `/v3/projects/e49c93c5178d448db2e7fddd46247e9f/users/d86eef8e299a431d9816da8df37206d9/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:54:29.978509 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c4c05-76ac-4883-bc67-4a040041bbdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e49c93c5178d448db2e7fddd46247e9f, user_id=d86eef8e299a431d9816da8df37206d9, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:54:29.981130 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c4c05-76ac-4883-bc67-4a040041bbdc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:54:29.995862 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 747/1502] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:54:29 2022] PUT /identity/v3/projects/e49c93c5178d448db2e7fddd46247e9f/users/d86eef8e299a431d9816da8df37206d9/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:54:30.008207 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9af34d-5467-4d06-8c94-6f0b64b82ef0 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:54:30.008509 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9af34d-5467-4d06-8c94-6f0b64b82ef0 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:54:30.008745 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9af34d-5467-4d06-8c94-6f0b64b82ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:54:30.036965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-1f9af34d-5467-4d06-8c94-6f0b64b82ef0 None None] MFA Rules not processed for user `d86eef8e299a431d9816da8df37206d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:54:30.038248 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-1f9af34d-5467-4d06-8c94-6f0b64b82ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:54:30.105539 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 756/1503] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:54:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:54:30.117041 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c4c05-76ac-4883-bc67-4a040041bbdc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:54:30.191713 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c4c05-76ac-4883-bc67-4a040041bbdc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:54:30.198710 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98676a9-70a3-453a-a6c3-61ff9b314552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:54:30.199345 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98676a9-70a3-453a-a6c3-61ff9b314552 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:54:30.199621 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98676a9-70a3-453a-a6c3-61ff9b314552 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:54:30.199890 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98676a9-70a3-453a-a6c3-61ff9b314552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:54:30.207917 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98676a9-70a3-453a-a6c3-61ff9b314552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:54:30.209535 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98676a9-70a3-453a-a6c3-61ff9b314552 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:54:30.218487 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 748/1504] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:54:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:54:30.300974 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bb823-c767-4dd6-a9ae-3eefd40e3f1d None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:54:30.301344 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bb823-c767-4dd6-a9ae-3eefd40e3f1d None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:54:30.301657 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bb823-c767-4dd6-a9ae-3eefd40e3f1d None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:54:30.303410 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 757/1505] 10.222.0.31 () {52 vars in 829 bytes} [Thu Feb 10 20:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:54:30.307055 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98676a9-70a3-453a-a6c3-61ff9b314552 service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:54:30.367781 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98676a9-70a3-453a-a6c3-61ff9b314552 service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:54:30.372722 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f273aea-2406-47a9-8dc3-54dc0c99252c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:54:30.373613 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f273aea-2406-47a9-8dc3-54dc0c99252c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:54:30.373888 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f273aea-2406-47a9-8dc3-54dc0c99252c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:54:30.374143 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f273aea-2406-47a9-8dc3-54dc0c99252c admin admin] PATH_INFO: `/v3/users/d86eef8e299a431d9816da8df37206d9` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:54:30.375420 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f273aea-2406-47a9-8dc3-54dc0c99252c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d86eef8e299a431d9816da8df37206d9)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:54:30.376455 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-4f273aea-2406-47a9-8dc3-54dc0c99252c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:54:30.376455 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Feb 10 20:54:30.376455 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: Feb 10 20:54:30.377699 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f273aea-2406-47a9-8dc3-54dc0c99252c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:54:30.446080 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4f273aea-2406-47a9-8dc3-54dc0c99252c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd86eef8e299a431d9816da8df37206d9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:54:30.458159 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4f273aea-2406-47a9-8dc3-54dc0c99252c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd86eef8e299a431d9816da8df37206d9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:54:30.477266 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4f273aea-2406-47a9-8dc3-54dc0c99252c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd86eef8e299a431d9816da8df37206d9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:54:30.478233 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4f273aea-2406-47a9-8dc3-54dc0c99252c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd86eef8e299a431d9816da8df37206d9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:54:30.487778 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4f273aea-2406-47a9-8dc3-54dc0c99252c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd86eef8e299a431d9816da8df37206d9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:54:30.494058 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 749/1506] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:54:30 2022] DELETE /identity/v3/users/d86eef8e299a431d9816da8df37206d9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:54:30.498789 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88983436-01d2-416e-915d-486013e1aebe None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:54:30.499121 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88983436-01d2-416e-915d-486013e1aebe None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:54:30.499396 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88983436-01d2-416e-915d-486013e1aebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:54:30.517720 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-88983436-01d2-416e-915d-486013e1aebe None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:54:30.518895 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-88983436-01d2-416e-915d-486013e1aebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:54:30.579200 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 758/1507] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:54:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:54:30.589776 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f273aea-2406-47a9-8dc3-54dc0c99252c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:54:30.591314 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4f273aea-2406-47a9-8dc3-54dc0c99252c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:54:30.647558 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f273aea-2406-47a9-8dc3-54dc0c99252c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:54:30.653232 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc2ae4-4c95-4be2-b11e-7e75d3441db2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:54:30.654185 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc2ae4-4c95-4be2-b11e-7e75d3441db2 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:54:30.654549 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc2ae4-4c95-4be2-b11e-7e75d3441db2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:54:30.654892 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc2ae4-4c95-4be2-b11e-7e75d3441db2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:54:30.664770 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc2ae4-4c95-4be2-b11e-7e75d3441db2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:54:30.666235 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc2ae4-4c95-4be2-b11e-7e75d3441db2 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:54:30.675621 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 750/1508] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:54:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:54:31.041048 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88983436-01d2-416e-915d-486013e1aebe None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:54:31.042652 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-88983436-01d2-416e-915d-486013e1aebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:54:31.057040 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88983436-01d2-416e-915d-486013e1aebe None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:54:31.062151 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc035dab-5b99-46db-ba83-99a6c26158fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:54:31.063012 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc035dab-5b99-46db-ba83-99a6c26158fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:54:31.063289 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc035dab-5b99-46db-ba83-99a6c26158fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:54:31.063557 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc035dab-5b99-46db-ba83-99a6c26158fd admin admin] PATH_INFO: `/v3/projects/e49c93c5178d448db2e7fddd46247e9f` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:54:31.064756 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc035dab-5b99-46db-ba83-99a6c26158fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e49c93c5178d448db2e7fddd46247e9f)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:54:31.065850 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING py.warnings [None req-cc035dab-5b99-46db-ba83-99a6c26158fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:54:31.065850 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: warnings.warn(msg) Feb 10 20:54:31.065850 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: Feb 10 20:54:31.067065 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc035dab-5b99-46db-ba83-99a6c26158fd admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:54:31.125103 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-cc035dab-5b99-46db-ba83-99a6c26158fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e49c93c5178d448db2e7fddd46247e9f', 'request_id': 'req-cc035dab-5b99-46db-ba83-99a6c26158fd'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:54:31.130855 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-cc035dab-5b99-46db-ba83-99a6c26158fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e49c93c5178d448db2e7fddd46247e9f', 'request_id': 'req-cc035dab-5b99-46db-ba83-99a6c26158fd'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:54:31.143967 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-cc035dab-5b99-46db-ba83-99a6c26158fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e49c93c5178d448db2e7fddd46247e9f', 'request_id': 'req-cc035dab-5b99-46db-ba83-99a6c26158fd'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:54:31.163119 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-cc035dab-5b99-46db-ba83-99a6c26158fd admin admin] The token cache is being invalidate because project e49c93c5178d448db2e7fddd46247e9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:54:31.163338 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-cc035dab-5b99-46db-ba83-99a6c26158fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:54:31.164121 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-cc035dab-5b99-46db-ba83-99a6c26158fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:54:31.165751 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 759/1509] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:54:31 2022] DELETE /identity/v3/projects/e49c93c5178d448db2e7fddd46247e9f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:56:01.484774 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d857c40-958e-4f08-a073-83d62a14a7ed None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:01.485416 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d857c40-958e-4f08-a073-83d62a14a7ed None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:01.485416 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d857c40-958e-4f08-a073-83d62a14a7ed None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:01.487385 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 751/1510] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 20:56:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:56:01.492420 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ac3b0-21bb-4cb3-8862-b466a9ff02d2 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:01.492911 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ac3b0-21bb-4cb3-8862-b466a9ff02d2 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:01.493016 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ac3b0-21bb-4cb3-8862-b466a9ff02d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:01.511891 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-678ac3b0-21bb-4cb3-8862-b466a9ff02d2 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:56:01.513073 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-678ac3b0-21bb-4cb3-8862-b466a9ff02d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:56:01.574086 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 760/1511] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 20:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:56:01.728721 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d857c40-958e-4f08-a073-83d62a14a7ed None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:56:01.731988 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9d857c40-958e-4f08-a073-83d62a14a7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:56:01.813815 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d857c40-958e-4f08-a073-83d62a14a7ed None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:56:01.821503 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cc5cf-d8a7-4349-8aa7-a8d2c76bf57a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:56:01.822175 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cc5cf-d8a7-4349-8aa7-a8d2c76bf57a service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:01.822452 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cc5cf-d8a7-4349-8aa7-a8d2c76bf57a service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:01.822692 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cc5cf-d8a7-4349-8aa7-a8d2c76bf57a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:01.832057 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cc5cf-d8a7-4349-8aa7-a8d2c76bf57a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:56:01.834573 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cc5cf-d8a7-4349-8aa7-a8d2c76bf57a service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:56:01.848735 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 752/1512] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:56:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:56:02.049475 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b8b30-5f2c-4d50-b4fc-aa39a11ee276 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:02.049711 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b8b30-5f2c-4d50-b4fc-aa39a11ee276 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:02.049962 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b8b30-5f2c-4d50-b4fc-aa39a11ee276 None None] PATH_INFO: `/v3` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:02.051390 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 761/1513] 10.222.0.42 () {54 vars in 925 bytes} [Thu Feb 10 20:56:02 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:56:02.058427 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb48702-a8a6-4bc9-ba85-88950d799aac None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:02.058714 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb48702-a8a6-4bc9-ba85-88950d799aac None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:02.058984 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb48702-a8a6-4bc9-ba85-88950d799aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:02.078398 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-deb48702-a8a6-4bc9-ba85-88950d799aac None None] MFA Rules not processed for user `9f05eb88abe24af4825259712b497d48`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:56:02.079569 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-deb48702-a8a6-4bc9-ba85-88950d799aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:56:02.142129 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 753/1514] 10.222.0.42 () {58 vars in 1015 bytes} [Thu Feb 10 20:56:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:56:03.129440 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e15339-0b77-4d46-bc79-1a46c5cd4e9f None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:03.129895 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e15339-0b77-4d46-bc79-1a46c5cd4e9f None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:03.130007 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e15339-0b77-4d46-bc79-1a46c5cd4e9f None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:03.131763 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 762/1515] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 20:56:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:56:03.137132 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf644e7-ef03-4e14-aef6-729593b6ede5 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:03.137645 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf644e7-ef03-4e14-aef6-729593b6ede5 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:03.137755 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf644e7-ef03-4e14-aef6-729593b6ede5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:03.156996 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-cbf644e7-ef03-4e14-aef6-729593b6ede5 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:56:03.158212 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-cbf644e7-ef03-4e14-aef6-729593b6ede5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:56:03.167202 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 754/1516] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 20:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:56:03.322236 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e15339-0b77-4d46-bc79-1a46c5cd4e9f None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:56:03.342035 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e15339-0b77-4d46-bc79-1a46c5cd4e9f None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:56:03.347904 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df8da8-fdcd-451f-a292-e2b7dd2f8b6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:56:03.348513 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df8da8-fdcd-451f-a292-e2b7dd2f8b6c service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:03.348783 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df8da8-fdcd-451f-a292-e2b7dd2f8b6c service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:03.349049 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df8da8-fdcd-451f-a292-e2b7dd2f8b6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:03.358668 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df8da8-fdcd-451f-a292-e2b7dd2f8b6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:56:03.360278 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df8da8-fdcd-451f-a292-e2b7dd2f8b6c service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:56:03.371036 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 763/1517] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:56:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:56:06.016623 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc2fef-ac58-42bb-9cd0-853f2c56526d None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:06.017249 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc2fef-ac58-42bb-9cd0-853f2c56526d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:06.017249 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc2fef-ac58-42bb-9cd0-853f2c56526d None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:06.019146 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 755/1518] 10.222.0.31 () {54 vars in 960 bytes} [Thu Feb 10 20:56:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:56:06.024658 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1514072-05d8-491c-8559-93f7d17d2d11 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:06.025102 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1514072-05d8-491c-8559-93f7d17d2d11 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:06.025203 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1514072-05d8-491c-8559-93f7d17d2d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:06.044236 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-f1514072-05d8-491c-8559-93f7d17d2d11 None None] MFA Rules not processed for user `9f05eb88abe24af4825259712b497d48`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:56:06.045551 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-f1514072-05d8-491c-8559-93f7d17d2d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:56:06.054677 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 764/1519] 10.222.0.31 () {58 vars in 1057 bytes} [Thu Feb 10 20:56:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:56:06.062253 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc2fef-ac58-42bb-9cd0-853f2c56526d None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:56:06.076217 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc2fef-ac58-42bb-9cd0-853f2c56526d None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:56:06.082260 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fb335-b718-47ad-8d6c-11a0f2b9bc6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f05eb88abe24af4825259712b497d48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:56:06.082912 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fb335-b718-47ad-8d6c-11a0f2b9bc6d service placement] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:06.083211 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fb335-b718-47ad-8d6c-11a0f2b9bc6d service placement] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:06.083483 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fb335-b718-47ad-8d6c-11a0f2b9bc6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:06.092016 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fb335-b718-47ad-8d6c-11a0f2b9bc6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:56:06.093644 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fb335-b718-47ad-8d6c-11a0f2b9bc6d service placement] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:56:06.103116 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 756/1520] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:56:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:56:15.109099 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45967bf2-a048-4e01-b1fa-d7e5125190dd None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:15.109773 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45967bf2-a048-4e01-b1fa-d7e5125190dd None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:15.109773 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45967bf2-a048-4e01-b1fa-d7e5125190dd None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:15.111498 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 765/1521] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 20:56:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:56:15.117559 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4a8a1-82a7-4ad5-8903-8733100ac71a None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:15.117956 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4a8a1-82a7-4ad5-8903-8733100ac71a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:15.118060 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4a8a1-82a7-4ad5-8903-8733100ac71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:15.139530 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-4ce4a8a1-82a7-4ad5-8903-8733100ac71a None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:56:15.140714 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4ce4a8a1-82a7-4ad5-8903-8733100ac71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:56:15.149155 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 757/1522] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 20:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:56:15.303851 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45967bf2-a048-4e01-b1fa-d7e5125190dd None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:56:15.321011 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45967bf2-a048-4e01-b1fa-d7e5125190dd None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:56:15.327481 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a50174-6d3f-4c8e-afed-f480f4b54ecf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:56:15.328123 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a50174-6d3f-4c8e-afed-f480f4b54ecf service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:15.328401 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a50174-6d3f-4c8e-afed-f480f4b54ecf service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:15.328674 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a50174-6d3f-4c8e-afed-f480f4b54ecf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:15.337553 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a50174-6d3f-4c8e-afed-f480f4b54ecf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:56:15.339140 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a50174-6d3f-4c8e-afed-f480f4b54ecf service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:56:15.348825 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 766/1523] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:56:16.624352 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bf7bd-7b3b-44be-805a-5b43b02180a2 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:16.624948 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bf7bd-7b3b-44be-805a-5b43b02180a2 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:16.624948 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bf7bd-7b3b-44be-805a-5b43b02180a2 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:16.626704 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 758/1524] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 20:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:56:16.632716 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eff31f-d34a-415b-8c50-a2717fa10372 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:16.633485 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eff31f-d34a-415b-8c50-a2717fa10372 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:16.633807 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eff31f-d34a-415b-8c50-a2717fa10372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:16.653809 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-c7eff31f-d34a-415b-8c50-a2717fa10372 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:56:16.655032 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-c7eff31f-d34a-415b-8c50-a2717fa10372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:56:16.663253 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 767/1525] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 20:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:56:16.818831 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bf7bd-7b3b-44be-805a-5b43b02180a2 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:56:16.838803 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bf7bd-7b3b-44be-805a-5b43b02180a2 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:56:16.844790 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6d6b1-8697-4789-9cbe-0327effdcf9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:56:16.845460 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6d6b1-8697-4789-9cbe-0327effdcf9b service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:16.845765 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6d6b1-8697-4789-9cbe-0327effdcf9b service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:16.846041 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6d6b1-8697-4789-9cbe-0327effdcf9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:16.854711 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6d6b1-8697-4789-9cbe-0327effdcf9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:56:16.856298 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6d6b1-8697-4789-9cbe-0327effdcf9b service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:56:16.873098 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 759/1526] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:56:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:56:20.929511 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed457788-d293-45f8-8e49-f0acbf842690 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:20.930135 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed457788-d293-45f8-8e49-f0acbf842690 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:20.930135 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed457788-d293-45f8-8e49-f0acbf842690 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:20.932913 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 768/1527] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 20:56:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:56:20.942067 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5895d8-975a-45f6-85dd-b39c0bbd7857 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:20.942497 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5895d8-975a-45f6-85dd-b39c0bbd7857 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:20.942631 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5895d8-975a-45f6-85dd-b39c0bbd7857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:20.968930 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-2d5895d8-975a-45f6-85dd-b39c0bbd7857 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:56:20.970145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2d5895d8-975a-45f6-85dd-b39c0bbd7857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:56:20.979486 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 760/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 20:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:56:21.018867 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed457788-d293-45f8-8e49-f0acbf842690 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:56:21.020643 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ed457788-d293-45f8-8e49-f0acbf842690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:56:21.081342 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed457788-d293-45f8-8e49-f0acbf842690 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:56:21.085828 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3f52d-442a-4b24-986f-87638b80f98b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:56:21.086469 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3f52d-442a-4b24-986f-87638b80f98b service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:21.086743 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3f52d-442a-4b24-986f-87638b80f98b service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:21.087012 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3f52d-442a-4b24-986f-87638b80f98b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:21.097197 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3f52d-442a-4b24-986f-87638b80f98b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:56:21.098663 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3f52d-442a-4b24-986f-87638b80f98b service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:56:21.108483 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 769/1529] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:56:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:56:23.272759 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a9e37-641b-4213-b20b-c111b1457c50 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:23.273641 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a9e37-641b-4213-b20b-c111b1457c50 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:23.273841 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a9e37-641b-4213-b20b-c111b1457c50 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:23.276610 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 761/1530] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 20:56:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:56:23.289283 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570088a-2746-4deb-9314-7d2d20a0a1d1 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:23.290020 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570088a-2746-4deb-9314-7d2d20a0a1d1 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:23.290240 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570088a-2746-4deb-9314-7d2d20a0a1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:23.317276 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-4570088a-2746-4deb-9314-7d2d20a0a1d1 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:56:23.318620 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4570088a-2746-4deb-9314-7d2d20a0a1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:56:23.327684 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 770/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 20:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:56:23.368836 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a9e37-641b-4213-b20b-c111b1457c50 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:56:23.384893 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a9e37-641b-4213-b20b-c111b1457c50 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:56:23.389087 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc715e-3c41-4a29-96a2-4e05acb3987b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:56:23.389759 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc715e-3c41-4a29-96a2-4e05acb3987b service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:23.390036 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc715e-3c41-4a29-96a2-4e05acb3987b service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:23.390298 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc715e-3c41-4a29-96a2-4e05acb3987b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:23.399961 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc715e-3c41-4a29-96a2-4e05acb3987b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:56:23.401472 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc715e-3c41-4a29-96a2-4e05acb3987b service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:56:23.410854 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 762/1532] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:56:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:56:27.178720 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d3bff-87a0-4cd8-85f0-c29f0c45f327 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:27.179256 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d3bff-87a0-4cd8-85f0-c29f0c45f327 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:27.179256 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d3bff-87a0-4cd8-85f0-c29f0c45f327 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:27.181080 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 771/1533] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 20:56:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:56:27.187027 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0bfd4-8fd7-4001-9c29-977da48cd1f6 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:27.187477 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0bfd4-8fd7-4001-9c29-977da48cd1f6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:27.187579 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0bfd4-8fd7-4001-9c29-977da48cd1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:27.207402 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7ea0bfd4-8fd7-4001-9c29-977da48cd1f6 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:56:27.208606 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7ea0bfd4-8fd7-4001-9c29-977da48cd1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:56:27.217095 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 763/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 20:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:56:27.469339 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d3bff-87a0-4cd8-85f0-c29f0c45f327 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:56:27.471605 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b71d3bff-87a0-4cd8-85f0-c29f0c45f327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:56:27.536812 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d3bff-87a0-4cd8-85f0-c29f0c45f327 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:56:27.541045 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb36dc3-09f0-42d6-87c0-ae1a3dcd2276 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:56:27.541757 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb36dc3-09f0-42d6-87c0-ae1a3dcd2276 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:27.542036 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb36dc3-09f0-42d6-87c0-ae1a3dcd2276 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:27.542303 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb36dc3-09f0-42d6-87c0-ae1a3dcd2276 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:27.555971 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb36dc3-09f0-42d6-87c0-ae1a3dcd2276 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:56:27.557409 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb36dc3-09f0-42d6-87c0-ae1a3dcd2276 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:56:27.566790 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 772/1535] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:56:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:56:29.836106 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7af082-f53e-40e6-bf93-b05343d60f7e None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:29.836899 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7af082-f53e-40e6-bf93-b05343d60f7e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:29.836899 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7af082-f53e-40e6-bf93-b05343d60f7e None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:29.839795 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 764/1536] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 20:56:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:56:29.846349 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55baa25f-30f8-4bf6-b244-f04a9e36f7d5 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:29.847035 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55baa25f-30f8-4bf6-b244-f04a9e36f7d5 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:29.847224 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55baa25f-30f8-4bf6-b244-f04a9e36f7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:29.872586 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-55baa25f-30f8-4bf6-b244-f04a9e36f7d5 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:56:29.873821 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-55baa25f-30f8-4bf6-b244-f04a9e36f7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:56:29.882054 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 773/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 20:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:56:30.132741 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b1628-a8ee-4831-9a75-5e1d4fcbd1e8 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:30.132960 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b1628-a8ee-4831-9a75-5e1d4fcbd1e8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:30.133209 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b1628-a8ee-4831-9a75-5e1d4fcbd1e8 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:30.135035 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 765/1538] 10.222.0.31 () {54 vars in 963 bytes} [Thu Feb 10 20:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:56:30.142744 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0e789-e812-41f7-8ca4-e1dbbf6de860 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:30.143115 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0e789-e812-41f7-8ca4-e1dbbf6de860 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:30.143413 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0e789-e812-41f7-8ca4-e1dbbf6de860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:30.169290 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-d6c0e789-e812-41f7-8ca4-e1dbbf6de860 None None] MFA Rules not processed for user `ce66e520f6f84eab9e85c81022a0c743`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:56:30.170491 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d6c0e789-e812-41f7-8ca4-e1dbbf6de860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:56:30.177998 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 774/1539] 10.222.0.31 () {58 vars in 1060 bytes} [Thu Feb 10 20:56:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:56:30.185829 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b1628-a8ee-4831-9a75-5e1d4fcbd1e8 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:56:30.197965 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b1628-a8ee-4831-9a75-5e1d4fcbd1e8 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:56:30.205212 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb61be-6805-45ed-ad0e-58eed801f288 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:56:30.205869 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb61be-6805-45ed-ad0e-58eed801f288 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:56:30.206150 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb61be-6805-45ed-ad0e-58eed801f288 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:56:30.206416 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb61be-6805-45ed-ad0e-58eed801f288 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:56:30.215517 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb61be-6805-45ed-ad0e-58eed801f288 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:56:30.216943 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb61be-6805-45ed-ad0e-58eed801f288 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:56:30.226557 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 766/1540] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:56:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:57:54.579208 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851449a9-a120-4713-908f-2a87d614f142 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:54.579849 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851449a9-a120-4713-908f-2a87d614f142 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:54.579849 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851449a9-a120-4713-908f-2a87d614f142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:54.602773 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-851449a9-a120-4713-908f-2a87d614f142 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:54.603993 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-851449a9-a120-4713-908f-2a87d614f142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:54.608494 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbea86e-7c6d-4897-9b57-cae20772f9e4 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:54.609016 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbea86e-7c6d-4897-9b57-cae20772f9e4 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:54.609016 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbea86e-7c6d-4897-9b57-cae20772f9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:54.633581 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 775/1541] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:54.634931 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec5766-bb0e-41a3-87ac-aaf9846f4698 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:54.635215 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec5766-bb0e-41a3-87ac-aaf9846f4698 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:54.635487 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec5766-bb0e-41a3-87ac-aaf9846f4698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:54.645023 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-1fbea86e-7c6d-4897-9b57-cae20772f9e4 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:54.646258 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1fbea86e-7c6d-4897-9b57-cae20772f9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:54.675043 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 767/1542] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:57:54.676387 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac26258-65f2-474e-90da-cf21d36ebdc0 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:54.676670 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac26258-65f2-474e-90da-cf21d36ebdc0 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:54.676944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac26258-65f2-474e-90da-cf21d36ebdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:54.686033 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-faec5766-bb0e-41a3-87ac-aaf9846f4698 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:54.687304 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-faec5766-bb0e-41a3-87ac-aaf9846f4698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:54.712930 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 776/1543] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:54.716214 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff913117-dfab-42b6-a973-18cd796809e1 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:54.716466 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff913117-dfab-42b6-a973-18cd796809e1 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:54.716745 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff913117-dfab-42b6-a973-18cd796809e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:54.726760 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-9ac26258-65f2-474e-90da-cf21d36ebdc0 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:54.727983 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9ac26258-65f2-474e-90da-cf21d36ebdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:54.746891 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 768/1544] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:54.748201 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a517a0-1b2a-4848-8889-6afa61e7e43b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:54.748483 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a517a0-1b2a-4848-8889-6afa61e7e43b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:54.748751 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a517a0-1b2a-4848-8889-6afa61e7e43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:54.760903 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-ff913117-dfab-42b6-a973-18cd796809e1 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:54.768522 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ff913117-dfab-42b6-a973-18cd796809e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:54.783593 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 777/1545] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:54.784447 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff913117-dfab-42b6-a973-18cd796809e1 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:54.791967 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-11a517a0-1b2a-4848-8889-6afa61e7e43b None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:54.793211 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-11a517a0-1b2a-4848-8889-6afa61e7e43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:54.804841 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff913117-dfab-42b6-a973-18cd796809e1 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:54.809646 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 769/1546] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:54.813653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7fbb5-b0e7-4051-88c7-4efa539ed0ff None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:54.813944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7fbb5-b0e7-4051-88c7-4efa539ed0ff None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:54.815376 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cfcec-01ca-41e1-9c93-7e6b539f15cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:54.816042 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cfcec-01ca-41e1-9c93-7e6b539f15cc admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:54.816315 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cfcec-01ca-41e1-9c93-7e6b539f15cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:54.816722 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7fbb5-b0e7-4051-88c7-4efa539ed0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:54.818667 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cfcec-01ca-41e1-9c93-7e6b539f15cc admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:54.819418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082cfcec-01ca-41e1-9c93-7e6b539f15cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:57:54.819724 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082cfcec-01ca-41e1-9c93-7e6b539f15cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:54.821436 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082cfcec-01ca-41e1-9c93-7e6b539f15cc admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:54.841694 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7be7fbb5-b0e7-4051-88c7-4efa539ed0ff None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:54.841694 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7be7fbb5-b0e7-4051-88c7-4efa539ed0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:54.843409 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 778/1547] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:57:54.844799 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cfcec-01ca-41e1-9c93-7e6b539f15cc admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:54.850392 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 770/1548] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:54.851689 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c26f7-eef1-4931-bcef-8646292037e5 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:54.852019 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c26f7-eef1-4931-bcef-8646292037e5 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:54.852290 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c26f7-eef1-4931-bcef-8646292037e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:54.862145 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cfcec-01ca-41e1-9c93-7e6b539f15cc admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:54.868217 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5edc5-d045-40a4-809e-55381fb107c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:54.869456 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5edc5-d045-40a4-809e-55381fb107c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:54.870144 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5edc5-d045-40a4-809e-55381fb107c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:54.870636 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5edc5-d045-40a4-809e-55381fb107c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:54.871614 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5edc5-d045-40a4-809e-55381fb107c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:57:54.872133 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5edc5-d045-40a4-809e-55381fb107c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:54.874333 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5edc5-d045-40a4-809e-55381fb107c6 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:54.874698 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-c75c26f7-eef1-4931-bcef-8646292037e5 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:54.875952 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c75c26f7-eef1-4931-bcef-8646292037e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:54.889608 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 771/1549] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:54.890597 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c26f7-eef1-4931-bcef-8646292037e5 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:54.891045 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 779/1550] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:57:54.892664 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576728a-de11-47b4-8769-0fe685fdbbc2 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:54.893167 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576728a-de11-47b4-8769-0fe685fdbbc2 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:54.893686 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576728a-de11-47b4-8769-0fe685fdbbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:54.900706 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c26f7-eef1-4931-bcef-8646292037e5 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:54.909846 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515cba3-95cf-4387-aedc-088e2e4ccb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:54.910509 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515cba3-95cf-4387-aedc-088e2e4ccb86 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:54.910789 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515cba3-95cf-4387-aedc-088e2e4ccb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:54.911059 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515cba3-95cf-4387-aedc-088e2e4ccb86 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:54.911804 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515cba3-95cf-4387-aedc-088e2e4ccb86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:57:54.912137 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515cba3-95cf-4387-aedc-088e2e4ccb86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:54.913791 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515cba3-95cf-4387-aedc-088e2e4ccb86 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:54.914160 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-c576728a-de11-47b4-8769-0fe685fdbbc2 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:54.915393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-c576728a-de11-47b4-8769-0fe685fdbbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:54.923652 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 780/1551] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:54.924514 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576728a-de11-47b4-8769-0fe685fdbbc2 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:54.929449 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 772/1552] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:57:54.929449 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5a414-7eb8-453d-adcf-64c8156b0672 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:54.929449 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5a414-7eb8-453d-adcf-64c8156b0672 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:54.929449 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5a414-7eb8-453d-adcf-64c8156b0672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:54.934385 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576728a-de11-47b4-8769-0fe685fdbbc2 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:54.939700 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf10a22-e8e9-4642-976b-ae7419ba457a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:54.940355 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf10a22-e8e9-4642-976b-ae7419ba457a admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:54.940630 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf10a22-e8e9-4642-976b-ae7419ba457a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:54.940896 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf10a22-e8e9-4642-976b-ae7419ba457a admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:54.941631 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf10a22-e8e9-4642-976b-ae7419ba457a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:54.943528 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf10a22-e8e9-4642-976b-ae7419ba457a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:54.946756 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-11c5a414-7eb8-453d-adcf-64c8156b0672 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:54.947923 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-11c5a414-7eb8-453d-adcf-64c8156b0672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:54.955735 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 773/1553] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:54.956800 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28b167-a4b2-4df3-b212-7e5b960468a8 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:54.957077 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28b167-a4b2-4df3-b212-7e5b960468a8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:54.957371 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28b167-a4b2-4df3-b212-7e5b960468a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:54.970296 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 781/1554] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:57:54 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:57:54.971061 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf10a22-e8e9-4642-976b-ae7419ba457a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:54.975962 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-2e28b167-a4b2-4df3-b212-7e5b960468a8 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:54.977201 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2e28b167-a4b2-4df3-b212-7e5b960468a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:55.028314 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf10a22-e8e9-4642-976b-ae7419ba457a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.032851 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a3266-5f3b-45dd-b7fe-bd988047a041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.033613 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a3266-5f3b-45dd-b7fe-bd988047a041 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.033882 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 774/1555] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:55.034013 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a3266-5f3b-45dd-b7fe-bd988047a041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.034333 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a3266-5f3b-45dd-b7fe-bd988047a041 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.035085 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a3266-5f3b-45dd-b7fe-bd988047a041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.035419 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdfe90-67db-4098-bbdd-d41317067fce None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.035795 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdfe90-67db-4098-bbdd-d41317067fce None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.036128 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdfe90-67db-4098-bbdd-d41317067fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.037274 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a3266-5f3b-45dd-b7fe-bd988047a041 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.054254 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e3fdfe90-67db-4098-bbdd-d41317067fce None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:55.055335 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e3fdfe90-67db-4098-bbdd-d41317067fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:55.063186 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 775/1556] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:55.064386 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5417c-a357-41a0-b9ea-6f2f9abdb2f8 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.064667 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5417c-a357-41a0-b9ea-6f2f9abdb2f8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.064935 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5417c-a357-41a0-b9ea-6f2f9abdb2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.070978 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 782/1557] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:57:54 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:57:55.073595 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9261c4-1890-44ff-9a66-b9dd4d285299 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.074456 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9261c4-1890-44ff-9a66-b9dd4d285299 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.074578 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9261c4-1890-44ff-9a66-b9dd4d285299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.085713 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-0cf5417c-a357-41a0-b9ea-6f2f9abdb2f8 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:55.086976 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0cf5417c-a357-41a0-b9ea-6f2f9abdb2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:55.095654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-ea9261c4-1890-44ff-9a66-b9dd4d285299 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:55.096845 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ea9261c4-1890-44ff-9a66-b9dd4d285299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:55.145343 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 776/1558] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:55.146407 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5417c-a357-41a0-b9ea-6f2f9abdb2f8 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.155674 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5417c-a357-41a0-b9ea-6f2f9abdb2f8 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.158843 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 783/1559] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:55.159714 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9261c4-1890-44ff-9a66-b9dd4d285299 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.160245 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e9d70-6c82-4165-86d9-d34c1b71dccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.160836 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e9d70-6c82-4165-86d9-d34c1b71dccd admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.161112 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e9d70-6c82-4165-86d9-d34c1b71dccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.161405 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e9d70-6c82-4165-86d9-d34c1b71dccd admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.162102 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e9d70-6c82-4165-86d9-d34c1b71dccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.164065 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e9d70-6c82-4165-86d9-d34c1b71dccd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.169315 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9261c4-1890-44ff-9a66-b9dd4d285299 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.175042 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7144f-4f1c-4adf-aabf-fe9e2cf7b507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.175693 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7144f-4f1c-4adf-aabf-fe9e2cf7b507 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.175965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7144f-4f1c-4adf-aabf-fe9e2cf7b507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.176355 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7144f-4f1c-4adf-aabf-fe9e2cf7b507 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.177083 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7144f-4f1c-4adf-aabf-fe9e2cf7b507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:57:55.177408 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7144f-4f1c-4adf-aabf-fe9e2cf7b507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.179074 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7144f-4f1c-4adf-aabf-fe9e2cf7b507 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.190880 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 777/1560] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:57:55 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:57:55.198277 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 784/1561] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:57:55.198277 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7144f-4f1c-4adf-aabf-fe9e2cf7b507 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.198519 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e9d70-6c82-4165-86d9-d34c1b71dccd admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.201339 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7144f-4f1c-4adf-aabf-fe9e2cf7b507 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.254072 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34b894-a922-4439-ba70-574322d88935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.254747 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34b894-a922-4439-ba70-574322d88935 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.255025 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34b894-a922-4439-ba70-574322d88935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.255295 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34b894-a922-4439-ba70-574322d88935 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.255999 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34b894-a922-4439-ba70-574322d88935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.257967 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34b894-a922-4439-ba70-574322d88935 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.259460 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e9d70-6c82-4165-86d9-d34c1b71dccd admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.264246 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8b621-74a8-46a6-b1fd-e863c869a34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.264915 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8b621-74a8-46a6-b1fd-e863c869a34b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.265193 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8b621-74a8-46a6-b1fd-e863c869a34b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.265606 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8b621-74a8-46a6-b1fd-e863c869a34b admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.266333 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8b621-74a8-46a6-b1fd-e863c869a34b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:57:55.266635 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8b621-74a8-46a6-b1fd-e863c869a34b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.268495 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8b621-74a8-46a6-b1fd-e863c869a34b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.280954 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 785/1562] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:57:55 2022] POST /identity/v3/users => generated 293 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:57:55.280954 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b4fd5-e3cc-4ac6-a612-c248c62c51fe None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.280954 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b4fd5-e3cc-4ac6-a612-c248c62c51fe None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.280954 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b4fd5-e3cc-4ac6-a612-c248c62c51fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.281447 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 778/1563] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:57:55.282477 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8b621-74a8-46a6-b1fd-e863c869a34b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.293279 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8b621-74a8-46a6-b1fd-e863c869a34b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.298665 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-7a1b4fd5-e3cc-4ac6-a612-c248c62c51fe None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:55.299103 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a9052-a5dd-43c7-8a19-9a854a75df1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.299791 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a9052-a5dd-43c7-8a19-9a854a75df1a admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.299974 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-7a1b4fd5-e3cc-4ac6-a612-c248c62c51fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:55.300071 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a9052-a5dd-43c7-8a19-9a854a75df1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.300326 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a9052-a5dd-43c7-8a19-9a854a75df1a admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.301050 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a9052-a5dd-43c7-8a19-9a854a75df1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.303067 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a9052-a5dd-43c7-8a19-9a854a75df1a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.308062 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 786/1564] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:55.309421 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecaae03-32e1-4e8c-b01f-c1919e0a28b3 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.309900 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecaae03-32e1-4e8c-b01f-c1919e0a28b3 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.310181 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecaae03-32e1-4e8c-b01f-c1919e0a28b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.326399 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 779/1565] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:57:55 2022] POST /identity/v3/users => generated 291 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:57:55.328038 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a9052-a5dd-43c7-8a19-9a854a75df1a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.335609 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-cecaae03-32e1-4e8c-b01f-c1919e0a28b3 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:55.336833 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-cecaae03-32e1-4e8c-b01f-c1919e0a28b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:55.338740 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a9052-a5dd-43c7-8a19-9a854a75df1a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.343233 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195fd12-68b7-477f-aacd-1668fdb5611c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.343860 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195fd12-68b7-477f-aacd-1668fdb5611c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.344139 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195fd12-68b7-477f-aacd-1668fdb5611c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.344403 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195fd12-68b7-477f-aacd-1668fdb5611c admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.345119 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195fd12-68b7-477f-aacd-1668fdb5611c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:57:55.345243 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 787/1566] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:55.345446 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195fd12-68b7-477f-aacd-1668fdb5611c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.347044 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195fd12-68b7-477f-aacd-1668fdb5611c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.349433 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecaae03-32e1-4e8c-b01f-c1919e0a28b3 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.358481 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecaae03-32e1-4e8c-b01f-c1919e0a28b3 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.366143 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 780/1567] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:57:55.366143 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195fd12-68b7-477f-aacd-1668fdb5611c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.369015 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195fd12-68b7-477f-aacd-1668fdb5611c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.370538 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178325ce-476e-4782-a58c-f9ec491d07dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.371233 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178325ce-476e-4782-a58c-f9ec491d07dd admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.371549 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178325ce-476e-4782-a58c-f9ec491d07dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.371801 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178325ce-476e-4782-a58c-f9ec491d07dd admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.372618 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178325ce-476e-4782-a58c-f9ec491d07dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.373895 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c6f52-bc82-47f6-9506-40ebf1d9a668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.374505 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c6f52-bc82-47f6-9506-40ebf1d9a668 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.374615 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178325ce-476e-4782-a58c-f9ec491d07dd admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.374783 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c6f52-bc82-47f6-9506-40ebf1d9a668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.375053 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c6f52-bc82-47f6-9506-40ebf1d9a668 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.375729 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c6f52-bc82-47f6-9506-40ebf1d9a668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.377598 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c6f52-bc82-47f6-9506-40ebf1d9a668 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.395152 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 788/1568] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:57:55 2022] POST /identity/v3/users => generated 289 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:57:55.395958 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178325ce-476e-4782-a58c-f9ec491d07dd admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.405786 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178325ce-476e-4782-a58c-f9ec491d07dd admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.410031 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 781/1569] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:57:55 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:57:55.410031 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c6f52-bc82-47f6-9506-40ebf1d9a668 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.468106 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266a33c-0f0b-49eb-b34c-b043aaf92ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.468759 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c6f52-bc82-47f6-9506-40ebf1d9a668 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.468879 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266a33c-0f0b-49eb-b34c-b043aaf92ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.469035 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266a33c-0f0b-49eb-b34c-b043aaf92ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.469299 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266a33c-0f0b-49eb-b34c-b043aaf92ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.470060 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266a33c-0f0b-49eb-b34c-b043aaf92ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.471683 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266a33c-0f0b-49eb-b34c-b043aaf92ae8 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.473216 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d4117-dc44-4d03-8085-0aa83476cf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.473894 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d4117-dc44-4d03-8085-0aa83476cf6c admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.474167 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d4117-dc44-4d03-8085-0aa83476cf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.474432 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d4117-dc44-4d03-8085-0aa83476cf6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.475103 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d4117-dc44-4d03-8085-0aa83476cf6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.477026 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d4117-dc44-4d03-8085-0aa83476cf6c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.482087 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 789/1570] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:57:55.482087 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266a33c-0f0b-49eb-b34c-b043aaf92ae8 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.491438 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266a33c-0f0b-49eb-b34c-b043aaf92ae8 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.496602 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2301ba8-22c7-47af-ba68-46807838802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.497282 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2301ba8-22c7-47af-ba68-46807838802e admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.497562 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2301ba8-22c7-47af-ba68-46807838802e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.497833 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2301ba8-22c7-47af-ba68-46807838802e admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.498552 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2301ba8-22c7-47af-ba68-46807838802e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:57:55.498861 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2301ba8-22c7-47af-ba68-46807838802e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.500436 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2301ba8-22c7-47af-ba68-46807838802e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.503692 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 782/1571] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:57:55 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:57:55.504637 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d4117-dc44-4d03-8085-0aa83476cf6c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.519161 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 790/1572] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:57:55.519161 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2301ba8-22c7-47af-ba68-46807838802e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.528703 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2301ba8-22c7-47af-ba68-46807838802e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.569415 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d4117-dc44-4d03-8085-0aa83476cf6c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.574163 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad103a-2696-4948-8aaf-7f7e35596311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.574831 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad103a-2696-4948-8aaf-7f7e35596311 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.575118 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad103a-2696-4948-8aaf-7f7e35596311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.575398 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad103a-2696-4948-8aaf-7f7e35596311 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.576130 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad103a-2696-4948-8aaf-7f7e35596311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.577789 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad103a-2696-4948-8aaf-7f7e35596311 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.586478 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9102e02-992e-4fdd-ad7f-c45cec602b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.587139 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9102e02-992e-4fdd-ad7f-c45cec602b2d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.590314 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9102e02-992e-4fdd-ad7f-c45cec602b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.590459 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 783/1573] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:57:55.590568 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9102e02-992e-4fdd-ad7f-c45cec602b2d admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.590568 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9102e02-992e-4fdd-ad7f-c45cec602b2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:57:55.590735 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad103a-2696-4948-8aaf-7f7e35596311 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.590824 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9102e02-992e-4fdd-ad7f-c45cec602b2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.590824 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9102e02-992e-4fdd-ad7f-c45cec602b2d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.598987 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad103a-2696-4948-8aaf-7f7e35596311 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.605376 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 791/1574] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:57:55.605376 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9102e02-992e-4fdd-ad7f-c45cec602b2d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.607356 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8eba19-b6b1-4dff-95d4-b883ffb7ce96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.607992 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8eba19-b6b1-4dff-95d4-b883ffb7ce96 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.608633 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8eba19-b6b1-4dff-95d4-b883ffb7ce96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.609227 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8eba19-b6b1-4dff-95d4-b883ffb7ce96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.609625 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8eba19-b6b1-4dff-95d4-b883ffb7ce96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.611506 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8eba19-b6b1-4dff-95d4-b883ffb7ce96 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.614321 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9102e02-992e-4fdd-ad7f-c45cec602b2d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.619091 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ce757-d742-43c9-aac3-9e04dc299c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.619713 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ce757-d742-43c9-aac3-9e04dc299c3a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.620006 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ce757-d742-43c9-aac3-9e04dc299c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.620268 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ce757-d742-43c9-aac3-9e04dc299c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.620992 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ce757-d742-43c9-aac3-9e04dc299c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.622623 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ce757-d742-43c9-aac3-9e04dc299c3a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.634477 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 792/1575] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:57:55.635255 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ce757-d742-43c9-aac3-9e04dc299c3a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.642025 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 784/1576] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:57:55 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:57:55.643115 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8eba19-b6b1-4dff-95d4-b883ffb7ce96 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.644790 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ce757-d742-43c9-aac3-9e04dc299c3a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.698835 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b129e-e62c-4610-911a-344d35d29fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.699508 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b129e-e62c-4610-911a-344d35d29fbc admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.699786 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b129e-e62c-4610-911a-344d35d29fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.700093 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b129e-e62c-4610-911a-344d35d29fbc admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.700793 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b129e-e62c-4610-911a-344d35d29fbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.702821 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b129e-e62c-4610-911a-344d35d29fbc admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.702933 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8eba19-b6b1-4dff-95d4-b883ffb7ce96 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.707338 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e45a3-7eb2-47ee-9edf-5bc7ada9c9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.708034 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e45a3-7eb2-47ee-9edf-5bc7ada9c9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.708311 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e45a3-7eb2-47ee-9edf-5bc7ada9c9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.708575 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e45a3-7eb2-47ee-9edf-5bc7ada9c9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.709300 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e45a3-7eb2-47ee-9edf-5bc7ada9c9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.710919 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e45a3-7eb2-47ee-9edf-5bc7ada9c9b4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.726113 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 785/1577] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:57:55.726113 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e45a3-7eb2-47ee-9edf-5bc7ada9c9b4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.726412 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 793/1578] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:57:55 2022] POST /identity/v3/users => generated 295 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:57:55.726412 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b129e-e62c-4610-911a-344d35d29fbc admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.734516 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b129e-e62c-4610-911a-344d35d29fbc admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.735970 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e45a3-7eb2-47ee-9edf-5bc7ada9c9b4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.739400 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7029cbf-b952-4de8-9a2d-0381b14ff7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.740042 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7029cbf-b952-4de8-9a2d-0381b14ff7d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.740321 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7029cbf-b952-4de8-9a2d-0381b14ff7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.740513 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b877b-5e02-42e8-b925-020bd3b3cc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.740674 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7029cbf-b952-4de8-9a2d-0381b14ff7d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.741148 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b877b-5e02-42e8-b925-020bd3b3cc6d admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.741418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7029cbf-b952-4de8-9a2d-0381b14ff7d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.741534 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b877b-5e02-42e8-b925-020bd3b3cc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.741698 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b877b-5e02-42e8-b925-020bd3b3cc6d admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.742373 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b877b-5e02-42e8-b925-020bd3b3cc6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.743420 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7029cbf-b952-4de8-9a2d-0381b14ff7d1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.744296 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b877b-5e02-42e8-b925-020bd3b3cc6d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.764952 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 786/1579] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:57:55 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:57:55.765795 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b877b-5e02-42e8-b925-020bd3b3cc6d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.768708 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 794/1580] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:57:55 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:57:55.769523 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7029cbf-b952-4de8-9a2d-0381b14ff7d1 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.778334 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b877b-5e02-42e8-b925-020bd3b3cc6d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.828772 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7029cbf-b952-4de8-9a2d-0381b14ff7d1 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.833272 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2d256-ac7e-45e5-ae9d-3a221ff780ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.833461 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb8a6b-9e87-49ce-bc05-4c70ba598b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.833950 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2d256-ac7e-45e5-ae9d-3a221ff780ab admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.834061 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb8a6b-9e87-49ce-bc05-4c70ba598b25 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.834242 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2d256-ac7e-45e5-ae9d-3a221ff780ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.834355 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb8a6b-9e87-49ce-bc05-4c70ba598b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.834493 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2d256-ac7e-45e5-ae9d-3a221ff780ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.834587 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb8a6b-9e87-49ce-bc05-4c70ba598b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.835179 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2d256-ac7e-45e5-ae9d-3a221ff780ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.835287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb8a6b-9e87-49ce-bc05-4c70ba598b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.836934 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb8a6b-9e87-49ce-bc05-4c70ba598b25 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.837174 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2d256-ac7e-45e5-ae9d-3a221ff780ab admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.846432 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 787/1581] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:57:55.847206 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb8a6b-9e87-49ce-bc05-4c70ba598b25 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.856195 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb8a6b-9e87-49ce-bc05-4c70ba598b25 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.860870 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3961f0-f33d-48cf-8145-6c7ef9eb9e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.861519 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3961f0-f33d-48cf-8145-6c7ef9eb9e9b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.861800 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3961f0-f33d-48cf-8145-6c7ef9eb9e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.862065 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3961f0-f33d-48cf-8145-6c7ef9eb9e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.862783 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3961f0-f33d-48cf-8145-6c7ef9eb9e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.864348 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3961f0-f33d-48cf-8145-6c7ef9eb9e9b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.870425 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 795/1582] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:57:55 2022] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:57:55.870425 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2d256-ac7e-45e5-ae9d-3a221ff780ab admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.874244 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 788/1583] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:57:55.874997 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3961f0-f33d-48cf-8145-6c7ef9eb9e9b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.883976 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3961f0-f33d-48cf-8145-6c7ef9eb9e9b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.932574 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2d256-ac7e-45e5-ae9d-3a221ff780ab admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.937787 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba185c2-5d21-43fb-b0d2-40b2a734bbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.938303 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cc0d2-0f76-4a42-94a4-39cff6bc35b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:55.938471 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba185c2-5d21-43fb-b0d2-40b2a734bbd3 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.938760 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba185c2-5d21-43fb-b0d2-40b2a734bbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.939025 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba185c2-5d21-43fb-b0d2-40b2a734bbd3 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.939170 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cc0d2-0f76-4a42-94a4-39cff6bc35b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:55.939440 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cc0d2-0f76-4a42-94a4-39cff6bc35b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:55.939702 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cc0d2-0f76-4a42-94a4-39cff6bc35b9 admin admin] PATH_INFO: `/v3/projects/f8a1aecb2fbd45cbb03e4cb2c7555e4a/users/ad654c90e73c45578f77bf89c2a08423/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:55.939857 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba185c2-5d21-43fb-b0d2-40b2a734bbd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.941745 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba185c2-5d21-43fb-b0d2-40b2a734bbd3 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.955054 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503cc0d2-0f76-4a42-94a4-39cff6bc35b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a1aecb2fbd45cbb03e4cb2c7555e4a, user_id=ad654c90e73c45578f77bf89c2a08423, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:55.958311 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503cc0d2-0f76-4a42-94a4-39cff6bc35b9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:55.961735 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 796/1584] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:57:55 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:57:55.962540 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba185c2-5d21-43fb-b0d2-40b2a734bbd3 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:55.971767 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba185c2-5d21-43fb-b0d2-40b2a734bbd3 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:55.972887 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 789/1585] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:57:55 2022] PUT /identity/v3/projects/f8a1aecb2fbd45cbb03e4cb2c7555e4a/users/ad654c90e73c45578f77bf89c2a08423/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:57:55.981596 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cc0d2-0f76-4a42-94a4-39cff6bc35b9 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:56.035161 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d6a61-e4dc-428d-8a01-ff0d4a8f1a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:56.035832 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d6a61-e4dc-428d-8a01-ff0d4a8f1a58 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.036111 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d6a61-e4dc-428d-8a01-ff0d4a8f1a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.036393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d6a61-e4dc-428d-8a01-ff0d4a8f1a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.037150 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d6a61-e4dc-428d-8a01-ff0d4a8f1a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:56.038810 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d6a61-e4dc-428d-8a01-ff0d4a8f1a58 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:56.045575 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cc0d2-0f76-4a42-94a4-39cff6bc35b9 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:56.051719 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 797/1586] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:57:56.051719 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d6a61-e4dc-428d-8a01-ff0d4a8f1a58 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:56.052727 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa73263-af59-4e4b-8c31-c167d4130f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:56.053425 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa73263-af59-4e4b-8c31-c167d4130f27 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.053712 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa73263-af59-4e4b-8c31-c167d4130f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.053982 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa73263-af59-4e4b-8c31-c167d4130f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.054723 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa73263-af59-4e4b-8c31-c167d4130f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:56.056372 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa73263-af59-4e4b-8c31-c167d4130f27 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:56.060857 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d6a61-e4dc-428d-8a01-ff0d4a8f1a58 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:56.065226 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e146cb-41df-4ebd-a6b9-0f9ffe7f6a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:56.065875 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e146cb-41df-4ebd-a6b9-0f9ffe7f6a2f admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.066151 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e146cb-41df-4ebd-a6b9-0f9ffe7f6a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.069239 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 790/1587] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:57:56.069403 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e146cb-41df-4ebd-a6b9-0f9ffe7f6a2f admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.069403 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e146cb-41df-4ebd-a6b9-0f9ffe7f6a2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:56.069609 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa73263-af59-4e4b-8c31-c167d4130f27 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:56.069709 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e146cb-41df-4ebd-a6b9-0f9ffe7f6a2f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:56.077809 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa73263-af59-4e4b-8c31-c167d4130f27 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:56.083343 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726902a-c1cb-4408-813a-9b7ab8533adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:56.084472 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726902a-c1cb-4408-813a-9b7ab8533adf admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.084753 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726902a-c1cb-4408-813a-9b7ab8533adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.085032 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726902a-c1cb-4408-813a-9b7ab8533adf admin admin] PATH_INFO: `/v3/projects/dc9c4e9b959f41f8abf61cb364de3df1/users/90e1e089c82b493bba4324948b5c5f82/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.093008 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 798/1588] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:57:56 2022] POST /identity/v3/users => generated 283 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:57:56.093008 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e146cb-41df-4ebd-a6b9-0f9ffe7f6a2f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:56.099617 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726902a-c1cb-4408-813a-9b7ab8533adf admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc9c4e9b959f41f8abf61cb364de3df1, user_id=90e1e089c82b493bba4324948b5c5f82, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:56.102359 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726902a-c1cb-4408-813a-9b7ab8533adf admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:56.102679 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e146cb-41df-4ebd-a6b9-0f9ffe7f6a2f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:56.107487 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267f05f-cbb8-4ebe-b6a4-866d58631c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:56.108131 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267f05f-cbb8-4ebe-b6a4-866d58631c69 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.108409 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267f05f-cbb8-4ebe-b6a4-866d58631c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.108671 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267f05f-cbb8-4ebe-b6a4-866d58631c69 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.109398 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267f05f-cbb8-4ebe-b6a4-866d58631c69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:56.111251 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267f05f-cbb8-4ebe-b6a4-866d58631c69 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:56.115447 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 791/1589] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:57:56 2022] PUT /identity/v3/projects/dc9c4e9b959f41f8abf61cb364de3df1/users/90e1e089c82b493bba4324948b5c5f82/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:57:56.116294 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726902a-c1cb-4408-813a-9b7ab8533adf admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:56.138092 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 799/1590] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:57:56 2022] POST /identity/v3/users => generated 297 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:57:56.139113 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267f05f-cbb8-4ebe-b6a4-866d58631c69 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:56.149172 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267f05f-cbb8-4ebe-b6a4-866d58631c69 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:56.190081 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726902a-c1cb-4408-813a-9b7ab8533adf admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:56.194941 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3711f96-de96-4865-8a04-6ff84a948f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:56.195902 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3711f96-de96-4865-8a04-6ff84a948f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.196197 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3711f96-de96-4865-8a04-6ff84a948f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.196472 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3711f96-de96-4865-8a04-6ff84a948f92 admin admin] PATH_INFO: `/v3/projects/cb01f8cda0e14466a64d43cb40867c5c/users/d6a6f1ee4ac24e0481c4ee1bf8ddf897/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.206189 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59f5fa-07b6-4a0e-8b11-c46a8239eece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:56.206853 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59f5fa-07b6-4a0e-8b11-c46a8239eece admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.207133 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59f5fa-07b6-4a0e-8b11-c46a8239eece admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.207404 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59f5fa-07b6-4a0e-8b11-c46a8239eece admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.208129 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59f5fa-07b6-4a0e-8b11-c46a8239eece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:56.209778 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59f5fa-07b6-4a0e-8b11-c46a8239eece admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:56.210401 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3711f96-de96-4865-8a04-6ff84a948f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb01f8cda0e14466a64d43cb40867c5c, user_id=d6a6f1ee4ac24e0481c4ee1bf8ddf897, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:56.213057 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3711f96-de96-4865-8a04-6ff84a948f92 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:56.219536 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 800/1591] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:57:56.220928 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c33e66-4140-41d3-bd0d-9414dbbf7fe5 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.221214 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c33e66-4140-41d3-bd0d-9414dbbf7fe5 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.221517 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c33e66-4140-41d3-bd0d-9414dbbf7fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.227277 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 792/1592] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:57:56 2022] PUT /identity/v3/projects/cb01f8cda0e14466a64d43cb40867c5c/users/d6a6f1ee4ac24e0481c4ee1bf8ddf897/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:57:56.228561 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3711f96-de96-4865-8a04-6ff84a948f92 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:56.247032 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-e2c33e66-4140-41d3-bd0d-9414dbbf7fe5 None None] MFA Rules not processed for user `ad654c90e73c45578f77bf89c2a08423`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:56.248247 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-e2c33e66-4140-41d3-bd0d-9414dbbf7fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:56.284464 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3711f96-de96-4865-8a04-6ff84a948f92 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:56.289235 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c09270-a4f9-4779-956c-6f261324bf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:56.289955 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c09270-a4f9-4779-956c-6f261324bf8e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.290227 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c09270-a4f9-4779-956c-6f261324bf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.290495 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c09270-a4f9-4779-956c-6f261324bf8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.291229 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c09270-a4f9-4779-956c-6f261324bf8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:56.292849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c09270-a4f9-4779-956c-6f261324bf8e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:56.302852 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 793/1593] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:57:56.306290 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c09270-a4f9-4779-956c-6f261324bf8e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:56.309985 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 801/1594] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:56.310804 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c33e66-4140-41d3-bd0d-9414dbbf7fe5 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:56.315216 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c09270-a4f9-4779-956c-6f261324bf8e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:56.320486 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d5049-71f7-49b8-b0fd-00d6dca3e91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:56.321152 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d5049-71f7-49b8-b0fd-00d6dca3e91e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.321502 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d5049-71f7-49b8-b0fd-00d6dca3e91e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.321777 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d5049-71f7-49b8-b0fd-00d6dca3e91e admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.322630 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d5049-71f7-49b8-b0fd-00d6dca3e91e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:56.324236 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d5049-71f7-49b8-b0fd-00d6dca3e91e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:56.325902 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c33e66-4140-41d3-bd0d-9414dbbf7fe5 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:56.331293 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b17bea-4ece-4691-8b99-c884bec4e3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:56.331956 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b17bea-4ece-4691-8b99-c884bec4e3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.332238 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b17bea-4ece-4691-8b99-c884bec4e3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.332508 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b17bea-4ece-4691-8b99-c884bec4e3f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.333240 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b17bea-4ece-4691-8b99-c884bec4e3f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:56.337695 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 794/1595] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:57:56.337695 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d5049-71f7-49b8-b0fd-00d6dca3e91e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:56.337951 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b17bea-4ece-4691-8b99-c884bec4e3f2 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:56.346687 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 802/1596] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:57:56.346846 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d5049-71f7-49b8-b0fd-00d6dca3e91e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:56.348208 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c336b59-5bcf-4690-9490-1d15807284a0 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.348498 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c336b59-5bcf-4690-9490-1d15807284a0 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.348777 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c336b59-5bcf-4690-9490-1d15807284a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.351414 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dfe33-a172-4589-aaa0-fb27591c22cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:56.352061 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dfe33-a172-4589-aaa0-fb27591c22cc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.352384 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dfe33-a172-4589-aaa0-fb27591c22cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.352653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dfe33-a172-4589-aaa0-fb27591c22cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.353400 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dfe33-a172-4589-aaa0-fb27591c22cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:56.354984 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dfe33-a172-4589-aaa0-fb27591c22cc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:56.364758 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 795/1597] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:57:56.365562 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dfe33-a172-4589-aaa0-fb27591c22cc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:56.374804 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-9c336b59-5bcf-4690-9490-1d15807284a0 None None] MFA Rules not processed for user `90e1e089c82b493bba4324948b5c5f82`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:56.376008 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-9c336b59-5bcf-4690-9490-1d15807284a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:56.378086 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dfe33-a172-4589-aaa0-fb27591c22cc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:56.382950 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f1d6f-b180-4797-848f-d183e5439bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:56.383638 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f1d6f-b180-4797-848f-d183e5439bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.383935 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f1d6f-b180-4797-848f-d183e5439bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.384203 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f1d6f-b180-4797-848f-d183e5439bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.384924 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f1d6f-b180-4797-848f-d183e5439bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:56.386516 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f1d6f-b180-4797-848f-d183e5439bb8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:56.396728 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 796/1598] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:57:56.397950 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a81934-7f92-49d3-837a-cf59e8e5d1d6 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.398234 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a81934-7f92-49d3-837a-cf59e8e5d1d6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.398504 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a81934-7f92-49d3-837a-cf59e8e5d1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.414610 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-f5a81934-7f92-49d3-837a-cf59e8e5d1d6 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:56.415840 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f5a81934-7f92-49d3-837a-cf59e8e5d1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:56.424132 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 797/1599] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:56.424850 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a81934-7f92-49d3-837a-cf59e8e5d1d6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:56.436192 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a81934-7f92-49d3-837a-cf59e8e5d1d6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:56.442058 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656443c6-65ab-4fb8-9a97-6860c1915037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:56.442956 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656443c6-65ab-4fb8-9a97-6860c1915037 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.443232 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656443c6-65ab-4fb8-9a97-6860c1915037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.443497 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656443c6-65ab-4fb8-9a97-6860c1915037 admin admin] PATH_INFO: `/v3/projects/c96651580da845748b21e850a875d357/users/54f6015a565b4a5eb74ec571f8774bbd/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.447380 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 803/1600] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:56.448974 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b6234-0fe5-458c-9f52-f113e05c6706 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.449263 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b6234-0fe5-458c-9f52-f113e05c6706 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.449575 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b6234-0fe5-458c-9f52-f113e05c6706 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.452853 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 804/1601] 10.222.0.31 () {54 vars in 961 bytes} [Thu Feb 10 20:57:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:57:56.453642 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b6234-0fe5-458c-9f52-f113e05c6706 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:56.460454 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656443c6-65ab-4fb8-9a97-6860c1915037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96651580da845748b21e850a875d357, user_id=54f6015a565b4a5eb74ec571f8774bbd, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:56.463314 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656443c6-65ab-4fb8-9a97-6860c1915037 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:56.466240 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b6234-0fe5-458c-9f52-f113e05c6706 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:56.471349 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dc35a-154e-47e6-9b75-71addf1aa36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:56.472215 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dc35a-154e-47e6-9b75-71addf1aa36e admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.472489 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dc35a-154e-47e6-9b75-71addf1aa36e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.472755 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dc35a-154e-47e6-9b75-71addf1aa36e admin admin] PATH_INFO: `/v3/projects/1878c4d1eab14d0fa8661ca8892d214b/users/f7050db935904c5e851384f033ecf4f3/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.476940 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 798/1602] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:57:56 2022] PUT /identity/v3/projects/c96651580da845748b21e850a875d357/users/54f6015a565b4a5eb74ec571f8774bbd/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:57:56.477927 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656443c6-65ab-4fb8-9a97-6860c1915037 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:56.487481 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dc35a-154e-47e6-9b75-71addf1aa36e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1878c4d1eab14d0fa8661ca8892d214b, user_id=f7050db935904c5e851384f033ecf4f3, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:56.490176 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dc35a-154e-47e6-9b75-71addf1aa36e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:56.504345 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 805/1603] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:57:56 2022] PUT /identity/v3/projects/1878c4d1eab14d0fa8661ca8892d214b/users/f7050db935904c5e851384f033ecf4f3/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:57:56.505274 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dc35a-154e-47e6-9b75-71addf1aa36e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:56.539421 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656443c6-65ab-4fb8-9a97-6860c1915037 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:56.567588 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dc35a-154e-47e6-9b75-71addf1aa36e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:56.572495 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fccf3-2ba4-4af0-b74e-429e97e051d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:56.573263 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fccf3-2ba4-4af0-b74e-429e97e051d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.573574 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fccf3-2ba4-4af0-b74e-429e97e051d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.573850 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fccf3-2ba4-4af0-b74e-429e97e051d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.574589 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fccf3-2ba4-4af0-b74e-429e97e051d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:56.576228 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fccf3-2ba4-4af0-b74e-429e97e051d7 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:56.586222 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 806/1604] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:57:56.587065 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fccf3-2ba4-4af0-b74e-429e97e051d7 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:56.596774 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fccf3-2ba4-4af0-b74e-429e97e051d7 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:56.599262 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756e17a-ba07-4009-a8ff-9094d8bace9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:56.599943 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756e17a-ba07-4009-a8ff-9094d8bace9a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.600225 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756e17a-ba07-4009-a8ff-9094d8bace9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.600492 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756e17a-ba07-4009-a8ff-9094d8bace9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.601259 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756e17a-ba07-4009-a8ff-9094d8bace9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:56.601684 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae8648-0a51-420f-8dfd-6497ad988dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:56.602550 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae8648-0a51-420f-8dfd-6497ad988dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.602825 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae8648-0a51-420f-8dfd-6497ad988dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.602958 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756e17a-ba07-4009-a8ff-9094d8bace9a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:56.603091 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae8648-0a51-420f-8dfd-6497ad988dd4 admin admin] PATH_INFO: `/v3/projects/3408233aa5b94f9fa88c46a4922bb1c1/users/e7050f2337534ebfbd21f6a973587d11/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.612461 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 799/1605] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:57:56.613260 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756e17a-ba07-4009-a8ff-9094d8bace9a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:56.619386 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae8648-0a51-420f-8dfd-6497ad988dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3408233aa5b94f9fa88c46a4922bb1c1, user_id=e7050f2337534ebfbd21f6a973587d11, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:56.622137 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae8648-0a51-420f-8dfd-6497ad988dd4 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:56.636446 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 807/1606] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:57:56 2022] PUT /identity/v3/projects/3408233aa5b94f9fa88c46a4922bb1c1/users/e7050f2337534ebfbd21f6a973587d11/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:57:56.637238 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae8648-0a51-420f-8dfd-6497ad988dd4 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:56.675376 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756e17a-ba07-4009-a8ff-9094d8bace9a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:56.708757 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae8648-0a51-420f-8dfd-6497ad988dd4 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:56.713538 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6e4e7-f08a-403b-80e3-084bb75ce2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:56.714276 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6e4e7-f08a-403b-80e3-084bb75ce2ad admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.714619 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6e4e7-f08a-403b-80e3-084bb75ce2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.714894 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6e4e7-f08a-403b-80e3-084bb75ce2ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.715588 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6e4e7-f08a-403b-80e3-084bb75ce2ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:56.717535 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6e4e7-f08a-403b-80e3-084bb75ce2ad admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:56.723947 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc7217-42d2-41ca-aa56-7f9f65d4b5a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:56.724641 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc7217-42d2-41ca-aa56-7f9f65d4b5a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.724980 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc7217-42d2-41ca-aa56-7f9f65d4b5a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.725239 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc7217-42d2-41ca-aa56-7f9f65d4b5a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.734300 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc7217-42d2-41ca-aa56-7f9f65d4b5a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:56.735748 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc7217-42d2-41ca-aa56-7f9f65d4b5a3 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:56.742138 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 808/1607] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:57:56 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:57:56.743730 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82a0a6-dc69-43e6-8eba-f681fe83fd8a None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.744017 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82a0a6-dc69-43e6-8eba-f681fe83fd8a None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.744289 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82a0a6-dc69-43e6-8eba-f681fe83fd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.745759 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 800/1608] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:57:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:57:56.747095 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5fb67-7794-417a-88fe-84014d122b66 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.747379 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5fb67-7794-417a-88fe-84014d122b66 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.747657 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5fb67-7794-417a-88fe-84014d122b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.764681 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-57c5fb67-7794-417a-88fe-84014d122b66 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:56.765947 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-57c5fb67-7794-417a-88fe-84014d122b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:56.768567 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-0d82a0a6-dc69-43e6-8eba-f681fe83fd8a None None] MFA Rules not processed for user `c0d84b0d7e3d423aa972e58be27c772c`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:56.770081 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-0d82a0a6-dc69-43e6-8eba-f681fe83fd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:56.823598 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 801/1609] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:56.824759 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265d266-8d28-4103-93c5-c70403fade4c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.825067 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265d266-8d28-4103-93c5-c70403fade4c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.825305 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265d266-8d28-4103-93c5-c70403fade4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.844241 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 809/1610] 10.222.0.31 () {58 vars in 1058 bytes} [Thu Feb 10 20:57:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:56.845996 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-a265d266-8d28-4103-93c5-c70403fade4c None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:56.846376 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82a0a6-dc69-43e6-8eba-f681fe83fd8a None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:56.847893 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a265d266-8d28-4103-93c5-c70403fade4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:56.856779 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 802/1611] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:56.857830 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265d266-8d28-4103-93c5-c70403fade4c None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:56.858749 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82a0a6-dc69-43e6-8eba-f681fe83fd8a None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:56.869674 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265d266-8d28-4103-93c5-c70403fade4c None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:56.870170 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba69d6f-b236-4eee-91a5-e99dd9f44992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:56.871652 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba69d6f-b236-4eee-91a5-e99dd9f44992 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.871782 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba69d6f-b236-4eee-91a5-e99dd9f44992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.872076 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba69d6f-b236-4eee-91a5-e99dd9f44992 admin admin] PATH_INFO: `/v3/projects/75c08e9ba79542bba3caac45c257d1da/users/edce3021d9e841b3b13c24b5a3c3c425/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.875022 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acbe67-01cb-48e1-97d1-930160a88abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:56.876032 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acbe67-01cb-48e1-97d1-930160a88abf admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.876404 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acbe67-01cb-48e1-97d1-930160a88abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.876769 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acbe67-01cb-48e1-97d1-930160a88abf admin admin] PATH_INFO: `/v3/projects/67e74021df03473e8ec953c7cd4401a0/users/de49aeb6fee74ddfbb13926cb8e1f037/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.889145 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba69d6f-b236-4eee-91a5-e99dd9f44992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c08e9ba79542bba3caac45c257d1da, user_id=edce3021d9e841b3b13c24b5a3c3c425, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:56.891616 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acbe67-01cb-48e1-97d1-930160a88abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=67e74021df03473e8ec953c7cd4401a0, user_id=de49aeb6fee74ddfbb13926cb8e1f037, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:56.892124 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba69d6f-b236-4eee-91a5-e99dd9f44992 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:56.894553 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acbe67-01cb-48e1-97d1-930160a88abf admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:56.906414 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 810/1612] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:57:56 2022] PUT /identity/v3/projects/75c08e9ba79542bba3caac45c257d1da/users/edce3021d9e841b3b13c24b5a3c3c425/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:57:56.908031 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b546e1-bf7d-46ce-b505-40801669ae16 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:56.908388 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b546e1-bf7d-46ce-b505-40801669ae16 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:56.908586 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 803/1613] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:57:56 2022] PUT /identity/v3/projects/67e74021df03473e8ec953c7cd4401a0/users/de49aeb6fee74ddfbb13926cb8e1f037/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:57:56.908854 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b546e1-bf7d-46ce-b505-40801669ae16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:56.909427 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acbe67-01cb-48e1-97d1-930160a88abf admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:56.979202 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-d3b546e1-bf7d-46ce-b505-40801669ae16 None None] MFA Rules not processed for user `e7050f2337534ebfbd21f6a973587d11`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:56.980812 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d3b546e1-bf7d-46ce-b505-40801669ae16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:57.010244 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acbe67-01cb-48e1-97d1-930160a88abf admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:57.015580 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a3233-f8c6-4499-87b7-e4d6d45de56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:57.016202 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a3233-f8c6-4499-87b7-e4d6d45de56b admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:57.016484 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a3233-f8c6-4499-87b7-e4d6d45de56b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:57.016753 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a3233-f8c6-4499-87b7-e4d6d45de56b admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:57.017516 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a3233-f8c6-4499-87b7-e4d6d45de56b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:57.020242 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a3233-f8c6-4499-87b7-e4d6d45de56b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:57.042434 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 804/1614] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:57:56 2022] POST /identity/v3/users => generated 296 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:57:57.043684 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a3233-f8c6-4499-87b7-e4d6d45de56b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:57.047723 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d74a3233-f8c6-4499-87b7-e4d6d45de56b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:57.053879 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 811/1615] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:57.054780 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b546e1-bf7d-46ce-b505-40801669ae16 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:57.114722 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a3233-f8c6-4499-87b7-e4d6d45de56b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:57.119861 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad5897-119f-4831-9ea8-4abdd4ef273e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:57.120173 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad5897-119f-4831-9ea8-4abdd4ef273e service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:57.120449 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad5897-119f-4831-9ea8-4abdd4ef273e service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:57.120721 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad5897-119f-4831-9ea8-4abdd4ef273e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:57.132915 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad5897-119f-4831-9ea8-4abdd4ef273e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:57.134723 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad5897-119f-4831-9ea8-4abdd4ef273e service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:57.137181 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b546e1-bf7d-46ce-b505-40801669ae16 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:57.143626 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57b775-7f2c-4445-9c3d-b23ecf0e131e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:57.144498 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57b775-7f2c-4445-9c3d-b23ecf0e131e service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:57.144847 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57b775-7f2c-4445-9c3d-b23ecf0e131e service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:57.145182 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57b775-7f2c-4445-9c3d-b23ecf0e131e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:57.147498 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 805/1616] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:57:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:57:57.148496 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad5897-119f-4831-9ea8-4abdd4ef273e service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:57.157994 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad5897-119f-4831-9ea8-4abdd4ef273e service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:57.162950 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f44f38-f4a9-4ae7-ac84-6146ba892a70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:57.163543 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f44f38-f4a9-4ae7-ac84-6146ba892a70 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:57.163827 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f44f38-f4a9-4ae7-ac84-6146ba892a70 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:57.164669 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f44f38-f4a9-4ae7-ac84-6146ba892a70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:57.183430 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f44f38-f4a9-4ae7-ac84-6146ba892a70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:57.185175 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f44f38-f4a9-4ae7-ac84-6146ba892a70 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:57.195953 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 806/1617] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:57:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:57:57.197530 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c37a4e-ef5f-4ffc-a6c0-4a056fb41395 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:57.197530 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c37a4e-ef5f-4ffc-a6c0-4a056fb41395 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:57.197744 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c37a4e-ef5f-4ffc-a6c0-4a056fb41395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:57.208226 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57b775-7f2c-4445-9c3d-b23ecf0e131e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:57.209953 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57b775-7f2c-4445-9c3d-b23ecf0e131e service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:57.214605 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-67c37a4e-ef5f-4ffc-a6c0-4a056fb41395 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:57.215808 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-67c37a4e-ef5f-4ffc-a6c0-4a056fb41395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:57.219839 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 812/1618] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:57:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:57:57.220960 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d46790-208c-46e9-a666-1ee3cc0eb67d None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:57.221387 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d46790-208c-46e9-a666-1ee3cc0eb67d None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:57.221671 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d46790-208c-46e9-a666-1ee3cc0eb67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:57.225392 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 807/1619] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:57.225817 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c37a4e-ef5f-4ffc-a6c0-4a056fb41395 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:57.235604 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c37a4e-ef5f-4ffc-a6c0-4a056fb41395 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:57.241597 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d3576-9bc3-4a10-8611-8ded33a52574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:57.242765 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d3576-9bc3-4a10-8611-8ded33a52574 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:57.243251 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d3576-9bc3-4a10-8611-8ded33a52574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:57.243651 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d3576-9bc3-4a10-8611-8ded33a52574 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:57.244552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d3576-9bc3-4a10-8611-8ded33a52574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:57.246434 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d3576-9bc3-4a10-8611-8ded33a52574 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:57.258595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 808/1620] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:57:57.264127 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dace7-7ada-4b0c-939c-4bf20e12bb66 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:57.264465 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dace7-7ada-4b0c-939c-4bf20e12bb66 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:57.265012 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dace7-7ada-4b0c-939c-4bf20e12bb66 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:57.270362 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-95d46790-208c-46e9-a666-1ee3cc0eb67d None None] MFA Rules not processed for user `de49aeb6fee74ddfbb13926cb8e1f037`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:57.272260 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-95d46790-208c-46e9-a666-1ee3cc0eb67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:57.274636 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 809/1621] 10.222.0.31 () {54 vars in 961 bytes} [Thu Feb 10 20:57:57 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:57:57.276156 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52dace7-7ada-4b0c-939c-4bf20e12bb66 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:57.289678 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52dace7-7ada-4b0c-939c-4bf20e12bb66 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:57.294745 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722f856-0fab-404d-83e0-9d863ab9d288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:57.295501 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722f856-0fab-404d-83e0-9d863ab9d288 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:57.295872 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722f856-0fab-404d-83e0-9d863ab9d288 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:57.296225 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722f856-0fab-404d-83e0-9d863ab9d288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:57.308916 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722f856-0fab-404d-83e0-9d863ab9d288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:57.310618 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722f856-0fab-404d-83e0-9d863ab9d288 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:57.323829 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 810/1622] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:57:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:57:57.325559 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722f856-0fab-404d-83e0-9d863ab9d288 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:57.341876 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722f856-0fab-404d-83e0-9d863ab9d288 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:57.353095 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55affaef-54e4-4ff6-8a01-900814342c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:57.355625 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55affaef-54e4-4ff6-8a01-900814342c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:57.355969 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55affaef-54e4-4ff6-8a01-900814342c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:57.356281 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55affaef-54e4-4ff6-8a01-900814342c2c admin admin] PATH_INFO: `/v3/projects/83064fb9b1d9492e8af64031efa9fb6d/users/106fb139620c4aca893c012ad44f5291/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:57.381064 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55affaef-54e4-4ff6-8a01-900814342c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=83064fb9b1d9492e8af64031efa9fb6d, user_id=106fb139620c4aca893c012ad44f5291, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:57.383870 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55affaef-54e4-4ff6-8a01-900814342c2c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:57.401804 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 813/1623] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:57.403329 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb607006-ecaf-43ab-9149-6d7eedb1d283 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:57.403613 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb607006-ecaf-43ab-9149-6d7eedb1d283 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:57.403884 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb607006-ecaf-43ab-9149-6d7eedb1d283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:57.419667 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 811/1624] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:57:57 2022] PUT /identity/v3/projects/83064fb9b1d9492e8af64031efa9fb6d/users/106fb139620c4aca893c012ad44f5291/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:57:57.419667 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55affaef-54e4-4ff6-8a01-900814342c2c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:57.449240 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-bb607006-ecaf-43ab-9149-6d7eedb1d283 None None] MFA Rules not processed for user `c0d84b0d7e3d423aa972e58be27c772c`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:57.450553 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-bb607006-ecaf-43ab-9149-6d7eedb1d283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:57.524279 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55affaef-54e4-4ff6-8a01-900814342c2c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:57.534211 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb341f-a53e-4946-88d6-b83eddeea670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:57.534854 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb341f-a53e-4946-88d6-b83eddeea670 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:57.535904 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb341f-a53e-4946-88d6-b83eddeea670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:57.536204 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb341f-a53e-4946-88d6-b83eddeea670 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:57.537000 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb341f-a53e-4946-88d6-b83eddeea670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:57.539109 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb341f-a53e-4946-88d6-b83eddeea670 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:57.575257 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 812/1625] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:57:57 2022] POST /identity/v3/projects => generated 365 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:57:57.576410 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb341f-a53e-4946-88d6-b83eddeea670 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:57.587645 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 814/1626] 10.222.0.31 () {58 vars in 1058 bytes} [Thu Feb 10 20:57:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:57.599868 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bb05e-1d41-45de-bc63-a0e1ab3e3885 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:57.600167 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bb05e-1d41-45de-bc63-a0e1ab3e3885 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:57.600444 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bb05e-1d41-45de-bc63-a0e1ab3e3885 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:57.603579 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 815/1627] 10.222.0.31 () {54 vars in 912 bytes} [Thu Feb 10 20:57:57 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:57:57.604491 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bb05e-1d41-45de-bc63-a0e1ab3e3885 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:57.656948 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb341f-a53e-4946-88d6-b83eddeea670 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:57.662825 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01fc18-93ea-4207-8c61-5828f9dbd81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:57.663581 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01fc18-93ea-4207-8c61-5828f9dbd81c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:57.663820 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01fc18-93ea-4207-8c61-5828f9dbd81c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:57.664140 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01fc18-93ea-4207-8c61-5828f9dbd81c admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:57.665123 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01fc18-93ea-4207-8c61-5828f9dbd81c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:57.667357 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01fc18-93ea-4207-8c61-5828f9dbd81c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:57.678247 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bb05e-1d41-45de-bc63-a0e1ab3e3885 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:57.683485 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 813/1628] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:57:57.683485 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01fc18-93ea-4207-8c61-5828f9dbd81c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:57.690382 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeadee2-bcc2-46a5-8658-412eff8120d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:57.691215 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeadee2-bcc2-46a5-8658-412eff8120d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:57.691503 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeadee2-bcc2-46a5-8658-412eff8120d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:57.691777 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeadee2-bcc2-46a5-8658-412eff8120d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:57.692904 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeadee2-bcc2-46a5-8658-412eff8120d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:57.697000 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeadee2-bcc2-46a5-8658-412eff8120d2 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:57.726294 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 816/1629] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:57:57 2022] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:57:57.728380 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367df38-5e5c-4a1f-911a-5d6952fa9c2c None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:57.728806 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367df38-5e5c-4a1f-911a-5d6952fa9c2c None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:57.730425 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367df38-5e5c-4a1f-911a-5d6952fa9c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:57.759912 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-8367df38-5e5c-4a1f-911a-5d6952fa9c2c None None] MFA Rules not processed for user `c0d84b0d7e3d423aa972e58be27c772c`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:57.761534 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-8367df38-5e5c-4a1f-911a-5d6952fa9c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:57.830323 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01fc18-93ea-4207-8c61-5828f9dbd81c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:57.844269 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985866f-15a7-4279-a147-2a8a1a1be655 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:57.844999 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985866f-15a7-4279-a147-2a8a1a1be655 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:57.846766 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985866f-15a7-4279-a147-2a8a1a1be655 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:57.847060 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985866f-15a7-4279-a147-2a8a1a1be655 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:57.881917 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 817/1630] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 10 20:57:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:57.882782 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367df38-5e5c-4a1f-911a-5d6952fa9c2c None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:57.894332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367df38-5e5c-4a1f-911a-5d6952fa9c2c None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:57.899158 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfb74b-f8d3-4af5-b18d-28955ca72423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:57.900185 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfb74b-f8d3-4af5-b18d-28955ca72423 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:57.900463 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfb74b-f8d3-4af5-b18d-28955ca72423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:57.900731 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfb74b-f8d3-4af5-b18d-28955ca72423 admin admin] PATH_INFO: `/v3/projects/83064fb9b1d9492e8af64031efa9fb6d/users/106fb139620c4aca893c012ad44f5291/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:57.903190 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfb74b-f8d3-4af5-b18d-28955ca72423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83064fb9b1d9492e8af64031efa9fb6d, user_id=106fb139620c4aca893c012ad44f5291, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:57.906356 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfb74b-f8d3-4af5-b18d-28955ca72423 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:57.918319 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 818/1631] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:57:57 2022] PUT /identity/v3/projects/83064fb9b1d9492e8af64031efa9fb6d/users/106fb139620c4aca893c012ad44f5291/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:57:57.919275 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfb74b-f8d3-4af5-b18d-28955ca72423 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:57.989248 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985866f-15a7-4279-a147-2a8a1a1be655 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:57.991452 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985866f-15a7-4279-a147-2a8a1a1be655 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:58.019523 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 814/1632] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:57:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:57:58.039381 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985866f-15a7-4279-a147-2a8a1a1be655 service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:58.098043 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfb74b-f8d3-4af5-b18d-28955ca72423 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:58.112463 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dcfc95-88d8-4795-9576-2f09d03a3195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:58.113598 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcfc95-88d8-4795-9576-2f09d03a3195 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:58.113884 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcfc95-88d8-4795-9576-2f09d03a3195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:58.115608 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcfc95-88d8-4795-9576-2f09d03a3195 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:58.117940 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dcfc95-88d8-4795-9576-2f09d03a3195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:58.127350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dcfc95-88d8-4795-9576-2f09d03a3195 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:58.159066 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 819/1633] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:57:58.163225 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d524b6-c9fe-4512-92ec-4e45e9e8c1f2 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:58.163511 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d524b6-c9fe-4512-92ec-4e45e9e8c1f2 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:58.163779 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d524b6-c9fe-4512-92ec-4e45e9e8c1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:58.183956 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985866f-15a7-4279-a147-2a8a1a1be655 service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:58.217956 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-81d524b6-c9fe-4512-92ec-4e45e9e8c1f2 None None] MFA Rules not processed for user `106fb139620c4aca893c012ad44f5291`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:58.219553 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-81d524b6-c9fe-4512-92ec-4e45e9e8c1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:58.294928 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b466e-4523-4817-91c8-4c5fd8236627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:58.296810 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b466e-4523-4817-91c8-4c5fd8236627 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:58.298177 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b466e-4523-4817-91c8-4c5fd8236627 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:58.299862 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b466e-4523-4817-91c8-4c5fd8236627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:58.316804 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 820/1634] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:58.318041 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d524b6-c9fe-4512-92ec-4e45e9e8c1f2 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:58.360584 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d524b6-c9fe-4512-92ec-4e45e9e8c1f2 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:58.372911 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929002e-42d0-4a83-96c4-9f4a5e61c576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:58.373901 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929002e-42d0-4a83-96c4-9f4a5e61c576 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:58.374179 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929002e-42d0-4a83-96c4-9f4a5e61c576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:58.375352 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929002e-42d0-4a83-96c4-9f4a5e61c576 admin admin] PATH_INFO: `/v3/projects/20e6f4f17f33456c9d00c0cb829212c0/users/bf73f88e1ad04243a4a24de42aa77c2c/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:58.415318 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929002e-42d0-4a83-96c4-9f4a5e61c576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e6f4f17f33456c9d00c0cb829212c0, user_id=bf73f88e1ad04243a4a24de42aa77c2c, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:58.419390 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929002e-42d0-4a83-96c4-9f4a5e61c576 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:58.459293 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 821/1635] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:57:58 2022] PUT /identity/v3/projects/20e6f4f17f33456c9d00c0cb829212c0/users/bf73f88e1ad04243a4a24de42aa77c2c/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:57:58.460348 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929002e-42d0-4a83-96c4-9f4a5e61c576 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:58.503328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b466e-4523-4817-91c8-4c5fd8236627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:58.507218 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b466e-4523-4817-91c8-4c5fd8236627 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:58.544326 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 815/1636] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:57:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:57:58.557337 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b466e-4523-4817-91c8-4c5fd8236627 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:58.580410 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b466e-4523-4817-91c8-4c5fd8236627 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:58.600016 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929002e-42d0-4a83-96c4-9f4a5e61c576 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:58.604902 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc0b0c-4a23-47be-8554-263a591235ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:58.605615 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc0b0c-4a23-47be-8554-263a591235ef service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:58.605891 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc0b0c-4a23-47be-8554-263a591235ef service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:58.606157 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc0b0c-4a23-47be-8554-263a591235ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:58.698503 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc0b0c-4a23-47be-8554-263a591235ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:58.700495 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc0b0c-4a23-47be-8554-263a591235ef service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:58.716642 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 822/1637] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:57:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:57:58.725627 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae43f9-8037-42cc-85a6-ef79e8c09a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:58.726328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae43f9-8037-42cc-85a6-ef79e8c09a94 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:58.726620 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae43f9-8037-42cc-85a6-ef79e8c09a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:58.728704 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae43f9-8037-42cc-85a6-ef79e8c09a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:58.731443 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae43f9-8037-42cc-85a6-ef79e8c09a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:58.733715 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dc5c5-abac-41e2-aac3-3041b7bd97ef None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:58.735722 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dc5c5-abac-41e2-aac3-3041b7bd97ef None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:58.736533 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dc5c5-abac-41e2-aac3-3041b7bd97ef None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:58.737914 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae43f9-8037-42cc-85a6-ef79e8c09a94 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:58.743980 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 823/1638] 10.222.0.31 () {54 vars in 912 bytes} [Thu Feb 10 20:57:58 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:57:58.750067 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81a756-ed57-4360-9bad-8aacd086cf5e None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:58.750549 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81a756-ed57-4360-9bad-8aacd086cf5e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:58.750968 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81a756-ed57-4360-9bad-8aacd086cf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:58.765197 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 816/1639] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:57:58.770669 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae43f9-8037-42cc-85a6-ef79e8c09a94 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:58.783885 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-9f81a756-ed57-4360-9bad-8aacd086cf5e None None] MFA Rules not processed for user `c0d84b0d7e3d423aa972e58be27c772c`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:58.786263 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-9f81a756-ed57-4360-9bad-8aacd086cf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:58.811890 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae43f9-8037-42cc-85a6-ef79e8c09a94 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:58.829697 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fcd2a-6317-471f-98eb-aaec5a2289fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:58.833125 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fcd2a-6317-471f-98eb-aaec5a2289fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:58.833425 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fcd2a-6317-471f-98eb-aaec5a2289fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:58.836316 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fcd2a-6317-471f-98eb-aaec5a2289fa admin admin] PATH_INFO: `/v3/projects/20e6f4f17f33456c9d00c0cb829212c0/users/bf73f88e1ad04243a4a24de42aa77c2c/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:58.840205 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143fcd2a-6317-471f-98eb-aaec5a2289fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e6f4f17f33456c9d00c0cb829212c0, user_id=bf73f88e1ad04243a4a24de42aa77c2c, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:58.860832 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143fcd2a-6317-471f-98eb-aaec5a2289fa admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:58.884931 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 824/1640] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 10 20:57:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:57:58.902127 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 817/1641] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:57:58 2022] PUT /identity/v3/projects/20e6f4f17f33456c9d00c0cb829212c0/users/bf73f88e1ad04243a4a24de42aa77c2c/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:57:58.911874 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58c00a-f2a8-43cf-a800-828d13f39491 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:58.912181 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58c00a-f2a8-43cf-a800-828d13f39491 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:58.912455 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58c00a-f2a8-43cf-a800-828d13f39491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:58.955006 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-bf58c00a-f2a8-43cf-a800-828d13f39491 None None] MFA Rules not processed for user `bf73f88e1ad04243a4a24de42aa77c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:58.956455 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-bf58c00a-f2a8-43cf-a800-828d13f39491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:58.959108 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fcd2a-6317-471f-98eb-aaec5a2289fa admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:59.082029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fcd2a-6317-471f-98eb-aaec5a2289fa admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:59.090376 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9886e-fc62-4172-9bc3-1dc7532131d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:59.092580 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9886e-fc62-4172-9bc3-1dc7532131d7 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:59.093279 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9886e-fc62-4172-9bc3-1dc7532131d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:59.094239 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9886e-fc62-4172-9bc3-1dc7532131d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:59.115090 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 825/1642] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:59.229308 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9886e-fc62-4172-9bc3-1dc7532131d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:59.231121 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9886e-fc62-4172-9bc3-1dc7532131d7 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:59.243456 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 818/1643] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:57:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:57:59.374056 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58c00a-f2a8-43cf-a800-828d13f39491 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:59.402217 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58c00a-f2a8-43cf-a800-828d13f39491 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:59.413128 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88482744-a5b7-486b-aeb1-146aad2ddb83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:59.413990 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88482744-a5b7-486b-aeb1-146aad2ddb83 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:59.414401 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88482744-a5b7-486b-aeb1-146aad2ddb83 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:59.414833 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88482744-a5b7-486b-aeb1-146aad2ddb83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:59.494098 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe49b9-b147-40c5-ae5b-1793bd37c13d None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:59.494387 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe49b9-b147-40c5-ae5b-1793bd37c13d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:59.494653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe49b9-b147-40c5-ae5b-1793bd37c13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:59.523066 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-34fe49b9-b147-40c5-ae5b-1793bd37c13d None None] MFA Rules not processed for user `f7050db935904c5e851384f033ecf4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:59.525031 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-34fe49b9-b147-40c5-ae5b-1793bd37c13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:59.589885 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88482744-a5b7-486b-aeb1-146aad2ddb83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:59.592004 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88482744-a5b7-486b-aeb1-146aad2ddb83 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:59.612691 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 826/1644] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:57:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:57:59.615087 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88482744-a5b7-486b-aeb1-146aad2ddb83 service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:59.627667 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88482744-a5b7-486b-aeb1-146aad2ddb83 service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:59.644654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cedd4-e482-4fb0-a199-7819657a55f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:59.645552 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cedd4-e482-4fb0-a199-7819657a55f6 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:59.645938 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cedd4-e482-4fb0-a199-7819657a55f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:59.646312 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cedd4-e482-4fb0-a199-7819657a55f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:59.667982 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cedd4-e482-4fb0-a199-7819657a55f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:59.669644 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cedd4-e482-4fb0-a199-7819657a55f6 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:59.672988 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 819/1645] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:57:59.687037 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f59db4-6700-4af9-94ef-20c9be41bfec None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:59.687246 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f59db4-6700-4af9-94ef-20c9be41bfec None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:59.687951 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f59db4-6700-4af9-94ef-20c9be41bfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:59.695253 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 827/1646] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:57:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:57:59.727971 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-32f59db4-6700-4af9-94ef-20c9be41bfec None None] MFA Rules not processed for user `f7050db935904c5e851384f033ecf4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:57:59.732918 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-32f59db4-6700-4af9-94ef-20c9be41bfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:57:59.747869 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 820/1647] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:57:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:57:59.798265 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cedd4-e482-4fb0-a199-7819657a55f6 service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:57:59.821885 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cedd4-e482-4fb0-a199-7819657a55f6 service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:57:59.843545 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc10f93-b432-4d44-8983-c2558a055676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:57:59.850029 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc10f93-b432-4d44-8983-c2558a055676 service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:57:59.852768 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc10f93-b432-4d44-8983-c2558a055676 service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:57:59.854859 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc10f93-b432-4d44-8983-c2558a055676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:57:59.885824 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc10f93-b432-4d44-8983-c2558a055676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:57:59.903113 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc10f93-b432-4d44-8983-c2558a055676 service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:57:59.941477 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 828/1648] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:57:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:00.079054 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f59db4-6700-4af9-94ef-20c9be41bfec None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:00.092975 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f59db4-6700-4af9-94ef-20c9be41bfec None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:00.102913 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808cf03-30dc-4805-ac8d-7233db75d4f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:00.106409 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808cf03-30dc-4805-ac8d-7233db75d4f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:00.107703 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808cf03-30dc-4805-ac8d-7233db75d4f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:00.108108 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808cf03-30dc-4805-ac8d-7233db75d4f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:00.117110 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc10f93-b432-4d44-8983-c2558a055676 service nova] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:00.227643 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808cf03-30dc-4805-ac8d-7233db75d4f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:00.229938 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808cf03-30dc-4805-ac8d-7233db75d4f8 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:00.245575 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 821/1649] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:00 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:00.318777 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc10f93-b432-4d44-8983-c2558a055676 service nova] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:00.328513 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7974a32-0569-436b-8adb-c12af37c2bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:00.329751 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7974a32-0569-436b-8adb-c12af37c2bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:00.330629 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7974a32-0569-436b-8adb-c12af37c2bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:00.330803 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7974a32-0569-436b-8adb-c12af37c2bd8 admin admin] PATH_INFO: `/v3/users/e7050f2337534ebfbd21f6a973587d11` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:00.332702 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7974a32-0569-436b-8adb-c12af37c2bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7050f2337534ebfbd21f6a973587d11)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:00.337473 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: WARNING py.warnings [None req-a7974a32-0569-436b-8adb-c12af37c2bd8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:58:00.337473 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: warnings.warn(msg) Feb 10 20:58:00.337473 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: Feb 10 20:58:00.338297 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7974a32-0569-436b-8adb-c12af37c2bd8 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:00.434805 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-a7974a32-0569-436b-8adb-c12af37c2bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7050f2337534ebfbd21f6a973587d11'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:00.448362 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-a7974a32-0569-436b-8adb-c12af37c2bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7050f2337534ebfbd21f6a973587d11'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:00.481626 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-a7974a32-0569-436b-8adb-c12af37c2bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7050f2337534ebfbd21f6a973587d11'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:00.482503 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-a7974a32-0569-436b-8adb-c12af37c2bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7050f2337534ebfbd21f6a973587d11'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:00.483196 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-a7974a32-0569-436b-8adb-c12af37c2bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7050f2337534ebfbd21f6a973587d11'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:00.505987 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 829/1650] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:00 2022] DELETE /identity/v3/users/e7050f2337534ebfbd21f6a973587d11 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:00.508049 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52422087-4d33-4386-b65b-6f2bfbca9d8a None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:00.508737 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52422087-4d33-4386-b65b-6f2bfbca9d8a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:00.509377 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52422087-4d33-4386-b65b-6f2bfbca9d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:00.534074 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-52422087-4d33-4386-b65b-6f2bfbca9d8a None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:00.535469 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-52422087-4d33-4386-b65b-6f2bfbca9d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:00.625592 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 822/1651] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:00.871816 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7974a32-0569-436b-8adb-c12af37c2bd8 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:00.871816 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-a7974a32-0569-436b-8adb-c12af37c2bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:00.876926 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc9674-5805-4bb9-b741-d462df78afb1 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:00.876926 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc9674-5805-4bb9-b741-d462df78afb1 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:00.876926 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc9674-5805-4bb9-b741-d462df78afb1 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:00.876926 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 823/1652] 10.222.0.31 () {54 vars in 912 bytes} [Thu Feb 10 20:58:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:58:00.876926 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1ffde-ecf6-4558-8b36-b401292ff051 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:00.876926 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1ffde-ecf6-4558-8b36-b401292ff051 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:00.878057 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1ffde-ecf6-4558-8b36-b401292ff051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:00.944303 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-3ba1ffde-ecf6-4558-8b36-b401292ff051 None None] MFA Rules not processed for user `b07a9ae7262b44ce88e1338c83360356`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:00.946669 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3ba1ffde-ecf6-4558-8b36-b401292ff051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:00.967156 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7974a32-0569-436b-8adb-c12af37c2bd8 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:00.973032 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e815b03-1a57-4dbd-b2c8-20c5e108f5e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:00.978945 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e815b03-1a57-4dbd-b2c8-20c5e108f5e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:00.980058 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e815b03-1a57-4dbd-b2c8-20c5e108f5e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:00.980417 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e815b03-1a57-4dbd-b2c8-20c5e108f5e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:00.991130 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e815b03-1a57-4dbd-b2c8-20c5e108f5e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:00.992761 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e815b03-1a57-4dbd-b2c8-20c5e108f5e9 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:01.022894 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 830/1653] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:01.065120 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 824/1654] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 10 20:58:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:01.085948 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e815b03-1a57-4dbd-b2c8-20c5e108f5e9 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:01.099311 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e815b03-1a57-4dbd-b2c8-20c5e108f5e9 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:01.105472 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ceb157-8cb9-4f9c-adc0-4a900e351e48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:01.106598 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ceb157-8cb9-4f9c-adc0-4a900e351e48 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:01.106883 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ceb157-8cb9-4f9c-adc0-4a900e351e48 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:01.107155 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ceb157-8cb9-4f9c-adc0-4a900e351e48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:01.116762 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ceb157-8cb9-4f9c-adc0-4a900e351e48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:01.118383 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ceb157-8cb9-4f9c-adc0-4a900e351e48 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:01.133441 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 831/1655] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:02.643523 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1ffde-ecf6-4558-8b36-b401292ff051 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:02.645240 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3ba1ffde-ecf6-4558-8b36-b401292ff051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:02.822432 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1ffde-ecf6-4558-8b36-b401292ff051 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:02.845566 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16961095-4ddf-4344-9693-c270eff410ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f05eb88abe24af4825259712b497d48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:02.852648 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16961095-4ddf-4344-9693-c270eff410ce service placement] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:02.854640 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16961095-4ddf-4344-9693-c270eff410ce service placement] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:02.855036 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16961095-4ddf-4344-9693-c270eff410ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:02.865088 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-16961095-4ddf-4344-9693-c270eff410ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:02.912524 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16961095-4ddf-4344-9693-c270eff410ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:02.918397 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16961095-4ddf-4344-9693-c270eff410ce service placement] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:02.959780 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 825/1656] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:02.975673 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ceb157-8cb9-4f9c-adc0-4a900e351e48 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:02.977147 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-65ceb157-8cb9-4f9c-adc0-4a900e351e48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:03.005841 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ceb157-8cb9-4f9c-adc0-4a900e351e48 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:03.027750 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada125c-1c7b-476d-a160-c49727cee37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:03.028635 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada125c-1c7b-476d-a160-c49727cee37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:03.028913 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada125c-1c7b-476d-a160-c49727cee37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:03.029241 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada125c-1c7b-476d-a160-c49727cee37e admin admin] PATH_INFO: `/v3/projects/3408233aa5b94f9fa88c46a4922bb1c1` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:03.033855 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada125c-1c7b-476d-a160-c49727cee37e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3408233aa5b94f9fa88c46a4922bb1c1)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:03.060273 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada125c-1c7b-476d-a160-c49727cee37e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:03.170419 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-8ada125c-1c7b-476d-a160-c49727cee37e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3408233aa5b94f9fa88c46a4922bb1c1', 'request_id': 'req-8ada125c-1c7b-476d-a160-c49727cee37e'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:03.177660 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-8ada125c-1c7b-476d-a160-c49727cee37e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3408233aa5b94f9fa88c46a4922bb1c1', 'request_id': 'req-8ada125c-1c7b-476d-a160-c49727cee37e'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:03.185096 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-8ada125c-1c7b-476d-a160-c49727cee37e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3408233aa5b94f9fa88c46a4922bb1c1', 'request_id': 'req-8ada125c-1c7b-476d-a160-c49727cee37e'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:03.203048 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-8ada125c-1c7b-476d-a160-c49727cee37e admin admin] The token cache is being invalidate because project 3408233aa5b94f9fa88c46a4922bb1c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:03.203510 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-8ada125c-1c7b-476d-a160-c49727cee37e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:03.214815 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-8ada125c-1c7b-476d-a160-c49727cee37e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:03.217068 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 832/1657] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:02 2022] DELETE /identity/v3/projects/3408233aa5b94f9fa88c46a4922bb1c1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:03.222539 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f7a99-bf7d-4360-bc28-540f8e3552dd None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:03.222920 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f7a99-bf7d-4360-bc28-540f8e3552dd None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:03.223288 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f7a99-bf7d-4360-bc28-540f8e3552dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:03.254732 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-a10f7a99-bf7d-4360-bc28-540f8e3552dd None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:03.256923 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a10f7a99-bf7d-4360-bc28-540f8e3552dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:03.405120 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 826/1658] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:03.415349 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da09cc-2eb3-44b4-9711-ea100da3b5da None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:03.416093 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da09cc-2eb3-44b4-9711-ea100da3b5da None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:03.416519 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da09cc-2eb3-44b4-9711-ea100da3b5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:03.475066 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-84da09cc-2eb3-44b4-9711-ea100da3b5da None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:03.483518 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-84da09cc-2eb3-44b4-9711-ea100da3b5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:03.506691 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 833/1659] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:03.512274 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f7a99-bf7d-4360-bc28-540f8e3552dd None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:03.524887 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f7a99-bf7d-4360-bc28-540f8e3552dd None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:03.536926 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60784039-a285-4a0f-a8a2-a9503fa8b526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:03.537977 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60784039-a285-4a0f-a8a2-a9503fa8b526 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:03.539591 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60784039-a285-4a0f-a8a2-a9503fa8b526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:03.540159 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60784039-a285-4a0f-a8a2-a9503fa8b526 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:03.543109 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60784039-a285-4a0f-a8a2-a9503fa8b526 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:58:03.543669 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60784039-a285-4a0f-a8a2-a9503fa8b526 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:03.548399 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60784039-a285-4a0f-a8a2-a9503fa8b526 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:03.611780 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 827/1660] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:58:03.612589 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da09cc-2eb3-44b4-9711-ea100da3b5da None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:03.623804 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da09cc-2eb3-44b4-9711-ea100da3b5da None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:03.637018 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629329d-3ed7-40e0-a040-f391b0f03eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:03.638170 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629329d-3ed7-40e0-a040-f391b0f03eee admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:03.640686 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629329d-3ed7-40e0-a040-f391b0f03eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:03.641210 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629329d-3ed7-40e0-a040-f391b0f03eee admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:03.642214 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629329d-3ed7-40e0-a040-f391b0f03eee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:03.644456 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629329d-3ed7-40e0-a040-f391b0f03eee admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:03.705894 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 834/1661] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:03 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:58:03.710461 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60784039-a285-4a0f-a8a2-a9503fa8b526 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:03.734024 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60784039-a285-4a0f-a8a2-a9503fa8b526 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:03.922967 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143781ea-df78-47c5-a45b-8b685514db94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:03.922967 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143781ea-df78-47c5-a45b-8b685514db94 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:03.922967 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143781ea-df78-47c5-a45b-8b685514db94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:03.922967 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143781ea-df78-47c5-a45b-8b685514db94 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:03.923839 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143781ea-df78-47c5-a45b-8b685514db94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:03.934143 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143781ea-df78-47c5-a45b-8b685514db94 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:03.990885 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 828/1662] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:03 2022] POST /identity/v3/users => generated 291 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:03.996273 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629329d-3ed7-40e0-a040-f391b0f03eee admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:04.013172 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629329d-3ed7-40e0-a040-f391b0f03eee admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:04.028144 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55077a9f-6c5d-4cf1-bb1e-f16a2177bdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:04.031546 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55077a9f-6c5d-4cf1-bb1e-f16a2177bdec admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:04.033818 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55077a9f-6c5d-4cf1-bb1e-f16a2177bdec admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:04.034283 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55077a9f-6c5d-4cf1-bb1e-f16a2177bdec admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:04.035652 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55077a9f-6c5d-4cf1-bb1e-f16a2177bdec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:04.040690 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55077a9f-6c5d-4cf1-bb1e-f16a2177bdec admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:04.074510 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 835/1663] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:04.078974 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143781ea-df78-47c5-a45b-8b685514db94 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:04.096273 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143781ea-df78-47c5-a45b-8b685514db94 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:04.114160 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c0fad-7f53-41f6-8197-4a57cb8dd1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:04.116981 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c0fad-7f53-41f6-8197-4a57cb8dd1cd admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:04.117548 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c0fad-7f53-41f6-8197-4a57cb8dd1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:04.120287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c0fad-7f53-41f6-8197-4a57cb8dd1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:04.124912 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c0fad-7f53-41f6-8197-4a57cb8dd1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:04.134074 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c0fad-7f53-41f6-8197-4a57cb8dd1cd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:04.182545 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55077a9f-6c5d-4cf1-bb1e-f16a2177bdec admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:04.187968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 829/1664] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:04.194052 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55077a9f-6c5d-4cf1-bb1e-f16a2177bdec admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:04.214486 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa2da7-2c02-40a2-910e-f25ae69120f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:04.215423 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa2da7-2c02-40a2-910e-f25ae69120f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:04.215700 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa2da7-2c02-40a2-910e-f25ae69120f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:04.215971 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa2da7-2c02-40a2-910e-f25ae69120f9 admin admin] PATH_INFO: `/v3/projects/b4152a2d6b5b4d7996f77ec7f2bb342e/users/6d4e677fac834d70943bd6b5913f9055/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:04.269381 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa2da7-2c02-40a2-910e-f25ae69120f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4152a2d6b5b4d7996f77ec7f2bb342e, user_id=6d4e677fac834d70943bd6b5913f9055, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:04.272358 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa2da7-2c02-40a2-910e-f25ae69120f9 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:04.329112 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 836/1665] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:04 2022] PUT /identity/v3/projects/b4152a2d6b5b4d7996f77ec7f2bb342e/users/6d4e677fac834d70943bd6b5913f9055/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:04.341411 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a481b-af41-45ce-bb99-5a368812bcd1 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:04.341743 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a481b-af41-45ce-bb99-5a368812bcd1 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:04.342015 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a481b-af41-45ce-bb99-5a368812bcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:04.408598 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-712a481b-af41-45ce-bb99-5a368812bcd1 None None] MFA Rules not processed for user `6d4e677fac834d70943bd6b5913f9055`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:04.409859 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-712a481b-af41-45ce-bb99-5a368812bcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:04.618633 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 830/1666] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:04.623332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa2da7-2c02-40a2-910e-f25ae69120f9 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:04.737294 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa2da7-2c02-40a2-910e-f25ae69120f9 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:04.742189 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bb12c-222f-4690-8b9f-446a6e84dd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:04.742871 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bb12c-222f-4690-8b9f-446a6e84dd49 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:04.743148 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bb12c-222f-4690-8b9f-446a6e84dd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:04.743470 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bb12c-222f-4690-8b9f-446a6e84dd49 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:04.744184 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bb12c-222f-4690-8b9f-446a6e84dd49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:04.746483 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bb12c-222f-4690-8b9f-446a6e84dd49 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:04.788460 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 837/1667] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:04 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:04.793120 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a481b-af41-45ce-bb99-5a368812bcd1 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:04.814315 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a481b-af41-45ce-bb99-5a368812bcd1 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:04.909162 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074be25-0a41-4a2f-8fa8-6f9710986f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:04.910206 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074be25-0a41-4a2f-8fa8-6f9710986f8e admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:04.910644 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074be25-0a41-4a2f-8fa8-6f9710986f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:04.911074 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074be25-0a41-4a2f-8fa8-6f9710986f8e admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:04.912574 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074be25-0a41-4a2f-8fa8-6f9710986f8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:04.915210 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074be25-0a41-4a2f-8fa8-6f9710986f8e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:04.947307 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 831/1668] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:04 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:04.951889 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bb12c-222f-4690-8b9f-446a6e84dd49 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:04.970182 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bb12c-222f-4690-8b9f-446a6e84dd49 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:04.980056 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554ddbf-ca48-4c8a-b4e5-2eca63b283d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:04.980895 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554ddbf-ca48-4c8a-b4e5-2eca63b283d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:04.981175 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554ddbf-ca48-4c8a-b4e5-2eca63b283d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:04.981488 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554ddbf-ca48-4c8a-b4e5-2eca63b283d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:04.983824 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554ddbf-ca48-4c8a-b4e5-2eca63b283d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:04.985521 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554ddbf-ca48-4c8a-b4e5-2eca63b283d4 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:05.001954 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 838/1669] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:05.003224 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074be25-0a41-4a2f-8fa8-6f9710986f8e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:05.019554 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074be25-0a41-4a2f-8fa8-6f9710986f8e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:05.035003 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911923a-a768-4f7a-816b-7510c16121ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:05.035933 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911923a-a768-4f7a-816b-7510c16121ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:05.036211 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911923a-a768-4f7a-816b-7510c16121ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:05.036480 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911923a-a768-4f7a-816b-7510c16121ba admin admin] PATH_INFO: `/v3/projects/6dba4120d55f4175a21a663533c7f94c/users/dcc115d549b743598a84b95343627025/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:05.053766 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911923a-a768-4f7a-816b-7510c16121ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dba4120d55f4175a21a663533c7f94c, user_id=dcc115d549b743598a84b95343627025, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:05.056765 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911923a-a768-4f7a-816b-7510c16121ba admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:05.079508 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 832/1670] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:05 2022] PUT /identity/v3/projects/6dba4120d55f4175a21a663533c7f94c/users/dcc115d549b743598a84b95343627025/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:05.083557 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554ddbf-ca48-4c8a-b4e5-2eca63b283d4 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:05.097024 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554ddbf-ca48-4c8a-b4e5-2eca63b283d4 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:05.183902 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7f41f-cf78-4ebe-8525-5d6ee1b5e2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:05.185175 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7f41f-cf78-4ebe-8525-5d6ee1b5e2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:05.185685 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7f41f-cf78-4ebe-8525-5d6ee1b5e2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:05.186213 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7f41f-cf78-4ebe-8525-5d6ee1b5e2f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:05.187369 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7f41f-cf78-4ebe-8525-5d6ee1b5e2f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:05.189471 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7f41f-cf78-4ebe-8525-5d6ee1b5e2f1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:05.203064 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 839/1671] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:05.207253 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911923a-a768-4f7a-816b-7510c16121ba admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:05.227275 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911923a-a768-4f7a-816b-7510c16121ba admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:05.235555 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7248a-cbb7-4d86-bdd7-1527cbe3dcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:05.237714 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7248a-cbb7-4d86-bdd7-1527cbe3dcc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:05.238194 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7248a-cbb7-4d86-bdd7-1527cbe3dcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:05.238679 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7248a-cbb7-4d86-bdd7-1527cbe3dcc3 admin admin] PATH_INFO: `/v3/projects/6dba4120d55f4175a21a663533c7f94c/users/dcc115d549b743598a84b95343627025/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:05.241720 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7248a-cbb7-4d86-bdd7-1527cbe3dcc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dba4120d55f4175a21a663533c7f94c, user_id=dcc115d549b743598a84b95343627025, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:05.244961 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7248a-cbb7-4d86-bdd7-1527cbe3dcc3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:05.271527 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 833/1672] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:05 2022] PUT /identity/v3/projects/6dba4120d55f4175a21a663533c7f94c/users/dcc115d549b743598a84b95343627025/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:05.273678 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fecdc-b157-4a4c-b4ba-a52d50853b6c None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:05.274235 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fecdc-b157-4a4c-b4ba-a52d50853b6c None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:05.274734 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fecdc-b157-4a4c-b4ba-a52d50853b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:05.372405 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-ec9fecdc-b157-4a4c-b4ba-a52d50853b6c None None] MFA Rules not processed for user `dcc115d549b743598a84b95343627025`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:05.373844 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ec9fecdc-b157-4a4c-b4ba-a52d50853b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:05.552606 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 840/1673] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:05.561649 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7248a-cbb7-4d86-bdd7-1527cbe3dcc3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:05.564341 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a4c7248a-cbb7-4d86-bdd7-1527cbe3dcc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:05.710449 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7248a-cbb7-4d86-bdd7-1527cbe3dcc3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:05.726986 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2a889-88a8-4320-b419-b0749333c345 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:05.727662 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2a889-88a8-4320-b419-b0749333c345 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:05.727938 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2a889-88a8-4320-b419-b0749333c345 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:05.728208 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2a889-88a8-4320-b419-b0749333c345 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:05.747460 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2a889-88a8-4320-b419-b0749333c345 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:05.748933 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2a889-88a8-4320-b419-b0749333c345 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:05.777533 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 834/1674] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:06.384996 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fecdc-b157-4a4c-b4ba-a52d50853b6c None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:06.396722 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fecdc-b157-4a4c-b4ba-a52d50853b6c None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:06.404003 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f471fb-fb1b-46e1-85c9-bcd678eca68b tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc115d549b743598a84b95343627025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dba4120d55f4175a21a663533c7f94c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:06.405116 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f471fb-fb1b-46e1-85c9-bcd678eca68b tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:06.405645 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f471fb-fb1b-46e1-85c9-bcd678eca68b tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:06.406129 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f471fb-fb1b-46e1-85c9-bcd678eca68b tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:06.407153 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f471fb-fb1b-46e1-85c9-bcd678eca68b tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:58:06.407880 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f471fb-fb1b-46e1-85c9-bcd678eca68b tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:06.410278 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f471fb-fb1b-46e1-85c9-bcd678eca68b tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:06.426268 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 841/1675] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:58:06.430302 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2a889-88a8-4320-b419-b0749333c345 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:06.442960 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2a889-88a8-4320-b419-b0749333c345 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:06.449028 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3edd66-e15d-4444-9364-5fff4f847af5 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc115d549b743598a84b95343627025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dba4120d55f4175a21a663533c7f94c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:06.450481 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3edd66-e15d-4444-9364-5fff4f847af5 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:06.451402 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3edd66-e15d-4444-9364-5fff4f847af5 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:06.451857 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3edd66-e15d-4444-9364-5fff4f847af5 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:06.452798 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3edd66-e15d-4444-9364-5fff4f847af5 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:06.455755 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3edd66-e15d-4444-9364-5fff4f847af5 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:06.496051 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 835/1676] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:06 2022] POST /identity/v3/projects => generated 353 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:06.500764 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f471fb-fb1b-46e1-85c9-bcd678eca68b tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:06.517619 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f471fb-fb1b-46e1-85c9-bcd678eca68b tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:06.652741 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdd4f3-39a6-4d6f-9b5d-18ce19456c63 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc115d549b743598a84b95343627025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dba4120d55f4175a21a663533c7f94c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:06.655338 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdd4f3-39a6-4d6f-9b5d-18ce19456c63 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:06.655964 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdd4f3-39a6-4d6f-9b5d-18ce19456c63 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:06.656505 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdd4f3-39a6-4d6f-9b5d-18ce19456c63 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:06.658084 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acdd4f3-39a6-4d6f-9b5d-18ce19456c63 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:58:06.659651 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acdd4f3-39a6-4d6f-9b5d-18ce19456c63 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:06.663590 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acdd4f3-39a6-4d6f-9b5d-18ce19456c63 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:06.700004 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 842/1677] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:58:06.777213 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3edd66-e15d-4444-9364-5fff4f847af5 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:06.794125 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3edd66-e15d-4444-9364-5fff4f847af5 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:06.806068 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adceb00-4f8c-416f-8f7a-0148eef5d873 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc115d549b743598a84b95343627025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dba4120d55f4175a21a663533c7f94c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:06.807103 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adceb00-4f8c-416f-8f7a-0148eef5d873 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:06.811055 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adceb00-4f8c-416f-8f7a-0148eef5d873 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:06.811520 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adceb00-4f8c-416f-8f7a-0148eef5d873 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] PATH_INFO: `/v3/projects/9dcecbbd77ae47808b95c9609af95396` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:06.813167 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adceb00-4f8c-416f-8f7a-0148eef5d873 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9dcecbbd77ae47808b95c9609af95396)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:06.814430 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-1adceb00-4f8c-416f-8f7a-0148eef5d873 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 20:58:06.814430 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Feb 10 20:58:06.814430 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: Feb 10 20:58:06.816145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adceb00-4f8c-416f-8f7a-0148eef5d873 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:06.943787 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1adceb00-4f8c-416f-8f7a-0148eef5d873 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dcecbbd77ae47808b95c9609af95396', 'request_id': 'req-1adceb00-4f8c-416f-8f7a-0148eef5d873'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:06.962721 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1adceb00-4f8c-416f-8f7a-0148eef5d873 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dcecbbd77ae47808b95c9609af95396', 'request_id': 'req-1adceb00-4f8c-416f-8f7a-0148eef5d873'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:07.000493 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1adceb00-4f8c-416f-8f7a-0148eef5d873 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dcecbbd77ae47808b95c9609af95396', 'request_id': 'req-1adceb00-4f8c-416f-8f7a-0148eef5d873'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:07.030911 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1adceb00-4f8c-416f-8f7a-0148eef5d873 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] The token cache is being invalidate because project 9dcecbbd77ae47808b95c9609af95396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:07.031677 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1adceb00-4f8c-416f-8f7a-0148eef5d873 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:07.035748 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1adceb00-4f8c-416f-8f7a-0148eef5d873 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:07.042021 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 836/1678] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:06 2022] DELETE /identity/v3/projects/9dcecbbd77ae47808b95c9609af95396 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:07.487658 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdd4f3-39a6-4d6f-9b5d-18ce19456c63 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:07.498892 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-3acdd4f3-39a6-4d6f-9b5d-18ce19456c63 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:07.611450 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdd4f3-39a6-4d6f-9b5d-18ce19456c63 tempest-VolumeQuotaClassesTest-1542069365 tempest-VolumeQuotaClassesTest-1542069365-project-admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:07.740598 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a17bfc-38a4-4cef-8041-9fc13f0ca095 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:07.741208 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a17bfc-38a4-4cef-8041-9fc13f0ca095 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:07.741208 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a17bfc-38a4-4cef-8041-9fc13f0ca095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:07.832304 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-20a17bfc-38a4-4cef-8041-9fc13f0ca095 None None] MFA Rules not processed for user `d6a6f1ee4ac24e0481c4ee1bf8ddf897`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:07.835558 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-20a17bfc-38a4-4cef-8041-9fc13f0ca095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:07.878604 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b92e4c-d732-4aea-8e45-0f8c8ac2a8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:07.879508 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b92e4c-d732-4aea-8e45-0f8c8ac2a8e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:07.883962 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b92e4c-d732-4aea-8e45-0f8c8ac2a8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:07.883962 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b92e4c-d732-4aea-8e45-0f8c8ac2a8e9 admin admin] PATH_INFO: `/v3/users/6d4e677fac834d70943bd6b5913f9055` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:07.888523 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b92e4c-d732-4aea-8e45-0f8c8ac2a8e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d4e677fac834d70943bd6b5913f9055)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:07.890570 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b92e4c-d732-4aea-8e45-0f8c8ac2a8e9 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:08.040756 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 837/1679] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:08.052738 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-73b92e4c-d732-4aea-8e45-0f8c8ac2a8e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d4e677fac834d70943bd6b5913f9055'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:08.064230 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a17bfc-38a4-4cef-8041-9fc13f0ca095 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:08.064868 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-73b92e4c-d732-4aea-8e45-0f8c8ac2a8e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d4e677fac834d70943bd6b5913f9055'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:08.066885 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-20a17bfc-38a4-4cef-8041-9fc13f0ca095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:08.097697 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-73b92e4c-d732-4aea-8e45-0f8c8ac2a8e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d4e677fac834d70943bd6b5913f9055'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:08.098745 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-73b92e4c-d732-4aea-8e45-0f8c8ac2a8e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d4e677fac834d70943bd6b5913f9055'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:08.099364 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-73b92e4c-d732-4aea-8e45-0f8c8ac2a8e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d4e677fac834d70943bd6b5913f9055'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:08.125581 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 843/1680] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:07 2022] DELETE /identity/v3/users/6d4e677fac834d70943bd6b5913f9055 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:08.129862 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5580d-df48-481c-a7af-31e4875efe22 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:08.130148 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5580d-df48-481c-a7af-31e4875efe22 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:08.130417 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5580d-df48-481c-a7af-31e4875efe22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:08.165627 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-5bc5580d-df48-481c-a7af-31e4875efe22 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:08.166959 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-5bc5580d-df48-481c-a7af-31e4875efe22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:08.241401 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a17bfc-38a4-4cef-8041-9fc13f0ca095 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:08.300188 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 844/1681] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:08.318459 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5580d-df48-481c-a7af-31e4875efe22 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:08.319920 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-5bc5580d-df48-481c-a7af-31e4875efe22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:08.377629 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b858a-47bf-4bb6-9dd3-f544bb9b69af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:08.378677 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b858a-47bf-4bb6-9dd3-f544bb9b69af service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:08.379196 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b858a-47bf-4bb6-9dd3-f544bb9b69af service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:08.379854 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b858a-47bf-4bb6-9dd3-f544bb9b69af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:08.386047 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-537b858a-47bf-4bb6-9dd3-f544bb9b69af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:08.492627 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5580d-df48-481c-a7af-31e4875efe22 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:08.497283 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3f8dd-936a-46a5-9722-e35ca75fe72d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:08.498220 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3f8dd-936a-46a5-9722-e35ca75fe72d service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:08.498754 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3f8dd-936a-46a5-9722-e35ca75fe72d service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:08.499266 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3f8dd-936a-46a5-9722-e35ca75fe72d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:08.504306 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b858a-47bf-4bb6-9dd3-f544bb9b69af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:08.506044 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b858a-47bf-4bb6-9dd3-f544bb9b69af service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:08.528473 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3f8dd-936a-46a5-9722-e35ca75fe72d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:08.530133 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3f8dd-936a-46a5-9722-e35ca75fe72d service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:08.537455 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 838/1682] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:58:08.564037 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 845/1683] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:09.508283 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12282c82-a12c-438b-8899-53490b1e9bf0 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:09.508848 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12282c82-a12c-438b-8899-53490b1e9bf0 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:09.508848 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12282c82-a12c-438b-8899-53490b1e9bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:09.558113 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-12282c82-a12c-438b-8899-53490b1e9bf0 None None] MFA Rules not processed for user `edce3021d9e841b3b13c24b5a3c3c425`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:09.568878 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-12282c82-a12c-438b-8899-53490b1e9bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:09.694359 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 839/1684] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:09.694863 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e03102-93ea-4736-9e2b-479851a07507 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:09.695346 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e03102-93ea-4736-9e2b-479851a07507 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:09.695442 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e03102-93ea-4736-9e2b-479851a07507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:09.728880 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-20e03102-93ea-4736-9e2b-479851a07507 None None] MFA Rules not processed for user `edce3021d9e841b3b13c24b5a3c3c425`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:09.736589 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-20e03102-93ea-4736-9e2b-479851a07507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:09.756100 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 846/1685] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:09.768039 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12282c82-a12c-438b-8899-53490b1e9bf0 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:09.769579 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-12282c82-a12c-438b-8899-53490b1e9bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:09.801634 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e03102-93ea-4736-9e2b-479851a07507 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:09.803527 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12282c82-a12c-438b-8899-53490b1e9bf0 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:09.804730 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-20e03102-93ea-4736-9e2b-479851a07507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:09.824179 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38deb40-57fb-4b31-a79e-df3fecd24f14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:09.824808 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e03102-93ea-4736-9e2b-479851a07507 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:09.824929 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38deb40-57fb-4b31-a79e-df3fecd24f14 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:09.825120 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38deb40-57fb-4b31-a79e-df3fecd24f14 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:09.825470 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38deb40-57fb-4b31-a79e-df3fecd24f14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:09.837887 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38deb40-57fb-4b31-a79e-df3fecd24f14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:09.839592 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38deb40-57fb-4b31-a79e-df3fecd24f14 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:09.840107 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5231b3-5a9f-43eb-bda2-e0168fcbebae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:09.842467 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5231b3-5a9f-43eb-bda2-e0168fcbebae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:09.843652 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5231b3-5a9f-43eb-bda2-e0168fcbebae admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:09.844534 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5231b3-5a9f-43eb-bda2-e0168fcbebae admin admin] PATH_INFO: `/v3/projects/b4152a2d6b5b4d7996f77ec7f2bb342e` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:09.846542 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5231b3-5a9f-43eb-bda2-e0168fcbebae admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4152a2d6b5b4d7996f77ec7f2bb342e)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:09.851797 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5231b3-5a9f-43eb-bda2-e0168fcbebae admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:09.867235 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 840/1686] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:09.868400 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771c662-47d3-4541-aff4-e911011284be None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:09.868685 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771c662-47d3-4541-aff4-e911011284be None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:09.868956 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771c662-47d3-4541-aff4-e911011284be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:09.914659 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-1771c662-47d3-4541-aff4-e911011284be None None] MFA Rules not processed for user `54f6015a565b4a5eb74ec571f8774bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:09.916121 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1771c662-47d3-4541-aff4-e911011284be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:09.923778 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-1b5231b3-5a9f-43eb-bda2-e0168fcbebae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4152a2d6b5b4d7996f77ec7f2bb342e', 'request_id': 'req-1b5231b3-5a9f-43eb-bda2-e0168fcbebae'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:09.936613 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-1b5231b3-5a9f-43eb-bda2-e0168fcbebae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4152a2d6b5b4d7996f77ec7f2bb342e', 'request_id': 'req-1b5231b3-5a9f-43eb-bda2-e0168fcbebae'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:09.945884 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-1b5231b3-5a9f-43eb-bda2-e0168fcbebae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4152a2d6b5b4d7996f77ec7f2bb342e', 'request_id': 'req-1b5231b3-5a9f-43eb-bda2-e0168fcbebae'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:09.976407 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-1b5231b3-5a9f-43eb-bda2-e0168fcbebae admin admin] The token cache is being invalidate because project b4152a2d6b5b4d7996f77ec7f2bb342e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:09.976638 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-1b5231b3-5a9f-43eb-bda2-e0168fcbebae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:09.980622 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-1b5231b3-5a9f-43eb-bda2-e0168fcbebae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:09.987619 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 847/1687] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:09 2022] DELETE /identity/v3/projects/b4152a2d6b5b4d7996f77ec7f2bb342e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:09.988584 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5231b3-5a9f-43eb-bda2-e0168fcbebae admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:10.007006 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-1b5231b3-5a9f-43eb-bda2-e0168fcbebae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:10.097649 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5231b3-5a9f-43eb-bda2-e0168fcbebae admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:10.104215 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e7d49-de21-4473-991d-497f4054d8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:10.106303 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e7d49-de21-4473-991d-497f4054d8d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:10.106880 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e7d49-de21-4473-991d-497f4054d8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:10.107253 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e7d49-de21-4473-991d-497f4054d8d1 admin admin] PATH_INFO: `/v3/users/dcc115d549b743598a84b95343627025` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:10.113770 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e7d49-de21-4473-991d-497f4054d8d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcc115d549b743598a84b95343627025)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:10.116350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e7d49-de21-4473-991d-497f4054d8d1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:10.135421 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 841/1688] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:10.227412 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-5a8e7d49-de21-4473-991d-497f4054d8d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcc115d549b743598a84b95343627025'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:10.239614 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-5a8e7d49-de21-4473-991d-497f4054d8d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcc115d549b743598a84b95343627025'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:10.268681 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-5a8e7d49-de21-4473-991d-497f4054d8d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcc115d549b743598a84b95343627025'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:10.269740 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-5a8e7d49-de21-4473-991d-497f4054d8d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcc115d549b743598a84b95343627025'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:10.270533 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-5a8e7d49-de21-4473-991d-497f4054d8d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcc115d549b743598a84b95343627025'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:10.321574 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 848/1689] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:09 2022] DELETE /identity/v3/users/dcc115d549b743598a84b95343627025 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:10.333679 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771c662-47d3-4541-aff4-e911011284be None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:10.335229 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1771c662-47d3-4541-aff4-e911011284be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:10.531439 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771c662-47d3-4541-aff4-e911011284be None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:10.557457 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cd422-b644-4146-9f1b-b49f74dfdb44 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:10.557457 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cd422-b644-4146-9f1b-b49f74dfdb44 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:10.557613 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cd422-b644-4146-9f1b-b49f74dfdb44 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:10.559882 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 849/1690] 10.222.0.31 () {54 vars in 912 bytes} [Thu Feb 10 20:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:58:10.569429 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa1563-7036-49f1-ac4b-8cda72dbd9a7 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:10.569712 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa1563-7036-49f1-ac4b-8cda72dbd9a7 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:10.569995 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa1563-7036-49f1-ac4b-8cda72dbd9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:10.604180 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-06fa1563-7036-49f1-ac4b-8cda72dbd9a7 None None] MFA Rules not processed for user `b07a9ae7262b44ce88e1338c83360356`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:10.607176 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-06fa1563-7036-49f1-ac4b-8cda72dbd9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:10.687207 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c9c53-7608-4c4c-92ec-73db2ac3cdbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:10.687875 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c9c53-7608-4c4c-92ec-73db2ac3cdbe service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:10.688300 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c9c53-7608-4c4c-92ec-73db2ac3cdbe service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:10.688572 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c9c53-7608-4c4c-92ec-73db2ac3cdbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:10.698497 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-479c9c53-7608-4c4c-92ec-73db2ac3cdbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:10.722041 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 850/1691] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 10 20:58:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:10.747408 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa1563-7036-49f1-ac4b-8cda72dbd9a7 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:10.748836 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-06fa1563-7036-49f1-ac4b-8cda72dbd9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:10.771695 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa1563-7036-49f1-ac4b-8cda72dbd9a7 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:10.783204 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e560bc6-aa47-4cae-b87a-0d981fd34b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:10.787302 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e560bc6-aa47-4cae-b87a-0d981fd34b1c service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:10.787596 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e560bc6-aa47-4cae-b87a-0d981fd34b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:10.787874 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e560bc6-aa47-4cae-b87a-0d981fd34b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:10.809434 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e560bc6-aa47-4cae-b87a-0d981fd34b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:10.814698 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e560bc6-aa47-4cae-b87a-0d981fd34b1c service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:10.841802 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 851/1692] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:10.848595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c9c53-7608-4c4c-92ec-73db2ac3cdbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:10.850261 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c9c53-7608-4c4c-92ec-73db2ac3cdbe service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:10.866700 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 842/1693] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:11.005147 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e560bc6-aa47-4cae-b87a-0d981fd34b1c service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:11.006694 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-1e560bc6-aa47-4cae-b87a-0d981fd34b1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:11.148921 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e560bc6-aa47-4cae-b87a-0d981fd34b1c service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:11.158263 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62348d9a-d0c7-4447-ba4e-39c595e13ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:11.159479 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62348d9a-d0c7-4447-ba4e-39c595e13ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:11.160588 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62348d9a-d0c7-4447-ba4e-39c595e13ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:11.161253 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62348d9a-d0c7-4447-ba4e-39c595e13ecf admin admin] PATH_INFO: `/v3/projects/6dba4120d55f4175a21a663533c7f94c` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:11.178286 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62348d9a-d0c7-4447-ba4e-39c595e13ecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dba4120d55f4175a21a663533c7f94c)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:11.180767 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62348d9a-d0c7-4447-ba4e-39c595e13ecf admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:11.288680 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-62348d9a-d0c7-4447-ba4e-39c595e13ecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dba4120d55f4175a21a663533c7f94c', 'request_id': 'req-62348d9a-d0c7-4447-ba4e-39c595e13ecf'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:11.303174 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-62348d9a-d0c7-4447-ba4e-39c595e13ecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dba4120d55f4175a21a663533c7f94c', 'request_id': 'req-62348d9a-d0c7-4447-ba4e-39c595e13ecf'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:11.318685 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-62348d9a-d0c7-4447-ba4e-39c595e13ecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dba4120d55f4175a21a663533c7f94c', 'request_id': 'req-62348d9a-d0c7-4447-ba4e-39c595e13ecf'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:11.350229 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-62348d9a-d0c7-4447-ba4e-39c595e13ecf admin admin] The token cache is being invalidate because project 6dba4120d55f4175a21a663533c7f94c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:11.350793 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-62348d9a-d0c7-4447-ba4e-39c595e13ecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:11.352805 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-62348d9a-d0c7-4447-ba4e-39c595e13ecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:11.354742 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 852/1694] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:11 2022] DELETE /identity/v3/projects/6dba4120d55f4175a21a663533c7f94c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:11.362144 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e5311-e83b-4249-b458-4ebfeec149bb None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:11.362564 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e5311-e83b-4249-b458-4ebfeec149bb None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:11.362965 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e5311-e83b-4249-b458-4ebfeec149bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:11.399632 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-905e5311-e83b-4249-b458-4ebfeec149bb None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:11.407108 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-905e5311-e83b-4249-b458-4ebfeec149bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:11.539315 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 843/1695] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:11.547108 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab06a2a-0ff5-498f-b882-6b94b0a6c9b5 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:11.547704 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab06a2a-0ff5-498f-b882-6b94b0a6c9b5 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:11.548129 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab06a2a-0ff5-498f-b882-6b94b0a6c9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:11.583515 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-7ab06a2a-0ff5-498f-b882-6b94b0a6c9b5 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:11.584921 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-7ab06a2a-0ff5-498f-b882-6b94b0a6c9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:11.608886 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 853/1696] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:11.613274 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e5311-e83b-4249-b458-4ebfeec149bb None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:11.623737 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e5311-e83b-4249-b458-4ebfeec149bb None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:11.646399 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00516bf-cd21-42a4-8e58-f1c169f22d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:11.647781 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00516bf-cd21-42a4-8e58-f1c169f22d8b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:11.648123 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00516bf-cd21-42a4-8e58-f1c169f22d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:11.648386 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00516bf-cd21-42a4-8e58-f1c169f22d8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:11.649198 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00516bf-cd21-42a4-8e58-f1c169f22d8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:58:11.649570 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00516bf-cd21-42a4-8e58-f1c169f22d8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:11.651344 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00516bf-cd21-42a4-8e58-f1c169f22d8b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:11.677651 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab06a2a-0ff5-498f-b882-6b94b0a6c9b5 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:11.686916 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 844/1697] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:58:11.687223 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab06a2a-0ff5-498f-b882-6b94b0a6c9b5 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:11.722599 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf05c3-afbb-4b42-b13e-bb0227403981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:11.723965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf05c3-afbb-4b42-b13e-bb0227403981 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:11.725515 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf05c3-afbb-4b42-b13e-bb0227403981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:11.731318 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf05c3-afbb-4b42-b13e-bb0227403981 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:11.732993 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf05c3-afbb-4b42-b13e-bb0227403981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:11.739325 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf05c3-afbb-4b42-b13e-bb0227403981 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:11.788336 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 854/1698] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:11 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:58:11.792799 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00516bf-cd21-42a4-8e58-f1c169f22d8b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:11.803100 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00516bf-cd21-42a4-8e58-f1c169f22d8b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:11.847964 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1b079-8349-451d-a9a9-a830620ace6b None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:11.848244 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1b079-8349-451d-a9a9-a830620ace6b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:11.848814 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1b079-8349-451d-a9a9-a830620ace6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:11.908114 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-48f1b079-8349-451d-a9a9-a830620ace6b None None] MFA Rules not processed for user `edce3021d9e841b3b13c24b5a3c3c425`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:11.910774 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-48f1b079-8349-451d-a9a9-a830620ace6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:12.027954 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecd329-ebf0-440f-a0e8-0c54df5fc564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:12.028660 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecd329-ebf0-440f-a0e8-0c54df5fc564 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:12.028939 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecd329-ebf0-440f-a0e8-0c54df5fc564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:12.029211 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecd329-ebf0-440f-a0e8-0c54df5fc564 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:12.029950 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecd329-ebf0-440f-a0e8-0c54df5fc564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:12.032275 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecd329-ebf0-440f-a0e8-0c54df5fc564 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:12.072895 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 845/1699] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:11 2022] POST /identity/v3/users => generated 284 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:12.082827 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecd329-ebf0-440f-a0e8-0c54df5fc564 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:12.111006 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecd329-ebf0-440f-a0e8-0c54df5fc564 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:12.127283 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 855/1700] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:12.145314 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f470ce7-77e7-4b25-9351-dff649c13079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:12.146304 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f470ce7-77e7-4b25-9351-dff649c13079 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:12.146720 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f470ce7-77e7-4b25-9351-dff649c13079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:12.147152 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f470ce7-77e7-4b25-9351-dff649c13079 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:12.148086 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f470ce7-77e7-4b25-9351-dff649c13079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:12.155267 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f470ce7-77e7-4b25-9351-dff649c13079 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:12.195658 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 846/1701] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 20:58:12.201313 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1b079-8349-451d-a9a9-a830620ace6b None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:12.219818 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1b079-8349-451d-a9a9-a830620ace6b None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:12.225888 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ea11a-acf5-43d0-8edc-7c928341275c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:12.236347 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ea11a-acf5-43d0-8edc-7c928341275c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:12.238796 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da629b86-c6db-4940-b78d-b471ac5f9ea5 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:12.239098 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da629b86-c6db-4940-b78d-b471ac5f9ea5 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:12.239197 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ea11a-acf5-43d0-8edc-7c928341275c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:12.239294 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da629b86-c6db-4940-b78d-b471ac5f9ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:12.239429 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ea11a-acf5-43d0-8edc-7c928341275c admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:12.243213 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ea11a-acf5-43d0-8edc-7c928341275c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:12.244894 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ea11a-acf5-43d0-8edc-7c928341275c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:12.289644 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-da629b86-c6db-4940-b78d-b471ac5f9ea5 None None] MFA Rules not processed for user `d6a6f1ee4ac24e0481c4ee1bf8ddf897`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:12.293077 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-da629b86-c6db-4940-b78d-b471ac5f9ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:12.296856 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 856/1702] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:12.303765 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ea11a-acf5-43d0-8edc-7c928341275c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:12.317825 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ea11a-acf5-43d0-8edc-7c928341275c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:12.345137 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b14b3f-311a-4f37-94cb-4842d5bd4e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:12.345137 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b14b3f-311a-4f37-94cb-4842d5bd4e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:12.347484 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b14b3f-311a-4f37-94cb-4842d5bd4e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:12.347760 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b14b3f-311a-4f37-94cb-4842d5bd4e2c admin admin] PATH_INFO: `/v3/projects/1b6d6f94d12a45d5913c2ea77cd085ef/users/2a5f0bf7dc7d4b519bae40241a5f9a54/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:12.421990 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b14b3f-311a-4f37-94cb-4842d5bd4e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6d6f94d12a45d5913c2ea77cd085ef, user_id=2a5f0bf7dc7d4b519bae40241a5f9a54, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:12.425101 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b14b3f-311a-4f37-94cb-4842d5bd4e2c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:12.493148 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 857/1703] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:12 2022] PUT /identity/v3/projects/1b6d6f94d12a45d5913c2ea77cd085ef/users/2a5f0bf7dc7d4b519bae40241a5f9a54/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:12.517438 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdbed5-131f-4e3c-8ae8-5234193d8fef None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:12.517713 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdbed5-131f-4e3c-8ae8-5234193d8fef None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:12.517973 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdbed5-131f-4e3c-8ae8-5234193d8fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:12.610004 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 847/1704] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:12.633312 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-05cdbed5-131f-4e3c-8ae8-5234193d8fef None None] MFA Rules not processed for user `2a5f0bf7dc7d4b519bae40241a5f9a54`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:12.636158 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-05cdbed5-131f-4e3c-8ae8-5234193d8fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:12.855910 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 858/1705] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:12.857739 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da629b86-c6db-4940-b78d-b471ac5f9ea5 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:12.878735 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da629b86-c6db-4940-b78d-b471ac5f9ea5 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:13.022116 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad504e-dd32-4092-b3e0-6106180f8323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:13.023040 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad504e-dd32-4092-b3e0-6106180f8323 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:13.023474 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad504e-dd32-4092-b3e0-6106180f8323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:13.024305 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad504e-dd32-4092-b3e0-6106180f8323 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:13.025487 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad504e-dd32-4092-b3e0-6106180f8323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:13.030737 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad504e-dd32-4092-b3e0-6106180f8323 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:13.072030 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2fde3-0067-42b5-b3c7-0a8a73f0b723 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:13.072308 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2fde3-0067-42b5-b3c7-0a8a73f0b723 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:13.072577 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2fde3-0067-42b5-b3c7-0a8a73f0b723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:13.080904 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 848/1706] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:12 2022] POST /identity/v3/projects => generated 365 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:13.082543 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad504e-dd32-4092-b3e0-6106180f8323 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:13.116088 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-5fa2fde3-0067-42b5-b3c7-0a8a73f0b723 None None] MFA Rules not processed for user `de790a1a69994f7498834ded10480e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:13.117327 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-5fa2fde3-0067-42b5-b3c7-0a8a73f0b723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:13.240286 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad504e-dd32-4092-b3e0-6106180f8323 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:13.253215 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70d994-2231-4b98-b5c6-678467312884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:13.254210 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70d994-2231-4b98-b5c6-678467312884 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:13.254631 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70d994-2231-4b98-b5c6-678467312884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:13.255039 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70d994-2231-4b98-b5c6-678467312884 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:13.255884 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70d994-2231-4b98-b5c6-678467312884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:13.257988 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70d994-2231-4b98-b5c6-678467312884 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:13.268648 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 859/1707] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 10 20:58:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:13.308746 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 849/1708] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:13 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:13.313852 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2fde3-0067-42b5-b3c7-0a8a73f0b723 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:13.348875 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2fde3-0067-42b5-b3c7-0a8a73f0b723 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:13.360482 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2863dca-3f60-4326-bd23-8aacf30a1141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:13.364378 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2863dca-3f60-4326-bd23-8aacf30a1141 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:13.370585 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2863dca-3f60-4326-bd23-8aacf30a1141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:13.372509 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2863dca-3f60-4326-bd23-8aacf30a1141 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:13.374368 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2863dca-3f60-4326-bd23-8aacf30a1141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:13.377633 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2863dca-3f60-4326-bd23-8aacf30a1141 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:13.409342 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 860/1709] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:13.413973 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70d994-2231-4b98-b5c6-678467312884 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:13.427956 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70d994-2231-4b98-b5c6-678467312884 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:13.444145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f31044-e499-4771-9dfa-edda29c54b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:13.444971 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f31044-e499-4771-9dfa-edda29c54b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:13.445238 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f31044-e499-4771-9dfa-edda29c54b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:13.445689 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f31044-e499-4771-9dfa-edda29c54b04 admin admin] PATH_INFO: `/v3/projects/54533d98c8284f428054166c67612bb5/users/0faaa457de354f9ebee6c54cfdee7b26/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:13.483011 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f31044-e499-4771-9dfa-edda29c54b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54533d98c8284f428054166c67612bb5, user_id=0faaa457de354f9ebee6c54cfdee7b26, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:13.486849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f31044-e499-4771-9dfa-edda29c54b04 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:13.515794 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 850/1710] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:13 2022] PUT /identity/v3/projects/54533d98c8284f428054166c67612bb5/users/0faaa457de354f9ebee6c54cfdee7b26/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:13.520045 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2863dca-3f60-4326-bd23-8aacf30a1141 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:13.537203 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2863dca-3f60-4326-bd23-8aacf30a1141 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:13.618672 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f31044-e499-4771-9dfa-edda29c54b04 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:13.620540 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e2f31044-e499-4771-9dfa-edda29c54b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:13.794650 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eee832-6e24-4832-8814-565afa106d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:13.796626 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eee832-6e24-4832-8814-565afa106d85 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:13.797035 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eee832-6e24-4832-8814-565afa106d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:13.797463 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eee832-6e24-4832-8814-565afa106d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:13.798439 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eee832-6e24-4832-8814-565afa106d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:13.801504 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eee832-6e24-4832-8814-565afa106d85 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:13.822511 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 861/1711] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:13.823602 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eee832-6e24-4832-8814-565afa106d85 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:13.852811 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eee832-6e24-4832-8814-565afa106d85 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:13.862206 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f31044-e499-4771-9dfa-edda29c54b04 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:13.868328 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77ffb6-96f2-4395-af1e-c5ce38f35d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:13.869000 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f50de6-d09c-4b58-9615-9f3735167da4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f09689635e54a4e85c0ef0e3539d911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:13.869917 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f50de6-d09c-4b58-9615-9f3735167da4 service swift] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:13.870089 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77ffb6-96f2-4395-af1e-c5ce38f35d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:13.870370 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77ffb6-96f2-4395-af1e-c5ce38f35d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:13.871201 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77ffb6-96f2-4395-af1e-c5ce38f35d7b admin admin] PATH_INFO: `/v3/projects/54533d98c8284f428054166c67612bb5/users/0faaa457de354f9ebee6c54cfdee7b26/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:13.871590 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f50de6-d09c-4b58-9615-9f3735167da4 service swift] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:13.871997 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f50de6-d09c-4b58-9615-9f3735167da4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:13.873318 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77ffb6-96f2-4395-af1e-c5ce38f35d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=54533d98c8284f428054166c67612bb5, user_id=0faaa457de354f9ebee6c54cfdee7b26, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:13.878341 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77ffb6-96f2-4395-af1e-c5ce38f35d7b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:13.904719 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 862/1712] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:13 2022] PUT /identity/v3/projects/54533d98c8284f428054166c67612bb5/users/0faaa457de354f9ebee6c54cfdee7b26/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:13.922513 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745d242-b314-43b4-b3f8-a986001c04cc None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:13.922806 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745d242-b314-43b4-b3f8-a986001c04cc None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:13.923084 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745d242-b314-43b4-b3f8-a986001c04cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:13.983545 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f50de6-d09c-4b58-9615-9f3735167da4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:13.986594 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f50de6-d09c-4b58-9615-9f3735167da4 service swift] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:14.026010 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 851/1713] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 10 20:58:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 20:58:14.047623 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-5745d242-b314-43b4-b3f8-a986001c04cc None None] MFA Rules not processed for user `0faaa457de354f9ebee6c54cfdee7b26`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:14.054983 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-5745d242-b314-43b4-b3f8-a986001c04cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:14.322562 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 863/1714] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:14.402392 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f50de6-d09c-4b58-9615-9f3735167da4 service swift] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:14.409834 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-81f50de6-d09c-4b58-9615-9f3735167da4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:14.586471 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f50de6-d09c-4b58-9615-9f3735167da4 service swift] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:14.797562 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a60d2-6113-4445-b3f3-8de7f90c3af2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:14.798274 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a60d2-6113-4445-b3f3-8de7f90c3af2 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:14.798512 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a60d2-6113-4445-b3f3-8de7f90c3af2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:14.798781 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a60d2-6113-4445-b3f3-8de7f90c3af2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:14.854273 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a60d2-6113-4445-b3f3-8de7f90c3af2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:14.869398 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a60d2-6113-4445-b3f3-8de7f90c3af2 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:14.933505 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 852/1715] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:15.251567 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745d242-b314-43b4-b3f8-a986001c04cc None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:15.253734 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-5745d242-b314-43b4-b3f8-a986001c04cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:15.288820 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745d242-b314-43b4-b3f8-a986001c04cc None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:15.306544 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6da11-c59d-4592-8f5c-555a6aee5823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:15.310988 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6da11-c59d-4592-8f5c-555a6aee5823 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:15.311275 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6da11-c59d-4592-8f5c-555a6aee5823 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:15.311546 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6da11-c59d-4592-8f5c-555a6aee5823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:15.491088 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6da11-c59d-4592-8f5c-555a6aee5823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:15.493005 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6da11-c59d-4592-8f5c-555a6aee5823 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:15.508211 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 864/1716] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:16.162879 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33928a64-3b44-40a2-aefa-6c0f1212ea74 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:16.163397 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33928a64-3b44-40a2-aefa-6c0f1212ea74 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:16.163486 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33928a64-3b44-40a2-aefa-6c0f1212ea74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:16.243697 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-33928a64-3b44-40a2-aefa-6c0f1212ea74 None None] MFA Rules not processed for user `54f6015a565b4a5eb74ec571f8774bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:16.244720 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-33928a64-3b44-40a2-aefa-6c0f1212ea74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:16.416379 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 853/1717] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:23.814812 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6da11-c59d-4592-8f5c-555a6aee5823 service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:23.816905 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-8db6da11-c59d-4592-8f5c-555a6aee5823 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:23.953762 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6da11-c59d-4592-8f5c-555a6aee5823 service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:23.959828 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76799dc2-9e19-45ba-8d92-bd3d0d1e2dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:23.961197 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76799dc2-9e19-45ba-8d92-bd3d0d1e2dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:23.961755 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76799dc2-9e19-45ba-8d92-bd3d0d1e2dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:23.962138 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76799dc2-9e19-45ba-8d92-bd3d0d1e2dbc admin admin] PATH_INFO: `/v3/users/ad654c90e73c45578f77bf89c2a08423` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:23.964361 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76799dc2-9e19-45ba-8d92-bd3d0d1e2dbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad654c90e73c45578f77bf89c2a08423)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:23.966802 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76799dc2-9e19-45ba-8d92-bd3d0d1e2dbc admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:24.086258 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-76799dc2-9e19-45ba-8d92-bd3d0d1e2dbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad654c90e73c45578f77bf89c2a08423'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:24.097463 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-76799dc2-9e19-45ba-8d92-bd3d0d1e2dbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad654c90e73c45578f77bf89c2a08423'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:24.112752 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-76799dc2-9e19-45ba-8d92-bd3d0d1e2dbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad654c90e73c45578f77bf89c2a08423'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:24.113843 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-76799dc2-9e19-45ba-8d92-bd3d0d1e2dbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad654c90e73c45578f77bf89c2a08423'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:24.114793 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-76799dc2-9e19-45ba-8d92-bd3d0d1e2dbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad654c90e73c45578f77bf89c2a08423'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:24.143295 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 865/1718] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:23 2022] DELETE /identity/v3/users/ad654c90e73c45578f77bf89c2a08423 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:24.149729 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c7cc5-ec12-4df0-aa60-5b2f6680f36f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:24.150621 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c7cc5-ec12-4df0-aa60-5b2f6680f36f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:24.151087 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c7cc5-ec12-4df0-aa60-5b2f6680f36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:24.174308 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-176c7cc5-ec12-4df0-aa60-5b2f6680f36f None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:24.175833 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-176c7cc5-ec12-4df0-aa60-5b2f6680f36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:24.242132 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76799dc2-9e19-45ba-8d92-bd3d0d1e2dbc admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:24.243554 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-76799dc2-9e19-45ba-8d92-bd3d0d1e2dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:24.251782 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 854/1719] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:24.266440 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c7cc5-ec12-4df0-aa60-5b2f6680f36f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:24.268398 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76799dc2-9e19-45ba-8d92-bd3d0d1e2dbc admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:24.269212 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-176c7cc5-ec12-4df0-aa60-5b2f6680f36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:24.291450 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0ee04-c84c-497c-9885-957186fcc7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:24.293284 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0ee04-c84c-497c-9885-957186fcc7f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:24.293284 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0ee04-c84c-497c-9885-957186fcc7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:24.294464 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0ee04-c84c-497c-9885-957186fcc7f6 admin admin] PATH_INFO: `/v3/users/90e1e089c82b493bba4324948b5c5f82` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:24.300229 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0ee04-c84c-497c-9885-957186fcc7f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e1e089c82b493bba4324948b5c5f82)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:24.309661 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0ee04-c84c-497c-9885-957186fcc7f6 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:24.384614 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c7cc5-ec12-4df0-aa60-5b2f6680f36f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:24.401595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c4b89-b150-45da-ad69-c032954ff0c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:24.401595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c4b89-b150-45da-ad69-c032954ff0c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:24.401595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c4b89-b150-45da-ad69-c032954ff0c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:24.401595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c4b89-b150-45da-ad69-c032954ff0c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:24.407166 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-89d0ee04-c84c-497c-9885-957186fcc7f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e1e089c82b493bba4324948b5c5f82'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:24.415638 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-89d0ee04-c84c-497c-9885-957186fcc7f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e1e089c82b493bba4324948b5c5f82'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:24.430020 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-89d0ee04-c84c-497c-9885-957186fcc7f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e1e089c82b493bba4324948b5c5f82'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:24.431034 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-89d0ee04-c84c-497c-9885-957186fcc7f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e1e089c82b493bba4324948b5c5f82'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:24.431614 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c4b89-b150-45da-ad69-c032954ff0c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:24.431895 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-89d0ee04-c84c-497c-9885-957186fcc7f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e1e089c82b493bba4324948b5c5f82'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:24.434338 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c4b89-b150-45da-ad69-c032954ff0c9 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:24.451575 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 855/1720] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:24.460442 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 866/1721] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:24 2022] DELETE /identity/v3/users/90e1e089c82b493bba4324948b5c5f82 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:24.465914 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328eebb-839f-4e39-bf6f-76cdb0bdd4f9 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:24.466282 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328eebb-839f-4e39-bf6f-76cdb0bdd4f9 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:24.466627 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328eebb-839f-4e39-bf6f-76cdb0bdd4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:24.505550 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-0328eebb-839f-4e39-bf6f-76cdb0bdd4f9 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:24.507269 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0328eebb-839f-4e39-bf6f-76cdb0bdd4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:24.610148 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 856/1722] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:24.617776 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0ee04-c84c-497c-9885-957186fcc7f6 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:24.619356 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-89d0ee04-c84c-497c-9885-957186fcc7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:24.751740 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0ee04-c84c-497c-9885-957186fcc7f6 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:24.756167 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66ae54-8a1b-49af-a76f-fc6e0b00c568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:24.756978 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66ae54-8a1b-49af-a76f-fc6e0b00c568 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:24.757253 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66ae54-8a1b-49af-a76f-fc6e0b00c568 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:24.757850 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66ae54-8a1b-49af-a76f-fc6e0b00c568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:24.778293 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66ae54-8a1b-49af-a76f-fc6e0b00c568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:24.779837 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66ae54-8a1b-49af-a76f-fc6e0b00c568 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:24.805606 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 867/1723] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:24.896356 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787888c7-b08f-4844-b8ed-c14aa435110c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:24.897304 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787888c7-b08f-4844-b8ed-c14aa435110c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:24.898206 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787888c7-b08f-4844-b8ed-c14aa435110c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:24.947135 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-787888c7-b08f-4844-b8ed-c14aa435110c None None] MFA Rules not processed for user `b07a9ae7262b44ce88e1338c83360356`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:24.955310 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-787888c7-b08f-4844-b8ed-c14aa435110c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:24.992256 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 857/1724] 10.222.0.42 () {58 vars in 1015 bytes} [Thu Feb 10 20:58:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:25.013484 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66ae54-8a1b-49af-a76f-fc6e0b00c568 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:25.020298 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-5e66ae54-8a1b-49af-a76f-fc6e0b00c568 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:25.042835 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787888c7-b08f-4844-b8ed-c14aa435110c None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:25.061418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66ae54-8a1b-49af-a76f-fc6e0b00c568 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:25.064902 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787888c7-b08f-4844-b8ed-c14aa435110c None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:25.074200 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab365911-b9cf-470a-be43-5ae614155469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:25.078204 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab365911-b9cf-470a-be43-5ae614155469 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:25.078765 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab365911-b9cf-470a-be43-5ae614155469 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:25.078765 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab365911-b9cf-470a-be43-5ae614155469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:25.132551 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab365911-b9cf-470a-be43-5ae614155469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:25.132551 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab365911-b9cf-470a-be43-5ae614155469 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:25.136680 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862bf44-442b-4811-82b8-aeb959165e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:25.137984 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862bf44-442b-4811-82b8-aeb959165e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:25.142595 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862bf44-442b-4811-82b8-aeb959165e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:25.143130 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862bf44-442b-4811-82b8-aeb959165e5f admin admin] PATH_INFO: `/v3/projects/f8a1aecb2fbd45cbb03e4cb2c7555e4a` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:25.148333 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 858/1725] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:58:25.149541 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862bf44-442b-4811-82b8-aeb959165e5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8a1aecb2fbd45cbb03e4cb2c7555e4a)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:25.163436 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862bf44-442b-4811-82b8-aeb959165e5f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:25.308457 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0862bf44-442b-4811-82b8-aeb959165e5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a1aecb2fbd45cbb03e4cb2c7555e4a', 'request_id': 'req-0862bf44-442b-4811-82b8-aeb959165e5f'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:25.338092 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0862bf44-442b-4811-82b8-aeb959165e5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a1aecb2fbd45cbb03e4cb2c7555e4a', 'request_id': 'req-0862bf44-442b-4811-82b8-aeb959165e5f'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:25.365226 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0862bf44-442b-4811-82b8-aeb959165e5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a1aecb2fbd45cbb03e4cb2c7555e4a', 'request_id': 'req-0862bf44-442b-4811-82b8-aeb959165e5f'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:25.423201 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0862bf44-442b-4811-82b8-aeb959165e5f admin admin] The token cache is being invalidate because project f8a1aecb2fbd45cbb03e4cb2c7555e4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:25.423543 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0862bf44-442b-4811-82b8-aeb959165e5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:25.424971 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0862bf44-442b-4811-82b8-aeb959165e5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:25.429771 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 868/1726] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:25 2022] DELETE /identity/v3/projects/f8a1aecb2fbd45cbb03e4cb2c7555e4a => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:25.435370 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5554cb8-6c58-4f49-8a93-6cad590727c4 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:25.435945 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5554cb8-6c58-4f49-8a93-6cad590727c4 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:25.436104 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5554cb8-6c58-4f49-8a93-6cad590727c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:25.467514 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-c5554cb8-6c58-4f49-8a93-6cad590727c4 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:25.472671 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c5554cb8-6c58-4f49-8a93-6cad590727c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:25.689483 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 859/1727] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:25.698920 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee6cf1-71f2-4632-b715-5252508e9f13 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:25.699255 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee6cf1-71f2-4632-b715-5252508e9f13 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:25.699530 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee6cf1-71f2-4632-b715-5252508e9f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:25.749056 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-92ee6cf1-71f2-4632-b715-5252508e9f13 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:25.750529 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-92ee6cf1-71f2-4632-b715-5252508e9f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:25.770437 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 869/1728] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:25.775072 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5554cb8-6c58-4f49-8a93-6cad590727c4 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:25.790861 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5554cb8-6c58-4f49-8a93-6cad590727c4 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:25.797972 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57727c9f-1da0-4125-a0a9-4ec2490f8408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:25.798816 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57727c9f-1da0-4125-a0a9-4ec2490f8408 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:25.799392 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57727c9f-1da0-4125-a0a9-4ec2490f8408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:25.799730 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57727c9f-1da0-4125-a0a9-4ec2490f8408 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:25.800620 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57727c9f-1da0-4125-a0a9-4ec2490f8408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:58:25.801062 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57727c9f-1da0-4125-a0a9-4ec2490f8408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:25.803376 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57727c9f-1da0-4125-a0a9-4ec2490f8408 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:25.847014 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee6cf1-71f2-4632-b715-5252508e9f13 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:25.849633 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 860/1729] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:58:25.868842 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee6cf1-71f2-4632-b715-5252508e9f13 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:25.885261 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a3093-5fc8-4f6f-b4cc-8c1c32d1fbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:25.886071 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a3093-5fc8-4f6f-b4cc-8c1c32d1fbd5 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:25.886296 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a3093-5fc8-4f6f-b4cc-8c1c32d1fbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:25.886568 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a3093-5fc8-4f6f-b4cc-8c1c32d1fbd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:25.887293 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a3093-5fc8-4f6f-b4cc-8c1c32d1fbd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:25.889210 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a3093-5fc8-4f6f-b4cc-8c1c32d1fbd5 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:25.965573 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 870/1730] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:25 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:58:25.967294 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57727c9f-1da0-4125-a0a9-4ec2490f8408 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:25.988496 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57727c9f-1da0-4125-a0a9-4ec2490f8408 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:26.090472 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d7d85-00ca-45a8-bda7-541269abe012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:26.091703 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d7d85-00ca-45a8-bda7-541269abe012 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:26.091988 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d7d85-00ca-45a8-bda7-541269abe012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:26.093074 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d7d85-00ca-45a8-bda7-541269abe012 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:26.093886 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d7d85-00ca-45a8-bda7-541269abe012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:26.107041 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d7d85-00ca-45a8-bda7-541269abe012 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:26.170891 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 861/1731] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:25 2022] POST /identity/v3/users => generated 284 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:26.175257 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a3093-5fc8-4f6f-b4cc-8c1c32d1fbd5 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:26.205172 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a3093-5fc8-4f6f-b4cc-8c1c32d1fbd5 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:26.211941 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41bb9b-911c-49c3-ad2f-2769c9169ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:26.212968 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41bb9b-911c-49c3-ad2f-2769c9169ddd admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:26.214088 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41bb9b-911c-49c3-ad2f-2769c9169ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:26.214573 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41bb9b-911c-49c3-ad2f-2769c9169ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:26.215517 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41bb9b-911c-49c3-ad2f-2769c9169ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:26.217857 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41bb9b-911c-49c3-ad2f-2769c9169ddd admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:26.265308 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 871/1732] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:26.267720 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d7d85-00ca-45a8-bda7-541269abe012 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:26.298416 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d7d85-00ca-45a8-bda7-541269abe012 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:26.313177 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51197d4d-38a8-4d85-88e6-f58de3cbe694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:26.316196 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51197d4d-38a8-4d85-88e6-f58de3cbe694 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:26.316658 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51197d4d-38a8-4d85-88e6-f58de3cbe694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:26.317208 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51197d4d-38a8-4d85-88e6-f58de3cbe694 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:26.318388 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51197d4d-38a8-4d85-88e6-f58de3cbe694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:26.320650 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51197d4d-38a8-4d85-88e6-f58de3cbe694 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:26.340865 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41bb9b-911c-49c3-ad2f-2769c9169ddd admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:26.342353 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 862/1733] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:26.354305 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51197d4d-38a8-4d85-88e6-f58de3cbe694 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:26.356802 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41bb9b-911c-49c3-ad2f-2769c9169ddd admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:26.359675 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-51197d4d-38a8-4d85-88e6-f58de3cbe694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:26.374030 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33527668-6d7b-449d-8645-3ef0edeb8378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:26.377334 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33527668-6d7b-449d-8645-3ef0edeb8378 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:26.377894 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33527668-6d7b-449d-8645-3ef0edeb8378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:26.378313 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33527668-6d7b-449d-8645-3ef0edeb8378 admin admin] PATH_INFO: `/v3/projects/83785ff9e8874e4eb9be53d2802168dc/users/f6fc3abb4e374979b6757fb5f0e38409/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:26.396807 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51197d4d-38a8-4d85-88e6-f58de3cbe694 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:26.412508 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb3225-3f34-4c9b-a466-24f6165a7ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:26.416089 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb3225-3f34-4c9b-a466-24f6165a7ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:26.420588 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb3225-3f34-4c9b-a466-24f6165a7ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:26.422756 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb3225-3f34-4c9b-a466-24f6165a7ea2 admin admin] PATH_INFO: `/v3/projects/dc9c4e9b959f41f8abf61cb364de3df1` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:26.443895 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb3225-3f34-4c9b-a466-24f6165a7ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc9c4e9b959f41f8abf61cb364de3df1)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:26.446942 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33527668-6d7b-449d-8645-3ef0edeb8378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83785ff9e8874e4eb9be53d2802168dc, user_id=f6fc3abb4e374979b6757fb5f0e38409, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:26.449627 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33527668-6d7b-449d-8645-3ef0edeb8378 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:26.452306 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb3225-3f34-4c9b-a466-24f6165a7ea2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:26.491886 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 872/1734] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:26 2022] PUT /identity/v3/projects/83785ff9e8874e4eb9be53d2802168dc/users/f6fc3abb4e374979b6757fb5f0e38409/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:26.505070 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0f757-5dfd-40c6-b16e-9a9eca49890a None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:26.505369 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0f757-5dfd-40c6-b16e-9a9eca49890a None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:26.506014 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0f757-5dfd-40c6-b16e-9a9eca49890a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:26.540390 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-4ff0f757-5dfd-40c6-b16e-9a9eca49890a None None] MFA Rules not processed for user `f6fc3abb4e374979b6757fb5f0e38409`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:26.541954 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4ff0f757-5dfd-40c6-b16e-9a9eca49890a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:26.641386 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 873/1735] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:26.670566 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0f757-5dfd-40c6-b16e-9a9eca49890a None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:26.673292 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4ff0f757-5dfd-40c6-b16e-9a9eca49890a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:26.708700 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-afeb3225-3f34-4c9b-a466-24f6165a7ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc9c4e9b959f41f8abf61cb364de3df1', 'request_id': 'req-afeb3225-3f34-4c9b-a466-24f6165a7ea2'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:26.748815 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-afeb3225-3f34-4c9b-a466-24f6165a7ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc9c4e9b959f41f8abf61cb364de3df1', 'request_id': 'req-afeb3225-3f34-4c9b-a466-24f6165a7ea2'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:26.771130 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-afeb3225-3f34-4c9b-a466-24f6165a7ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc9c4e9b959f41f8abf61cb364de3df1', 'request_id': 'req-afeb3225-3f34-4c9b-a466-24f6165a7ea2'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:26.818507 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-afeb3225-3f34-4c9b-a466-24f6165a7ea2 admin admin] The token cache is being invalidate because project dc9c4e9b959f41f8abf61cb364de3df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:26.819045 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-afeb3225-3f34-4c9b-a466-24f6165a7ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:26.825818 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-afeb3225-3f34-4c9b-a466-24f6165a7ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:26.827475 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0f757-5dfd-40c6-b16e-9a9eca49890a None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:26.829018 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 863/1736] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:26 2022] DELETE /identity/v3/projects/dc9c4e9b959f41f8abf61cb364de3df1 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:26.842847 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb3225-3f34-4c9b-a466-24f6165a7ea2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:26.847094 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-afeb3225-3f34-4c9b-a466-24f6165a7ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:26.983863 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6562c-98e4-431d-9480-083e603368ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:26.984655 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6562c-98e4-431d-9480-083e603368ea service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:26.984933 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6562c-98e4-431d-9480-083e603368ea service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:26.985197 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6562c-98e4-431d-9480-083e603368ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:26.995247 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-74c6562c-98e4-431d-9480-083e603368ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:27.024704 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb3225-3f34-4c9b-a466-24f6165a7ea2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:27.034408 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f6a68-8629-40e6-9194-2413a9f42e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:27.034975 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f6a68-8629-40e6-9194-2413a9f42e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:27.035249 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f6a68-8629-40e6-9194-2413a9f42e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:27.035512 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f6a68-8629-40e6-9194-2413a9f42e06 admin admin] PATH_INFO: `/v3/users/106fb139620c4aca893c012ad44f5291` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:27.040470 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f6a68-8629-40e6-9194-2413a9f42e06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=106fb139620c4aca893c012ad44f5291)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:27.042861 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f6a68-8629-40e6-9194-2413a9f42e06 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:27.147075 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-538f6a68-8629-40e6-9194-2413a9f42e06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '106fb139620c4aca893c012ad44f5291'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:27.155419 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6562c-98e4-431d-9480-083e603368ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:27.158431 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-538f6a68-8629-40e6-9194-2413a9f42e06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '106fb139620c4aca893c012ad44f5291'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:27.161917 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6562c-98e4-431d-9480-083e603368ea service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:27.184032 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-538f6a68-8629-40e6-9194-2413a9f42e06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '106fb139620c4aca893c012ad44f5291'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:27.189456 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-538f6a68-8629-40e6-9194-2413a9f42e06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '106fb139620c4aca893c012ad44f5291'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:27.209088 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-538f6a68-8629-40e6-9194-2413a9f42e06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '106fb139620c4aca893c012ad44f5291'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:27.220413 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 864/1737] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:26 2022] DELETE /identity/v3/users/106fb139620c4aca893c012ad44f5291 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:27.234918 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 874/1738] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:27.444085 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f6a68-8629-40e6-9194-2413a9f42e06 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:27.445519 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-538f6a68-8629-40e6-9194-2413a9f42e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:27.549110 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f6a68-8629-40e6-9194-2413a9f42e06 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:27.558361 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f25c23-24a9-4466-85f8-4b987ed86ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:27.559719 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f25c23-24a9-4466-85f8-4b987ed86ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:27.560180 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f25c23-24a9-4466-85f8-4b987ed86ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:27.562051 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f25c23-24a9-4466-85f8-4b987ed86ff3 admin admin] PATH_INFO: `/v3/users/de49aeb6fee74ddfbb13926cb8e1f037` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:27.564858 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f25c23-24a9-4466-85f8-4b987ed86ff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de49aeb6fee74ddfbb13926cb8e1f037)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:27.568562 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f25c23-24a9-4466-85f8-4b987ed86ff3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:27.652004 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-87f25c23-24a9-4466-85f8-4b987ed86ff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de49aeb6fee74ddfbb13926cb8e1f037'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:27.665331 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-87f25c23-24a9-4466-85f8-4b987ed86ff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de49aeb6fee74ddfbb13926cb8e1f037'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:27.680788 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-87f25c23-24a9-4466-85f8-4b987ed86ff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de49aeb6fee74ddfbb13926cb8e1f037'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:27.682164 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-87f25c23-24a9-4466-85f8-4b987ed86ff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de49aeb6fee74ddfbb13926cb8e1f037'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:27.692345 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-87f25c23-24a9-4466-85f8-4b987ed86ff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de49aeb6fee74ddfbb13926cb8e1f037'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:27.702275 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 865/1739] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:27 2022] DELETE /identity/v3/users/de49aeb6fee74ddfbb13926cb8e1f037 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:27.707298 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4a495-26ad-45ba-9466-1a91de43716a None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:27.709527 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4a495-26ad-45ba-9466-1a91de43716a None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:27.710466 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4a495-26ad-45ba-9466-1a91de43716a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:27.773877 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-c5f4a495-26ad-45ba-9466-1a91de43716a None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:27.790758 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-c5f4a495-26ad-45ba-9466-1a91de43716a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:27.952602 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 875/1740] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:27.999356 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f25c23-24a9-4466-85f8-4b987ed86ff3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:28.000906 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-87f25c23-24a9-4466-85f8-4b987ed86ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:28.080451 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f25c23-24a9-4466-85f8-4b987ed86ff3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:28.084814 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb63a7-e90d-4526-b487-fa5ad538cd30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:28.085511 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb63a7-e90d-4526-b487-fa5ad538cd30 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:28.085790 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb63a7-e90d-4526-b487-fa5ad538cd30 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:28.086062 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb63a7-e90d-4526-b487-fa5ad538cd30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:28.098065 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb63a7-e90d-4526-b487-fa5ad538cd30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:28.099371 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb63a7-e90d-4526-b487-fa5ad538cd30 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:28.110607 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 866/1741] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:28.376094 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4a495-26ad-45ba-9466-1a91de43716a None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:28.377793 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-c5f4a495-26ad-45ba-9466-1a91de43716a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:28.391578 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4a495-26ad-45ba-9466-1a91de43716a None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:28.397389 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e201856-24a2-44eb-8909-b5c8d46ef89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:28.398394 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e201856-24a2-44eb-8909-b5c8d46ef89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:28.398672 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e201856-24a2-44eb-8909-b5c8d46ef89a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:28.398958 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e201856-24a2-44eb-8909-b5c8d46ef89a admin admin] PATH_INFO: `/v3/projects/83064fb9b1d9492e8af64031efa9fb6d` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:28.400182 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e201856-24a2-44eb-8909-b5c8d46ef89a admin admin] RBAC: Authorizing `identity:delete_project(project_id=83064fb9b1d9492e8af64031efa9fb6d)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:28.402170 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e201856-24a2-44eb-8909-b5c8d46ef89a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:28.450357 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32482d38-e40b-4379-8cfb-2664519febc7 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:28.452988 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32482d38-e40b-4379-8cfb-2664519febc7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:28.454229 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32482d38-e40b-4379-8cfb-2664519febc7 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:28.458794 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 867/1742] 10.222.0.31 () {54 vars in 921 bytes} [Thu Feb 10 20:58:28 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 20:58:28.471194 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada282c4-a575-4628-980c-8ef3f19cc320 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:28.471610 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada282c4-a575-4628-980c-8ef3f19cc320 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:28.472108 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada282c4-a575-4628-980c-8ef3f19cc320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:28.486909 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-3e201856-24a2-44eb-8909-b5c8d46ef89a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83064fb9b1d9492e8af64031efa9fb6d', 'request_id': 'req-3e201856-24a2-44eb-8909-b5c8d46ef89a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:28.493510 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-3e201856-24a2-44eb-8909-b5c8d46ef89a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83064fb9b1d9492e8af64031efa9fb6d', 'request_id': 'req-3e201856-24a2-44eb-8909-b5c8d46ef89a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:28.496771 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ada282c4-a575-4628-980c-8ef3f19cc320 None None] MFA Rules not processed for user `c0d84b0d7e3d423aa972e58be27c772c`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:28.498125 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ada282c4-a575-4628-980c-8ef3f19cc320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:28.500384 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-3e201856-24a2-44eb-8909-b5c8d46ef89a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83064fb9b1d9492e8af64031efa9fb6d', 'request_id': 'req-3e201856-24a2-44eb-8909-b5c8d46ef89a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:28.518296 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-3e201856-24a2-44eb-8909-b5c8d46ef89a admin admin] The token cache is being invalidate because project 83064fb9b1d9492e8af64031efa9fb6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:28.525677 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-3e201856-24a2-44eb-8909-b5c8d46ef89a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:28.526711 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-3e201856-24a2-44eb-8909-b5c8d46ef89a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:28.529629 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 876/1743] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:28 2022] DELETE /identity/v3/projects/83064fb9b1d9492e8af64031efa9fb6d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:28.535816 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01319e6-7442-4b5f-b656-ef8549d0c206 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:28.536355 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01319e6-7442-4b5f-b656-ef8549d0c206 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:28.537567 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01319e6-7442-4b5f-b656-ef8549d0c206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:28.556940 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-b01319e6-7442-4b5f-b656-ef8549d0c206 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:28.558234 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b01319e6-7442-4b5f-b656-ef8549d0c206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:28.601539 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 868/1744] 10.222.0.31 () {58 vars in 1018 bytes} [Thu Feb 10 20:58:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:28.609968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada282c4-a575-4628-980c-8ef3f19cc320 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:28.612271 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ada282c4-a575-4628-980c-8ef3f19cc320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:28.621385 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 877/1745] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:28.629044 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada282c4-a575-4628-980c-8ef3f19cc320 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:28.630590 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b4884-1ce1-445f-863c-e5d31cd2edc3 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:28.630954 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b4884-1ce1-445f-863c-e5d31cd2edc3 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:28.631242 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b4884-1ce1-445f-863c-e5d31cd2edc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:28.635443 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4947be3-4165-41f7-9246-e26b71cc5ae2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:28.636588 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4947be3-4165-41f7-9246-e26b71cc5ae2 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:28.636873 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4947be3-4165-41f7-9246-e26b71cc5ae2 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:28.637289 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4947be3-4165-41f7-9246-e26b71cc5ae2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:28.650028 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-4b6b4884-1ce1-445f-863c-e5d31cd2edc3 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:28.650517 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4947be3-4165-41f7-9246-e26b71cc5ae2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:28.651253 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4b6b4884-1ce1-445f-863c-e5d31cd2edc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:28.652231 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4947be3-4165-41f7-9246-e26b71cc5ae2 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:28.660153 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 878/1746] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:28.664384 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b4884-1ce1-445f-863c-e5d31cd2edc3 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:28.667049 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 869/1747] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:58:28.673776 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b4884-1ce1-445f-863c-e5d31cd2edc3 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:28.679050 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ac6fd-2e08-4f42-a646-f5acac69284b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:28.679729 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ac6fd-2e08-4f42-a646-f5acac69284b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:28.680007 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ac6fd-2e08-4f42-a646-f5acac69284b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:28.680280 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ac6fd-2e08-4f42-a646-f5acac69284b admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:28.681018 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ac6fd-2e08-4f42-a646-f5acac69284b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:58:28.681320 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ac6fd-2e08-4f42-a646-f5acac69284b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:28.682979 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ac6fd-2e08-4f42-a646-f5acac69284b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:28.698798 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 879/1748] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:58:28.700526 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4947be3-4165-41f7-9246-e26b71cc5ae2 service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:28.713082 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4947be3-4165-41f7-9246-e26b71cc5ae2 service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:28.719297 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ba6e5-b9cb-4324-ad73-4beacdb801b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:28.721176 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ba6e5-b9cb-4324-ad73-4beacdb801b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:28.721501 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ba6e5-b9cb-4324-ad73-4beacdb801b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:28.721779 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ba6e5-b9cb-4324-ad73-4beacdb801b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:28.722499 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ba6e5-b9cb-4324-ad73-4beacdb801b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:28.724481 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ba6e5-b9cb-4324-ad73-4beacdb801b1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:28.755891 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 870/1749] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:28 2022] POST /identity/v3/projects => generated 355 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:58:28.761450 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ac6fd-2e08-4f42-a646-f5acac69284b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:28.772295 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ac6fd-2e08-4f42-a646-f5acac69284b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:28.853264 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e736ae-7196-4daf-9222-5f661ba61be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:28.854320 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e736ae-7196-4daf-9222-5f661ba61be8 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:28.854689 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e736ae-7196-4daf-9222-5f661ba61be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:28.855050 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e736ae-7196-4daf-9222-5f661ba61be8 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:28.856066 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e736ae-7196-4daf-9222-5f661ba61be8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:28.858379 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e736ae-7196-4daf-9222-5f661ba61be8 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:28.886372 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 880/1750] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:28 2022] POST /identity/v3/users => generated 278 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:28.892405 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ba6e5-b9cb-4324-ad73-4beacdb801b1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:28.926740 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ba6e5-b9cb-4324-ad73-4beacdb801b1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:28.936040 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb8497-bdcd-404b-9a17-7593c3be6a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:28.937814 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb8497-bdcd-404b-9a17-7593c3be6a09 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:28.938271 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb8497-bdcd-404b-9a17-7593c3be6a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:28.938696 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb8497-bdcd-404b-9a17-7593c3be6a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:28.939575 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb8497-bdcd-404b-9a17-7593c3be6a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:28.942002 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb8497-bdcd-404b-9a17-7593c3be6a09 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:28.967796 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 871/1751] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:28.971763 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e736ae-7196-4daf-9222-5f661ba61be8 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:28.986732 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e736ae-7196-4daf-9222-5f661ba61be8 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:29.001991 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f24dbe-d593-4be8-89b2-7c316321368e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:29.003768 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f24dbe-d593-4be8-89b2-7c316321368e admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:29.004125 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f24dbe-d593-4be8-89b2-7c316321368e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:29.009427 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f24dbe-d593-4be8-89b2-7c316321368e admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:29.010599 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f24dbe-d593-4be8-89b2-7c316321368e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:29.025913 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f24dbe-d593-4be8-89b2-7c316321368e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:29.043154 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb8497-bdcd-404b-9a17-7593c3be6a09 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:29.049249 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 881/1752] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:29.063774 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb8497-bdcd-404b-9a17-7593c3be6a09 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:29.080221 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa2264-f331-4b0d-8890-19de66d3b7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:29.081217 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa2264-f331-4b0d-8890-19de66d3b7ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:29.081531 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa2264-f331-4b0d-8890-19de66d3b7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:29.081944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa2264-f331-4b0d-8890-19de66d3b7ed admin admin] PATH_INFO: `/v3/projects/4e5dd18e290040eb881548ce1b3118c0/users/445960f7ae734f3cb90b670862264180/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:29.109957 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa2264-f331-4b0d-8890-19de66d3b7ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e5dd18e290040eb881548ce1b3118c0, user_id=445960f7ae734f3cb90b670862264180, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:29.112955 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa2264-f331-4b0d-8890-19de66d3b7ed admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:29.145302 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 872/1753] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:29 2022] PUT /identity/v3/projects/4e5dd18e290040eb881548ce1b3118c0/users/445960f7ae734f3cb90b670862264180/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:29.147121 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98753c58-3f9a-4173-8032-476f2fc6d3e8 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:29.147408 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98753c58-3f9a-4173-8032-476f2fc6d3e8 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:29.147725 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98753c58-3f9a-4173-8032-476f2fc6d3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:29.189000 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-98753c58-3f9a-4173-8032-476f2fc6d3e8 None None] MFA Rules not processed for user `445960f7ae734f3cb90b670862264180`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:29.192116 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-98753c58-3f9a-4173-8032-476f2fc6d3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:29.250786 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa2264-f331-4b0d-8890-19de66d3b7ed admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:29.258922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4dfa2264-f331-4b0d-8890-19de66d3b7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:29.305765 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 882/1754] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:29 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:29.322995 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98753c58-3f9a-4173-8032-476f2fc6d3e8 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:29.460478 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa2264-f331-4b0d-8890-19de66d3b7ed admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:29.469729 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98753c58-3f9a-4173-8032-476f2fc6d3e8 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:29.475021 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e45cd2-3a71-4b1e-ae10-aa016adbf325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:29.476022 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e45cd2-3a71-4b1e-ae10-aa016adbf325 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:29.476172 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47588322-6bea-4dc3-b4d3-a7a461451441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:29.476574 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e45cd2-3a71-4b1e-ae10-aa016adbf325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:29.477025 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e45cd2-3a71-4b1e-ae10-aa016adbf325 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:29.477240 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47588322-6bea-4dc3-b4d3-a7a461451441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:29.477565 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47588322-6bea-4dc3-b4d3-a7a461451441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:29.477839 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47588322-6bea-4dc3-b4d3-a7a461451441 admin admin] PATH_INFO: `/v3/users/2a5f0bf7dc7d4b519bae40241a5f9a54` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:29.478912 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e45cd2-3a71-4b1e-ae10-aa016adbf325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:29.480602 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47588322-6bea-4dc3-b4d3-a7a461451441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a5f0bf7dc7d4b519bae40241a5f9a54)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:29.482586 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47588322-6bea-4dc3-b4d3-a7a461451441 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:29.495532 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e45cd2-3a71-4b1e-ae10-aa016adbf325 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:29.563350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 883/1755] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:29 2022] POST /identity/v3/projects => generated 353 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:29.564491 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e45cd2-3a71-4b1e-ae10-aa016adbf325 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:29.566750 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-a3e45cd2-3a71-4b1e-ae10-aa016adbf325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:29.612435 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-47588322-6bea-4dc3-b4d3-a7a461451441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a5f0bf7dc7d4b519bae40241a5f9a54'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:29.622970 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-47588322-6bea-4dc3-b4d3-a7a461451441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a5f0bf7dc7d4b519bae40241a5f9a54'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:29.669926 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-47588322-6bea-4dc3-b4d3-a7a461451441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a5f0bf7dc7d4b519bae40241a5f9a54'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:29.672232 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-47588322-6bea-4dc3-b4d3-a7a461451441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a5f0bf7dc7d4b519bae40241a5f9a54'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:29.690595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-47588322-6bea-4dc3-b4d3-a7a461451441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a5f0bf7dc7d4b519bae40241a5f9a54'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:29.698648 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 873/1756] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:29 2022] DELETE /identity/v3/users/2a5f0bf7dc7d4b519bae40241a5f9a54 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:29.699984 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47588322-6bea-4dc3-b4d3-a7a461451441 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:29.702300 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-47588322-6bea-4dc3-b4d3-a7a461451441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:29.714726 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e45cd2-3a71-4b1e-ae10-aa016adbf325 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:29.789256 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47588322-6bea-4dc3-b4d3-a7a461451441 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:29.792840 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38591960-bc57-43d6-809b-2af0088e9cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:29.794024 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38591960-bc57-43d6-809b-2af0088e9cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:29.794424 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38591960-bc57-43d6-809b-2af0088e9cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:29.794797 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38591960-bc57-43d6-809b-2af0088e9cd0 admin admin] PATH_INFO: `/v3/projects/67e74021df03473e8ec953c7cd4401a0` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:29.796617 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38591960-bc57-43d6-809b-2af0088e9cd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67e74021df03473e8ec953c7cd4401a0)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:29.799802 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38591960-bc57-43d6-809b-2af0088e9cd0 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:29.806711 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797790a4-afb3-40eb-8655-0552fdb1d6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:29.808098 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797790a4-afb3-40eb-8655-0552fdb1d6eb admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:29.808371 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797790a4-afb3-40eb-8655-0552fdb1d6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:29.808646 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797790a4-afb3-40eb-8655-0552fdb1d6eb admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:29.809387 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797790a4-afb3-40eb-8655-0552fdb1d6eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:29.813011 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797790a4-afb3-40eb-8655-0552fdb1d6eb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:29.844538 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 874/1757] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:29 2022] POST /identity/v3/users => generated 283 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:29.846030 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f6a90-e8b0-46e7-9b3f-ac526accb78b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:29.846321 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f6a90-e8b0-46e7-9b3f-ac526accb78b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:29.846596 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f6a90-e8b0-46e7-9b3f-ac526accb78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:29.868038 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-fa2f6a90-e8b0-46e7-9b3f-ac526accb78b None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:29.869308 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-fa2f6a90-e8b0-46e7-9b3f-ac526accb78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:29.889621 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-38591960-bc57-43d6-809b-2af0088e9cd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67e74021df03473e8ec953c7cd4401a0', 'request_id': 'req-38591960-bc57-43d6-809b-2af0088e9cd0'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:29.901653 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-38591960-bc57-43d6-809b-2af0088e9cd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67e74021df03473e8ec953c7cd4401a0', 'request_id': 'req-38591960-bc57-43d6-809b-2af0088e9cd0'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:29.916305 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-38591960-bc57-43d6-809b-2af0088e9cd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67e74021df03473e8ec953c7cd4401a0', 'request_id': 'req-38591960-bc57-43d6-809b-2af0088e9cd0'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:29.939732 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-38591960-bc57-43d6-809b-2af0088e9cd0 admin admin] The token cache is being invalidate because project 67e74021df03473e8ec953c7cd4401a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:29.940674 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-38591960-bc57-43d6-809b-2af0088e9cd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:29.942595 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-38591960-bc57-43d6-809b-2af0088e9cd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:29.944969 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 884/1758] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:29 2022] DELETE /identity/v3/projects/67e74021df03473e8ec953c7cd4401a0 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:29.947893 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38591960-bc57-43d6-809b-2af0088e9cd0 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:29.949140 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-38591960-bc57-43d6-809b-2af0088e9cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:29.953004 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 875/1759] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:29.954262 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f6a90-e8b0-46e7-9b3f-ac526accb78b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:29.955875 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-fa2f6a90-e8b0-46e7-9b3f-ac526accb78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:29.968498 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f6a90-e8b0-46e7-9b3f-ac526accb78b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:29.974819 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13927b10-c6e7-4a86-ba7b-0baa0b69a493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:29.976058 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13927b10-c6e7-4a86-ba7b-0baa0b69a493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:29.976341 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38591960-bc57-43d6-809b-2af0088e9cd0 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:29.976722 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13927b10-c6e7-4a86-ba7b-0baa0b69a493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:29.977265 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13927b10-c6e7-4a86-ba7b-0baa0b69a493 admin admin] PATH_INFO: `/v3/users/bf73f88e1ad04243a4a24de42aa77c2c` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:29.978788 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13927b10-c6e7-4a86-ba7b-0baa0b69a493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf73f88e1ad04243a4a24de42aa77c2c)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:29.980926 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13927b10-c6e7-4a86-ba7b-0baa0b69a493 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:29.986802 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597d298-9bac-4e77-aab6-17e1a0cc00a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:29.989478 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597d298-9bac-4e77-aab6-17e1a0cc00a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:29.990280 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597d298-9bac-4e77-aab6-17e1a0cc00a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:29.990773 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597d298-9bac-4e77-aab6-17e1a0cc00a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:29.991734 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597d298-9bac-4e77-aab6-17e1a0cc00a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:29.995062 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597d298-9bac-4e77-aab6-17e1a0cc00a1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:30.010475 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 885/1760] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:30.015037 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597d298-9bac-4e77-aab6-17e1a0cc00a1 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:30.037071 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597d298-9bac-4e77-aab6-17e1a0cc00a1 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:30.043288 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1ab45-25cb-4289-a6e0-3aa133bd81f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:30.044194 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1ab45-25cb-4289-a6e0-3aa133bd81f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:30.044472 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1ab45-25cb-4289-a6e0-3aa133bd81f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:30.044928 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1ab45-25cb-4289-a6e0-3aa133bd81f3 admin admin] PATH_INFO: `/v3/projects/1db9855252a4405881bea15a9a47336d/users/ffc825bfd0a642f991ade0324d8db66c/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:30.069012 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1ab45-25cb-4289-a6e0-3aa133bd81f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db9855252a4405881bea15a9a47336d, user_id=ffc825bfd0a642f991ade0324d8db66c, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:30.072635 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1ab45-25cb-4289-a6e0-3aa133bd81f3 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:30.074236 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-13927b10-c6e7-4a86-ba7b-0baa0b69a493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf73f88e1ad04243a4a24de42aa77c2c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:30.089051 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-13927b10-c6e7-4a86-ba7b-0baa0b69a493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf73f88e1ad04243a4a24de42aa77c2c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:30.111725 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-13927b10-c6e7-4a86-ba7b-0baa0b69a493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf73f88e1ad04243a4a24de42aa77c2c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:30.112459 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-13927b10-c6e7-4a86-ba7b-0baa0b69a493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf73f88e1ad04243a4a24de42aa77c2c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:30.115845 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 886/1761] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:30 2022] PUT /identity/v3/projects/1db9855252a4405881bea15a9a47336d/users/ffc825bfd0a642f991ade0324d8db66c/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:30.116962 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1ab45-25cb-4289-a6e0-3aa133bd81f3 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:30.121601 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d0f1ab45-25cb-4289-a6e0-3aa133bd81f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:30.126529 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-13927b10-c6e7-4a86-ba7b-0baa0b69a493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf73f88e1ad04243a4a24de42aa77c2c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:30.135449 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 876/1762] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:29 2022] DELETE /identity/v3/users/bf73f88e1ad04243a4a24de42aa77c2c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:30.136691 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13927b10-c6e7-4a86-ba7b-0baa0b69a493 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:30.138594 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-13927b10-c6e7-4a86-ba7b-0baa0b69a493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:30.211241 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1ab45-25cb-4289-a6e0-3aa133bd81f3 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:30.235991 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13927b10-c6e7-4a86-ba7b-0baa0b69a493 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:30.243646 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba9af5-79b1-49e6-b334-12d65188d9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:30.244540 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba9af5-79b1-49e6-b334-12d65188d9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:30.244846 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba9af5-79b1-49e6-b334-12d65188d9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:30.245481 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba9af5-79b1-49e6-b334-12d65188d9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:30.246616 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba9af5-79b1-49e6-b334-12d65188d9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:30.249742 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba9af5-79b1-49e6-b334-12d65188d9d1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:30.268667 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 877/1763] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:30.272463 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba9af5-79b1-49e6-b334-12d65188d9d1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:30.277813 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b44e93-e8e3-4612-b5bc-6cc050ad21bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:30.278964 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b44e93-e8e3-4612-b5bc-6cc050ad21bd service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:30.279405 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b44e93-e8e3-4612-b5bc-6cc050ad21bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:30.279829 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b44e93-e8e3-4612-b5bc-6cc050ad21bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:30.282039 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b9b44e93-e8e3-4612-b5bc-6cc050ad21bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:30.298473 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b44e93-e8e3-4612-b5bc-6cc050ad21bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:30.299851 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba9af5-79b1-49e6-b334-12d65188d9d1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:30.303161 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b44e93-e8e3-4612-b5bc-6cc050ad21bd service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:30.310121 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57997241-f854-41e6-bd5e-b95039c4bb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:30.312620 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57997241-f854-41e6-bd5e-b95039c4bb2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:30.313409 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57997241-f854-41e6-bd5e-b95039c4bb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:30.316138 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57997241-f854-41e6-bd5e-b95039c4bb2d admin admin] PATH_INFO: `/v3/projects/1db9855252a4405881bea15a9a47336d/users/ffc825bfd0a642f991ade0324d8db66c/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:30.322300 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 887/1764] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:30.326970 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57997241-f854-41e6-bd5e-b95039c4bb2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db9855252a4405881bea15a9a47336d, user_id=ffc825bfd0a642f991ade0324d8db66c, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:30.330259 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57997241-f854-41e6-bd5e-b95039c4bb2d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:30.362213 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 878/1765] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:30 2022] PUT /identity/v3/projects/1db9855252a4405881bea15a9a47336d/users/ffc825bfd0a642f991ade0324d8db66c/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:30.377838 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da961ec8-50e2-470d-ad18-dcf3f3595423 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:30.378259 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da961ec8-50e2-470d-ad18-dcf3f3595423 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:30.378651 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da961ec8-50e2-470d-ad18-dcf3f3595423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:30.407260 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-da961ec8-50e2-470d-ad18-dcf3f3595423 None None] MFA Rules not processed for user `ffc825bfd0a642f991ade0324d8db66c`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:30.408474 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-da961ec8-50e2-470d-ad18-dcf3f3595423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:30.527377 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 888/1766] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:30 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:30.537491 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57997241-f854-41e6-bd5e-b95039c4bb2d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:30.543186 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-57997241-f854-41e6-bd5e-b95039c4bb2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:30.621713 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57997241-f854-41e6-bd5e-b95039c4bb2d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:30.626520 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530137f-9ba5-4dec-b283-c9e46df06d5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:30.627509 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530137f-9ba5-4dec-b283-c9e46df06d5b service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:30.628067 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530137f-9ba5-4dec-b283-c9e46df06d5b service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:30.628509 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530137f-9ba5-4dec-b283-c9e46df06d5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:30.641959 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530137f-9ba5-4dec-b283-c9e46df06d5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:30.643681 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530137f-9ba5-4dec-b283-c9e46df06d5b service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:30.659069 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 879/1767] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:30 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:30.795919 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da961ec8-50e2-470d-ad18-dcf3f3595423 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:30.815924 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da961ec8-50e2-470d-ad18-dcf3f3595423 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:30.831032 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1e39a-cfb9-49ad-b1a6-9934663909b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:30.831995 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1e39a-cfb9-49ad-b1a6-9934663909b5 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:30.832276 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1e39a-cfb9-49ad-b1a6-9934663909b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:30.832543 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1e39a-cfb9-49ad-b1a6-9934663909b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:30.838585 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-eaf1e39a-cfb9-49ad-b1a6-9934663909b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:30.967197 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1e39a-cfb9-49ad-b1a6-9934663909b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:30.971227 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1e39a-cfb9-49ad-b1a6-9934663909b5 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:31.003907 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 889/1768] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:30 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:31.175566 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9f4ba-b282-4e83-963d-602d04131d22 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:31.176927 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9f4ba-b282-4e83-963d-602d04131d22 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:31.177813 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9f4ba-b282-4e83-963d-602d04131d22 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:31.180327 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 880/1769] 10.222.0.31 () {54 vars in 921 bytes} [Thu Feb 10 20:58:31 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:58:31.227565 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aec59a-d68f-419b-9c55-1b223c09be99 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:31.227900 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aec59a-d68f-419b-9c55-1b223c09be99 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:31.228121 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aec59a-d68f-419b-9c55-1b223c09be99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:31.268807 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-38aec59a-d68f-419b-9c55-1b223c09be99 None None] MFA Rules not processed for user `c0d84b0d7e3d423aa972e58be27c772c`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:31.270063 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-38aec59a-d68f-419b-9c55-1b223c09be99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:31.329343 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9f4ba-b282-4e83-963d-602d04131d22 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:31.331196 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-67c9f4ba-b282-4e83-963d-602d04131d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:31.481867 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9f4ba-b282-4e83-963d-602d04131d22 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:31.482349 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 890/1770] 10.222.0.31 () {58 vars in 1018 bytes} [Thu Feb 10 20:58:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:31.490341 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351c90b-ec7e-4c99-8a37-4f6699e4f878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:31.492064 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351c90b-ec7e-4c99-8a37-4f6699e4f878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:31.492535 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351c90b-ec7e-4c99-8a37-4f6699e4f878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:31.492909 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351c90b-ec7e-4c99-8a37-4f6699e4f878 admin admin] PATH_INFO: `/v3/projects/20e6f4f17f33456c9d00c0cb829212c0` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:31.494871 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351c90b-ec7e-4c99-8a37-4f6699e4f878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20e6f4f17f33456c9d00c0cb829212c0)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:31.497156 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351c90b-ec7e-4c99-8a37-4f6699e4f878 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:31.563392 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e351c90b-ec7e-4c99-8a37-4f6699e4f878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20e6f4f17f33456c9d00c0cb829212c0', 'request_id': 'req-e351c90b-ec7e-4c99-8a37-4f6699e4f878'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:31.581581 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e351c90b-ec7e-4c99-8a37-4f6699e4f878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20e6f4f17f33456c9d00c0cb829212c0', 'request_id': 'req-e351c90b-ec7e-4c99-8a37-4f6699e4f878'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:31.590420 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e351c90b-ec7e-4c99-8a37-4f6699e4f878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20e6f4f17f33456c9d00c0cb829212c0', 'request_id': 'req-e351c90b-ec7e-4c99-8a37-4f6699e4f878'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:31.607385 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e351c90b-ec7e-4c99-8a37-4f6699e4f878 admin admin] The token cache is being invalidate because project 20e6f4f17f33456c9d00c0cb829212c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:31.607667 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e351c90b-ec7e-4c99-8a37-4f6699e4f878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:31.608506 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e351c90b-ec7e-4c99-8a37-4f6699e4f878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:31.610252 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 881/1771] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:31 2022] DELETE /identity/v3/projects/20e6f4f17f33456c9d00c0cb829212c0 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:31.616068 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440dc179-722c-453f-9513-09d41064d8d9 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:31.616632 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440dc179-722c-453f-9513-09d41064d8d9 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:31.616632 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440dc179-722c-453f-9513-09d41064d8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:31.636879 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-440dc179-722c-453f-9513-09d41064d8d9 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:31.638344 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-440dc179-722c-453f-9513-09d41064d8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:31.702707 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 891/1772] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:31.714744 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1858650-23ca-463f-9be3-87ad99aa4d6e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:31.715105 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1858650-23ca-463f-9be3-87ad99aa4d6e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:31.715441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1858650-23ca-463f-9be3-87ad99aa4d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:31.740815 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-c1858650-23ca-463f-9be3-87ad99aa4d6e None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:31.742268 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c1858650-23ca-463f-9be3-87ad99aa4d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:31.759919 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 882/1773] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:31.761577 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440dc179-722c-453f-9513-09d41064d8d9 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:31.781921 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440dc179-722c-453f-9513-09d41064d8d9 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:31.796118 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8b49e-52b9-4596-8b52-230454a2c6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:31.802739 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8b49e-52b9-4596-8b52-230454a2c6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:31.803141 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8b49e-52b9-4596-8b52-230454a2c6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:31.803426 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8b49e-52b9-4596-8b52-230454a2c6a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:31.804579 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8b49e-52b9-4596-8b52-230454a2c6a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:58:31.806236 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8b49e-52b9-4596-8b52-230454a2c6a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:31.810663 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8b49e-52b9-4596-8b52-230454a2c6a2 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:31.845291 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1858650-23ca-463f-9be3-87ad99aa4d6e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:31.846701 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c1858650-23ca-463f-9be3-87ad99aa4d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:31.852753 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 892/1774] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:58:31.859127 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8b49e-52b9-4596-8b52-230454a2c6a2 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:31.880897 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8b49e-52b9-4596-8b52-230454a2c6a2 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:31.891969 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce828dc-9e96-45dc-89e1-bafe6a8ea605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:31.892787 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce828dc-9e96-45dc-89e1-bafe6a8ea605 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:31.894514 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce828dc-9e96-45dc-89e1-bafe6a8ea605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:31.894971 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce828dc-9e96-45dc-89e1-bafe6a8ea605 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:31.895837 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce828dc-9e96-45dc-89e1-bafe6a8ea605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:31.899382 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce828dc-9e96-45dc-89e1-bafe6a8ea605 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:31.957157 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 893/1775] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:31 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:31.957728 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce828dc-9e96-45dc-89e1-bafe6a8ea605 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:31.961851 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4ce828dc-9e96-45dc-89e1-bafe6a8ea605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:32.012478 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1858650-23ca-463f-9be3-87ad99aa4d6e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:32.097074 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce828dc-9e96-45dc-89e1-bafe6a8ea605 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:32.103832 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce84c49-334e-4f6f-9d2b-ee3ac0b0fa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:32.104984 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce84c49-334e-4f6f-9d2b-ee3ac0b0fa06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:32.105511 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce84c49-334e-4f6f-9d2b-ee3ac0b0fa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:32.105980 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce84c49-334e-4f6f-9d2b-ee3ac0b0fa06 admin admin] PATH_INFO: `/v3/projects/1b6d6f94d12a45d5913c2ea77cd085ef` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:32.108201 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce84c49-334e-4f6f-9d2b-ee3ac0b0fa06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b6d6f94d12a45d5913c2ea77cd085ef)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:32.110628 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce84c49-334e-4f6f-9d2b-ee3ac0b0fa06 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:32.148546 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e622ca-4812-45ad-b29d-762736ae1d87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:32.149982 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e622ca-4812-45ad-b29d-762736ae1d87 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:32.150271 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e622ca-4812-45ad-b29d-762736ae1d87 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:32.150552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e622ca-4812-45ad-b29d-762736ae1d87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:32.153742 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-06e622ca-4812-45ad-b29d-762736ae1d87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:32.175571 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e622ca-4812-45ad-b29d-762736ae1d87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:32.177180 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e622ca-4812-45ad-b29d-762736ae1d87 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:32.189870 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-cce84c49-334e-4f6f-9d2b-ee3ac0b0fa06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b6d6f94d12a45d5913c2ea77cd085ef', 'request_id': 'req-cce84c49-334e-4f6f-9d2b-ee3ac0b0fa06'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:32.191523 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 883/1776] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:32.194751 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e622ca-4812-45ad-b29d-762736ae1d87 service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:32.198433 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-cce84c49-334e-4f6f-9d2b-ee3ac0b0fa06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b6d6f94d12a45d5913c2ea77cd085ef', 'request_id': 'req-cce84c49-334e-4f6f-9d2b-ee3ac0b0fa06'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:32.206039 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e622ca-4812-45ad-b29d-762736ae1d87 service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:32.210736 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-cce84c49-334e-4f6f-9d2b-ee3ac0b0fa06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b6d6f94d12a45d5913c2ea77cd085ef', 'request_id': 'req-cce84c49-334e-4f6f-9d2b-ee3ac0b0fa06'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:32.241194 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-cce84c49-334e-4f6f-9d2b-ee3ac0b0fa06 admin admin] The token cache is being invalidate because project 1b6d6f94d12a45d5913c2ea77cd085ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:32.241508 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-cce84c49-334e-4f6f-9d2b-ee3ac0b0fa06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:32.242394 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-cce84c49-334e-4f6f-9d2b-ee3ac0b0fa06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:32.245494 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 894/1777] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:31 2022] DELETE /identity/v3/projects/1b6d6f94d12a45d5913c2ea77cd085ef => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:32.249864 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce84c49-334e-4f6f-9d2b-ee3ac0b0fa06 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:32.251395 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-cce84c49-334e-4f6f-9d2b-ee3ac0b0fa06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:32.306643 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c386781-a813-4199-9744-1273fa1d3b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:32.307337 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c386781-a813-4199-9744-1273fa1d3b6e admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:32.307615 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c386781-a813-4199-9744-1273fa1d3b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:32.307894 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c386781-a813-4199-9744-1273fa1d3b6e admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:32.308654 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c386781-a813-4199-9744-1273fa1d3b6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:32.311460 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c386781-a813-4199-9744-1273fa1d3b6e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:32.347905 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 884/1778] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:32 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:32.349005 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c386781-a813-4199-9744-1273fa1d3b6e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:32.351568 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9c386781-a813-4199-9744-1273fa1d3b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:32.369778 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c386781-a813-4199-9744-1273fa1d3b6e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:32.377072 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfa86d-029d-4e80-923b-38d7f50729c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:32.379669 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfa86d-029d-4e80-923b-38d7f50729c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:32.380098 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfa86d-029d-4e80-923b-38d7f50729c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:32.380504 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfa86d-029d-4e80-923b-38d7f50729c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:32.381483 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfa86d-029d-4e80-923b-38d7f50729c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:32.383519 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfa86d-029d-4e80-923b-38d7f50729c5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:32.399003 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce84c49-334e-4f6f-9d2b-ee3ac0b0fa06 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:32.405960 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 885/1779] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:32.407029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfa86d-029d-4e80-923b-38d7f50729c5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:32.433021 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfa86d-029d-4e80-923b-38d7f50729c5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:32.438372 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20756168-58fb-4639-8898-4ee634df38cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:32.439045 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20756168-58fb-4639-8898-4ee634df38cc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:32.439581 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20756168-58fb-4639-8898-4ee634df38cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:32.439859 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20756168-58fb-4639-8898-4ee634df38cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:32.440605 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20756168-58fb-4639-8898-4ee634df38cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:32.442393 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20756168-58fb-4639-8898-4ee634df38cc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:32.447268 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de89154-c7ad-4737-9581-73c53120aa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:32.448422 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de89154-c7ad-4737-9581-73c53120aa62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:32.450396 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de89154-c7ad-4737-9581-73c53120aa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:32.451239 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de89154-c7ad-4737-9581-73c53120aa62 admin admin] PATH_INFO: `/v3/users/0faaa457de354f9ebee6c54cfdee7b26` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:32.453525 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de89154-c7ad-4737-9581-73c53120aa62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0faaa457de354f9ebee6c54cfdee7b26)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:32.455920 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de89154-c7ad-4737-9581-73c53120aa62 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:32.462470 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 886/1780] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:32.462823 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20756168-58fb-4639-8898-4ee634df38cc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:32.477536 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20756168-58fb-4639-8898-4ee634df38cc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:32.485099 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbab6e-fdc3-411e-9266-7db6874228cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:32.486057 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbab6e-fdc3-411e-9266-7db6874228cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:32.486332 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbab6e-fdc3-411e-9266-7db6874228cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:32.486606 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbab6e-fdc3-411e-9266-7db6874228cd admin admin] PATH_INFO: `/v3/projects/705fbfd73aae4614a2c9f53bade852ba/users/8efdb2cd218442a6ab60bb44c126b231/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:32.509479 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbab6e-fdc3-411e-9266-7db6874228cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=705fbfd73aae4614a2c9f53bade852ba, user_id=8efdb2cd218442a6ab60bb44c126b231, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:32.513157 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbab6e-fdc3-411e-9266-7db6874228cd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:32.549278 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 887/1781] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:32 2022] PUT /identity/v3/projects/705fbfd73aae4614a2c9f53bade852ba/users/8efdb2cd218442a6ab60bb44c126b231/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:32.552746 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa399-e013-4b0a-992e-3b26e4d9aa1b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:32.553232 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa399-e013-4b0a-992e-3b26e4d9aa1b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:32.554155 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa399-e013-4b0a-992e-3b26e4d9aa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:32.606300 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-1de89154-c7ad-4737-9581-73c53120aa62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0faaa457de354f9ebee6c54cfdee7b26'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:32.613529 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-191fa399-e013-4b0a-992e-3b26e4d9aa1b None None] MFA Rules not processed for user `8efdb2cd218442a6ab60bb44c126b231`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:32.614908 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-191fa399-e013-4b0a-992e-3b26e4d9aa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:32.626048 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-1de89154-c7ad-4737-9581-73c53120aa62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0faaa457de354f9ebee6c54cfdee7b26'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:32.653167 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-1de89154-c7ad-4737-9581-73c53120aa62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0faaa457de354f9ebee6c54cfdee7b26'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:32.654309 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-1de89154-c7ad-4737-9581-73c53120aa62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0faaa457de354f9ebee6c54cfdee7b26'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:32.659378 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-1de89154-c7ad-4737-9581-73c53120aa62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0faaa457de354f9ebee6c54cfdee7b26'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:32.687170 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 895/1782] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:32 2022] DELETE /identity/v3/users/0faaa457de354f9ebee6c54cfdee7b26 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:32.741170 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 888/1783] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:32.746272 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de89154-c7ad-4737-9581-73c53120aa62 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:32.747791 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-1de89154-c7ad-4737-9581-73c53120aa62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:32.839450 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de89154-c7ad-4737-9581-73c53120aa62 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:32.850109 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07446fad-9e30-4d72-a9c1-bd9c506f0857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:32.851166 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07446fad-9e30-4d72-a9c1-bd9c506f0857 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:32.851670 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07446fad-9e30-4d72-a9c1-bd9c506f0857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:32.852199 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07446fad-9e30-4d72-a9c1-bd9c506f0857 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:32.853852 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07446fad-9e30-4d72-a9c1-bd9c506f0857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:32.855856 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07446fad-9e30-4d72-a9c1-bd9c506f0857 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:32.892712 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 896/1784] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:32 2022] POST /identity/v3/projects => generated 389 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:32.896685 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fa399-e013-4b0a-992e-3b26e4d9aa1b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:32.962411 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fa399-e013-4b0a-992e-3b26e4d9aa1b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:33.023998 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e092b3-bb7a-4bdc-8faf-e86d2caa3513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:33.024747 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e092b3-bb7a-4bdc-8faf-e86d2caa3513 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:33.025110 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e092b3-bb7a-4bdc-8faf-e86d2caa3513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:33.025480 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e092b3-bb7a-4bdc-8faf-e86d2caa3513 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:33.026261 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e092b3-bb7a-4bdc-8faf-e86d2caa3513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:33.028233 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e092b3-bb7a-4bdc-8faf-e86d2caa3513 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:33.054536 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 889/1785] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:32 2022] POST /identity/v3/users => generated 301 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:58:33.055878 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07446fad-9e30-4d72-a9c1-bd9c506f0857 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:33.070036 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07446fad-9e30-4d72-a9c1-bd9c506f0857 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:33.084875 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe60a3-bc5c-4380-8be6-9482b1a7c0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:33.086114 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe60a3-bc5c-4380-8be6-9482b1a7c0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:33.086710 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe60a3-bc5c-4380-8be6-9482b1a7c0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:33.087175 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe60a3-bc5c-4380-8be6-9482b1a7c0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:33.088071 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe60a3-bc5c-4380-8be6-9482b1a7c0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:33.090946 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe60a3-bc5c-4380-8be6-9482b1a7c0d5 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:33.104558 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 897/1786] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:33.108666 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e092b3-bb7a-4bdc-8faf-e86d2caa3513 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:33.125063 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e092b3-bb7a-4bdc-8faf-e86d2caa3513 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:33.131087 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc30529-2d45-47e1-9bc1-8427e9f11be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:33.132756 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc30529-2d45-47e1-9bc1-8427e9f11be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:33.133158 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc30529-2d45-47e1-9bc1-8427e9f11be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:33.133583 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc30529-2d45-47e1-9bc1-8427e9f11be1 admin admin] PATH_INFO: `/v3/projects/6809369660ab47eebf0331360a4243cf/users/7370e8a2d6504753a35d10129d33a992/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:33.152536 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc30529-2d45-47e1-9bc1-8427e9f11be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6809369660ab47eebf0331360a4243cf, user_id=7370e8a2d6504753a35d10129d33a992, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:33.155630 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc30529-2d45-47e1-9bc1-8427e9f11be1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:33.182849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 890/1787] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:33 2022] PUT /identity/v3/projects/6809369660ab47eebf0331360a4243cf/users/7370e8a2d6504753a35d10129d33a992/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:33.187679 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe60a3-bc5c-4380-8be6-9482b1a7c0d5 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:33.201209 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe60a3-bc5c-4380-8be6-9482b1a7c0d5 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:33.276865 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9ebcf-b46f-4fbc-98d3-bef96789691c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:33.277711 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9ebcf-b46f-4fbc-98d3-bef96789691c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:33.277968 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9ebcf-b46f-4fbc-98d3-bef96789691c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:33.278393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9ebcf-b46f-4fbc-98d3-bef96789691c admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:33.279261 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9ebcf-b46f-4fbc-98d3-bef96789691c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:33.281903 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9ebcf-b46f-4fbc-98d3-bef96789691c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:33.292810 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 898/1788] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:33.296943 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc30529-2d45-47e1-9bc1-8427e9f11be1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:33.311104 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc30529-2d45-47e1-9bc1-8427e9f11be1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:33.317847 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac71aa7-42fb-4b40-b625-6b58b3d6531b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:33.318756 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac71aa7-42fb-4b40-b625-6b58b3d6531b admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:33.319043 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac71aa7-42fb-4b40-b625-6b58b3d6531b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:33.319922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac71aa7-42fb-4b40-b625-6b58b3d6531b admin admin] PATH_INFO: `/v3/projects/6809369660ab47eebf0331360a4243cf/users/7370e8a2d6504753a35d10129d33a992/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:33.322066 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac71aa7-42fb-4b40-b625-6b58b3d6531b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6809369660ab47eebf0331360a4243cf, user_id=7370e8a2d6504753a35d10129d33a992, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:33.324923 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac71aa7-42fb-4b40-b625-6b58b3d6531b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:33.338437 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 891/1789] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:33 2022] PUT /identity/v3/projects/6809369660ab47eebf0331360a4243cf/users/7370e8a2d6504753a35d10129d33a992/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:33.350289 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a686e-aafb-4339-9233-b45514ab4799 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:33.350597 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a686e-aafb-4339-9233-b45514ab4799 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:33.350922 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a686e-aafb-4339-9233-b45514ab4799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:33.382367 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-f96a686e-aafb-4339-9233-b45514ab4799 None None] MFA Rules not processed for user `7370e8a2d6504753a35d10129d33a992`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:33.383706 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-f96a686e-aafb-4339-9233-b45514ab4799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:33.450721 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 899/1790] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:33.460697 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac71aa7-42fb-4b40-b625-6b58b3d6531b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:33.462798 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-bac71aa7-42fb-4b40-b625-6b58b3d6531b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:33.575464 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac71aa7-42fb-4b40-b625-6b58b3d6531b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:33.579331 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07d1c3-b090-4310-8158-1fd162d94675 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:33.580073 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07d1c3-b090-4310-8158-1fd162d94675 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:33.580417 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07d1c3-b090-4310-8158-1fd162d94675 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:33.580750 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07d1c3-b090-4310-8158-1fd162d94675 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:33.592744 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b07d1c3-b090-4310-8158-1fd162d94675 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:33.592744 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b07d1c3-b090-4310-8158-1fd162d94675 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:33.605144 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 892/1791] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:33.737952 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a686e-aafb-4339-9233-b45514ab4799 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:33.842412 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a686e-aafb-4339-9233-b45514ab4799 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:33.850756 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f4853-2e29-4f6f-92ea-ac753dbb73fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:33.852104 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f4853-2e29-4f6f-92ea-ac753dbb73fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:33.852651 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f4853-2e29-4f6f-92ea-ac753dbb73fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:33.853239 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f4853-2e29-4f6f-92ea-ac753dbb73fe admin admin] PATH_INFO: `/v3/users/8efdb2cd218442a6ab60bb44c126b231` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:33.855444 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f4853-2e29-4f6f-92ea-ac753dbb73fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=8efdb2cd218442a6ab60bb44c126b231)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:33.857631 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f4853-2e29-4f6f-92ea-ac753dbb73fe admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:33.898174 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07d1c3-b090-4310-8158-1fd162d94675 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:33.900131 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9b07d1c3-b090-4310-8158-1fd162d94675 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:33.929935 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-817f4853-2e29-4f6f-92ea-ac753dbb73fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8efdb2cd218442a6ab60bb44c126b231'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:33.939141 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-817f4853-2e29-4f6f-92ea-ac753dbb73fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8efdb2cd218442a6ab60bb44c126b231'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:33.949785 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07d1c3-b090-4310-8158-1fd162d94675 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:33.959062 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee02291-7368-4f8e-958e-75d7dc86e392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:33.960102 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee02291-7368-4f8e-958e-75d7dc86e392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:33.960445 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-817f4853-2e29-4f6f-92ea-ac753dbb73fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8efdb2cd218442a6ab60bb44c126b231'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:33.961087 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee02291-7368-4f8e-958e-75d7dc86e392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:33.961388 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee02291-7368-4f8e-958e-75d7dc86e392 admin admin] PATH_INFO: `/v3/projects/54533d98c8284f428054166c67612bb5` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:33.961655 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-817f4853-2e29-4f6f-92ea-ac753dbb73fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8efdb2cd218442a6ab60bb44c126b231'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:33.962515 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-817f4853-2e29-4f6f-92ea-ac753dbb73fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8efdb2cd218442a6ab60bb44c126b231'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:33.963182 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee02291-7368-4f8e-958e-75d7dc86e392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54533d98c8284f428054166c67612bb5)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:33.966029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee02291-7368-4f8e-958e-75d7dc86e392 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:33.990752 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 900/1792] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:33 2022] DELETE /identity/v3/users/8efdb2cd218442a6ab60bb44c126b231 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:33.992395 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c57b9-4eac-4ee9-9c8f-b3db7c8a76dd None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:33.992823 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c57b9-4eac-4ee9-9c8f-b3db7c8a76dd None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:33.993118 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c57b9-4eac-4ee9-9c8f-b3db7c8a76dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:34.019362 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-601c57b9-4eac-4ee9-9c8f-b3db7c8a76dd None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:34.021305 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-601c57b9-4eac-4ee9-9c8f-b3db7c8a76dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:34.055387 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9ee02291-7368-4f8e-958e-75d7dc86e392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54533d98c8284f428054166c67612bb5', 'request_id': 'req-9ee02291-7368-4f8e-958e-75d7dc86e392'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:34.069627 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9ee02291-7368-4f8e-958e-75d7dc86e392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54533d98c8284f428054166c67612bb5', 'request_id': 'req-9ee02291-7368-4f8e-958e-75d7dc86e392'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:34.077937 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9ee02291-7368-4f8e-958e-75d7dc86e392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54533d98c8284f428054166c67612bb5', 'request_id': 'req-9ee02291-7368-4f8e-958e-75d7dc86e392'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:34.106792 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9ee02291-7368-4f8e-958e-75d7dc86e392 admin admin] The token cache is being invalidate because project 54533d98c8284f428054166c67612bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:34.108432 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9ee02291-7368-4f8e-958e-75d7dc86e392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:34.112426 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9ee02291-7368-4f8e-958e-75d7dc86e392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:34.117399 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 893/1793] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:33 2022] DELETE /identity/v3/projects/54533d98c8284f428054166c67612bb5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:34.121140 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab147fe2-a79e-401e-97b2-8bc3766ed38e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:34.124692 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab147fe2-a79e-401e-97b2-8bc3766ed38e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:34.125531 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab147fe2-a79e-401e-97b2-8bc3766ed38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:34.160357 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 901/1794] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:34.170831 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c57b9-4eac-4ee9-9c8f-b3db7c8a76dd None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:34.172896 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ab147fe2-a79e-401e-97b2-8bc3766ed38e None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:34.174000 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-601c57b9-4eac-4ee9-9c8f-b3db7c8a76dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:34.174108 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ab147fe2-a79e-401e-97b2-8bc3766ed38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:34.191267 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 894/1795] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:34.199349 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78135aa7-20e0-46a9-90b9-0b3b946b9a5f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:34.199964 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78135aa7-20e0-46a9-90b9-0b3b946b9a5f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:34.200295 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78135aa7-20e0-46a9-90b9-0b3b946b9a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:34.233065 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-78135aa7-20e0-46a9-90b9-0b3b946b9a5f None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:34.235009 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-78135aa7-20e0-46a9-90b9-0b3b946b9a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:34.249723 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 895/1796] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:34.251597 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78135aa7-20e0-46a9-90b9-0b3b946b9a5f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:34.263422 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78135aa7-20e0-46a9-90b9-0b3b946b9a5f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:34.263582 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c57b9-4eac-4ee9-9c8f-b3db7c8a76dd None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:34.269315 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fc759-e809-443b-ba1c-7572582bf81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:34.270022 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fc759-e809-443b-ba1c-7572582bf81f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:34.270452 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fc759-e809-443b-ba1c-7572582bf81f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:34.270727 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c6e51-77bc-4e4c-b312-fee39808f14e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:34.270867 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fc759-e809-443b-ba1c-7572582bf81f admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:34.271510 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c6e51-77bc-4e4c-b312-fee39808f14e service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:34.271628 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fc759-e809-443b-ba1c-7572582bf81f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:58:34.271812 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fc759-e809-443b-ba1c-7572582bf81f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:34.271921 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c6e51-77bc-4e4c-b312-fee39808f14e service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:34.272247 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c6e51-77bc-4e4c-b312-fee39808f14e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:34.273460 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fc759-e809-443b-ba1c-7572582bf81f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:34.284659 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c6e51-77bc-4e4c-b312-fee39808f14e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:34.289427 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 896/1797] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:58:34.289593 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c6e51-77bc-4e4c-b312-fee39808f14e service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:34.290456 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fc759-e809-443b-ba1c-7572582bf81f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:34.299376 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 902/1798] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:34.302930 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fc759-e809-443b-ba1c-7572582bf81f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:34.308774 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5c203-5bcf-4d82-a1bf-b5ed334fa79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:34.309712 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5c203-5bcf-4d82-a1bf-b5ed334fa79a admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:34.309992 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5c203-5bcf-4d82-a1bf-b5ed334fa79a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:34.310301 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5c203-5bcf-4d82-a1bf-b5ed334fa79a admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:34.311235 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5c203-5bcf-4d82-a1bf-b5ed334fa79a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:34.313257 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5c203-5bcf-4d82-a1bf-b5ed334fa79a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:34.357199 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 897/1799] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:34 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:34.362134 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c6e51-77bc-4e4c-b312-fee39808f14e service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:34.384002 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c6e51-77bc-4e4c-b312-fee39808f14e service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:34.497134 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87f341-5ee0-4a96-b7ec-dff2bbf8de48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:34.498290 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87f341-5ee0-4a96-b7ec-dff2bbf8de48 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:34.498784 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87f341-5ee0-4a96-b7ec-dff2bbf8de48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:34.499253 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87f341-5ee0-4a96-b7ec-dff2bbf8de48 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:34.500796 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87f341-5ee0-4a96-b7ec-dff2bbf8de48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:34.503793 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87f341-5ee0-4a96-b7ec-dff2bbf8de48 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:34.537153 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 903/1800] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:34 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:34.540750 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5c203-5bcf-4d82-a1bf-b5ed334fa79a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:34.564781 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5c203-5bcf-4d82-a1bf-b5ed334fa79a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:34.572576 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26a0b1-7f42-4325-8877-0d80a3b0d9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:34.573798 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26a0b1-7f42-4325-8877-0d80a3b0d9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:34.574294 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26a0b1-7f42-4325-8877-0d80a3b0d9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:34.575029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26a0b1-7f42-4325-8877-0d80a3b0d9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:34.576043 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26a0b1-7f42-4325-8877-0d80a3b0d9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:34.578106 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26a0b1-7f42-4325-8877-0d80a3b0d9b8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:34.595046 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 898/1801] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:34.598885 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87f341-5ee0-4a96-b7ec-dff2bbf8de48 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:34.617280 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87f341-5ee0-4a96-b7ec-dff2bbf8de48 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:34.628701 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb86048-114e-4aa0-86df-70eb32311fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:34.629648 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb86048-114e-4aa0-86df-70eb32311fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:34.630081 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb86048-114e-4aa0-86df-70eb32311fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:34.630486 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb86048-114e-4aa0-86df-70eb32311fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:34.632001 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb86048-114e-4aa0-86df-70eb32311fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:34.633824 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb86048-114e-4aa0-86df-70eb32311fb8 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:34.662406 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 904/1802] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:34.668321 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26a0b1-7f42-4325-8877-0d80a3b0d9b8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:34.684584 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26a0b1-7f42-4325-8877-0d80a3b0d9b8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:34.701406 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06ec42-3275-4a31-a7bb-a941018fcc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:34.702687 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06ec42-3275-4a31-a7bb-a941018fcc98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:34.703069 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06ec42-3275-4a31-a7bb-a941018fcc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:34.703433 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06ec42-3275-4a31-a7bb-a941018fcc98 admin admin] PATH_INFO: `/v3/projects/a3c39b180653407b844b26d3b2658938/users/36197be3ba9242429495bee469a52255/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:34.745053 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06ec42-3275-4a31-a7bb-a941018fcc98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3c39b180653407b844b26d3b2658938, user_id=36197be3ba9242429495bee469a52255, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:34.755286 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06ec42-3275-4a31-a7bb-a941018fcc98 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:34.785391 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 899/1803] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:34 2022] PUT /identity/v3/projects/a3c39b180653407b844b26d3b2658938/users/36197be3ba9242429495bee469a52255/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:34.804095 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c59dc-e9db-4897-b91b-94c80976fb3b None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:34.804644 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c59dc-e9db-4897-b91b-94c80976fb3b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:34.805053 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c59dc-e9db-4897-b91b-94c80976fb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:34.852550 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-ce0c59dc-e9db-4897-b91b-94c80976fb3b None None] MFA Rules not processed for user `36197be3ba9242429495bee469a52255`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:34.854526 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ce0c59dc-e9db-4897-b91b-94c80976fb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:34.941417 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 905/1804] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:34.945929 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06ec42-3275-4a31-a7bb-a941018fcc98 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:35.023949 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06ec42-3275-4a31-a7bb-a941018fcc98 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:35.030720 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de24cae-e8f0-49fb-b60c-ea97b01f61b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:35.031519 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de24cae-e8f0-49fb-b60c-ea97b01f61b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:35.032075 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de24cae-e8f0-49fb-b60c-ea97b01f61b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:35.032411 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de24cae-e8f0-49fb-b60c-ea97b01f61b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:35.033260 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de24cae-e8f0-49fb-b60c-ea97b01f61b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:35.035396 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de24cae-e8f0-49fb-b60c-ea97b01f61b7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:35.072229 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 900/1805] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:34 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:35.077127 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c59dc-e9db-4897-b91b-94c80976fb3b None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:35.098212 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c59dc-e9db-4897-b91b-94c80976fb3b None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:35.198404 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602b6b1-c167-4038-8703-9147acce2d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:35.199236 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602b6b1-c167-4038-8703-9147acce2d0b admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:35.199574 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602b6b1-c167-4038-8703-9147acce2d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:35.200958 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602b6b1-c167-4038-8703-9147acce2d0b admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:35.202243 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602b6b1-c167-4038-8703-9147acce2d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:35.204691 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602b6b1-c167-4038-8703-9147acce2d0b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:35.257176 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 906/1806] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:35 2022] POST /identity/v3/users => generated 300 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:35.258775 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de24cae-e8f0-49fb-b60c-ea97b01f61b7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:35.281921 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de24cae-e8f0-49fb-b60c-ea97b01f61b7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:35.295268 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d3089-f400-401c-9b70-72daf9de63e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:35.298084 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d3089-f400-401c-9b70-72daf9de63e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:35.298084 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d3089-f400-401c-9b70-72daf9de63e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:35.298084 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d3089-f400-401c-9b70-72daf9de63e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:35.301440 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d3089-f400-401c-9b70-72daf9de63e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:35.307807 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d3089-f400-401c-9b70-72daf9de63e4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:35.361042 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 901/1807] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 20:58:35.365716 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602b6b1-c167-4038-8703-9147acce2d0b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:35.383708 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602b6b1-c167-4038-8703-9147acce2d0b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:35.399318 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf751cb-434d-4e65-a97f-753a41a9d40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:35.400566 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf751cb-434d-4e65-a97f-753a41a9d40c admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:35.400988 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf751cb-434d-4e65-a97f-753a41a9d40c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:35.401452 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf751cb-434d-4e65-a97f-753a41a9d40c admin admin] PATH_INFO: `/v3/projects/940235144fbc4c73af3787e4fb400e27/users/8b98f2909dbf4f8d9a926b515087eb60/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:35.467551 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf751cb-434d-4e65-a97f-753a41a9d40c admin admin] RBAC: Authorizing `identity:create_grant(project_id=940235144fbc4c73af3787e4fb400e27, user_id=8b98f2909dbf4f8d9a926b515087eb60, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:35.480302 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf751cb-434d-4e65-a97f-753a41a9d40c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:35.507362 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 907/1808] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:35 2022] PUT /identity/v3/projects/940235144fbc4c73af3787e4fb400e27/users/8b98f2909dbf4f8d9a926b515087eb60/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:35.511795 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d3089-f400-401c-9b70-72daf9de63e4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:35.528570 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf751cb-434d-4e65-a97f-753a41a9d40c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:35.532016 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-8bf751cb-434d-4e65-a97f-753a41a9d40c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:35.542974 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d3089-f400-401c-9b70-72daf9de63e4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:35.678111 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf751cb-434d-4e65-a97f-753a41a9d40c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:35.683104 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00160454-c30e-4451-b860-415b9950add4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:35.684496 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00160454-c30e-4451-b860-415b9950add4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:35.684496 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00160454-c30e-4451-b860-415b9950add4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:35.684701 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00160454-c30e-4451-b860-415b9950add4 admin admin] PATH_INFO: `/v3/projects/705fbfd73aae4614a2c9f53bade852ba` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:35.685998 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00160454-c30e-4451-b860-415b9950add4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=705fbfd73aae4614a2c9f53bade852ba)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:35.688240 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00160454-c30e-4451-b860-415b9950add4 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:35.691713 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22270533-c297-4b51-bef0-44d83cf100ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:35.692483 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22270533-c297-4b51-bef0-44d83cf100ef admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:35.692695 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22270533-c297-4b51-bef0-44d83cf100ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:35.692961 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22270533-c297-4b51-bef0-44d83cf100ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:35.693894 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22270533-c297-4b51-bef0-44d83cf100ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:35.695787 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22270533-c297-4b51-bef0-44d83cf100ef admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:35.722499 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 902/1809] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:35.727649 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22270533-c297-4b51-bef0-44d83cf100ef admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:35.744484 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22270533-c297-4b51-bef0-44d83cf100ef admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:35.760149 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-00160454-c30e-4451-b860-415b9950add4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '705fbfd73aae4614a2c9f53bade852ba', 'request_id': 'req-00160454-c30e-4451-b860-415b9950add4'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:35.765970 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-00160454-c30e-4451-b860-415b9950add4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '705fbfd73aae4614a2c9f53bade852ba', 'request_id': 'req-00160454-c30e-4451-b860-415b9950add4'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:35.773989 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-00160454-c30e-4451-b860-415b9950add4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '705fbfd73aae4614a2c9f53bade852ba', 'request_id': 'req-00160454-c30e-4451-b860-415b9950add4'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:35.794490 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-00160454-c30e-4451-b860-415b9950add4 admin admin] The token cache is being invalidate because project 705fbfd73aae4614a2c9f53bade852ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:35.794490 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-00160454-c30e-4451-b860-415b9950add4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:35.794490 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-00160454-c30e-4451-b860-415b9950add4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:35.799422 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 908/1810] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:35 2022] DELETE /identity/v3/projects/705fbfd73aae4614a2c9f53bade852ba => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:35.801022 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00160454-c30e-4451-b860-415b9950add4 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:35.803648 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-00160454-c30e-4451-b860-415b9950add4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:35.880334 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19144d3b-5fb2-48b3-bd8b-5b781930f02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:35.881245 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19144d3b-5fb2-48b3-bd8b-5b781930f02d admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:35.881578 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19144d3b-5fb2-48b3-bd8b-5b781930f02d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:35.882438 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19144d3b-5fb2-48b3-bd8b-5b781930f02d admin admin] PATH_INFO: `/v3/projects/940235144fbc4c73af3787e4fb400e27/users/8b98f2909dbf4f8d9a926b515087eb60/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:35.884592 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19144d3b-5fb2-48b3-bd8b-5b781930f02d admin admin] RBAC: Authorizing `identity:create_grant(project_id=940235144fbc4c73af3787e4fb400e27, user_id=8b98f2909dbf4f8d9a926b515087eb60, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:35.888729 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19144d3b-5fb2-48b3-bd8b-5b781930f02d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:35.903510 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00160454-c30e-4451-b860-415b9950add4 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:35.906861 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 903/1811] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:35 2022] PUT /identity/v3/projects/940235144fbc4c73af3787e4fb400e27/users/8b98f2909dbf4f8d9a926b515087eb60/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:35.918124 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730a249-4b5e-4a92-8329-4ca08a9c7e1a None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:35.918555 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730a249-4b5e-4a92-8329-4ca08a9c7e1a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:35.919459 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730a249-4b5e-4a92-8329-4ca08a9c7e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:35.974380 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-2730a249-4b5e-4a92-8329-4ca08a9c7e1a None None] MFA Rules not processed for user `8b98f2909dbf4f8d9a926b515087eb60`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:35.977426 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2730a249-4b5e-4a92-8329-4ca08a9c7e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:36.012948 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4c077-c1d2-470d-a314-f40ff7b7f7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:36.013855 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4c077-c1d2-470d-a314-f40ff7b7f7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:36.014315 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4c077-c1d2-470d-a314-f40ff7b7f7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:36.014596 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4c077-c1d2-470d-a314-f40ff7b7f7d7 admin admin] PATH_INFO: `/v3/users/7370e8a2d6504753a35d10129d33a992` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:36.015912 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4c077-c1d2-470d-a314-f40ff7b7f7d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7370e8a2d6504753a35d10129d33a992)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:36.018248 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4c077-c1d2-470d-a314-f40ff7b7f7d7 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:36.112511 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d1c4c077-c1d2-470d-a314-f40ff7b7f7d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7370e8a2d6504753a35d10129d33a992'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:36.131950 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d1c4c077-c1d2-470d-a314-f40ff7b7f7d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7370e8a2d6504753a35d10129d33a992'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:36.147848 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d1c4c077-c1d2-470d-a314-f40ff7b7f7d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7370e8a2d6504753a35d10129d33a992'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:36.148803 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d1c4c077-c1d2-470d-a314-f40ff7b7f7d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7370e8a2d6504753a35d10129d33a992'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:36.149544 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d1c4c077-c1d2-470d-a314-f40ff7b7f7d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7370e8a2d6504753a35d10129d33a992'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:36.174926 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 904/1812] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:36.179169 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 909/1813] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:35 2022] DELETE /identity/v3/users/7370e8a2d6504753a35d10129d33a992 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:36.186538 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730a249-4b5e-4a92-8329-4ca08a9c7e1a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:36.190198 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2730a249-4b5e-4a92-8329-4ca08a9c7e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:36.323818 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730a249-4b5e-4a92-8329-4ca08a9c7e1a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:36.393899 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61d2a6-dd59-433c-8e35-1b017e5daccc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:36.394752 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61d2a6-dd59-433c-8e35-1b017e5daccc service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:36.395166 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61d2a6-dd59-433c-8e35-1b017e5daccc service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:36.395568 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61d2a6-dd59-433c-8e35-1b017e5daccc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:36.398244 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1b61d2a6-dd59-433c-8e35-1b017e5daccc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:36.483349 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61d2a6-dd59-433c-8e35-1b017e5daccc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:36.485006 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61d2a6-dd59-433c-8e35-1b017e5daccc service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:36.496677 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 905/1814] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:36.704777 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4c077-c1d2-470d-a314-f40ff7b7f7d7 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:36.706347 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d1c4c077-c1d2-470d-a314-f40ff7b7f7d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:36.811386 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4c077-c1d2-470d-a314-f40ff7b7f7d7 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:36.824085 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9255a-24a7-4ddd-8ae4-4fe8c76c0b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:36.826925 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9255a-24a7-4ddd-8ae4-4fe8c76c0b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:36.827824 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9255a-24a7-4ddd-8ae4-4fe8c76c0b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:36.828201 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9255a-24a7-4ddd-8ae4-4fe8c76c0b39 admin admin] PATH_INFO: `/v3/projects/6809369660ab47eebf0331360a4243cf` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:36.829870 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9255a-24a7-4ddd-8ae4-4fe8c76c0b39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6809369660ab47eebf0331360a4243cf)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:36.834228 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9255a-24a7-4ddd-8ae4-4fe8c76c0b39 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:36.889292 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-c5f9255a-24a7-4ddd-8ae4-4fe8c76c0b39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6809369660ab47eebf0331360a4243cf', 'request_id': 'req-c5f9255a-24a7-4ddd-8ae4-4fe8c76c0b39'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:36.898214 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-c5f9255a-24a7-4ddd-8ae4-4fe8c76c0b39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6809369660ab47eebf0331360a4243cf', 'request_id': 'req-c5f9255a-24a7-4ddd-8ae4-4fe8c76c0b39'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:36.905011 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-c5f9255a-24a7-4ddd-8ae4-4fe8c76c0b39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6809369660ab47eebf0331360a4243cf', 'request_id': 'req-c5f9255a-24a7-4ddd-8ae4-4fe8c76c0b39'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:36.924728 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-c5f9255a-24a7-4ddd-8ae4-4fe8c76c0b39 admin admin] The token cache is being invalidate because project 6809369660ab47eebf0331360a4243cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:36.924946 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-c5f9255a-24a7-4ddd-8ae4-4fe8c76c0b39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:36.931121 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-c5f9255a-24a7-4ddd-8ae4-4fe8c76c0b39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:36.931121 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 910/1815] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:36 2022] DELETE /identity/v3/projects/6809369660ab47eebf0331360a4243cf => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:36.932564 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b26ee-940a-41f6-94e4-abb192bd9214 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:36.932909 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b26ee-940a-41f6-94e4-abb192bd9214 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:36.933208 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b26ee-940a-41f6-94e4-abb192bd9214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:36.953609 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-846b26ee-940a-41f6-94e4-abb192bd9214 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:36.954838 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-846b26ee-940a-41f6-94e4-abb192bd9214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:37.031565 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 906/1816] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:37.039223 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150fdff-5fc3-42b3-9092-0406a6c1fa57 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:37.039512 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150fdff-5fc3-42b3-9092-0406a6c1fa57 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:37.039788 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150fdff-5fc3-42b3-9092-0406a6c1fa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:37.059936 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-a150fdff-5fc3-42b3-9092-0406a6c1fa57 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:37.061160 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-a150fdff-5fc3-42b3-9092-0406a6c1fa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:37.069533 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 911/1817] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:37.073916 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b26ee-940a-41f6-94e4-abb192bd9214 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:37.083845 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b26ee-940a-41f6-94e4-abb192bd9214 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:37.089936 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d7344-3a50-4acd-bc7f-dff621feb1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:37.090840 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d7344-3a50-4acd-bc7f-dff621feb1dc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:37.091531 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d7344-3a50-4acd-bc7f-dff621feb1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:37.092040 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d7344-3a50-4acd-bc7f-dff621feb1dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:37.093246 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d7344-3a50-4acd-bc7f-dff621feb1dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:58:37.093672 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d7344-3a50-4acd-bc7f-dff621feb1dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:37.095361 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d7344-3a50-4acd-bc7f-dff621feb1dc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:37.113642 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 907/1818] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:58:37.118765 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150fdff-5fc3-42b3-9092-0406a6c1fa57 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:37.132536 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150fdff-5fc3-42b3-9092-0406a6c1fa57 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:37.163618 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e818e1-2a76-4cd4-bff3-0c3404cf04ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:37.164298 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e818e1-2a76-4cd4-bff3-0c3404cf04ab admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:37.164574 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e818e1-2a76-4cd4-bff3-0c3404cf04ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:37.164845 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e818e1-2a76-4cd4-bff3-0c3404cf04ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:37.165602 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e818e1-2a76-4cd4-bff3-0c3404cf04ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:37.170608 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e818e1-2a76-4cd4-bff3-0c3404cf04ab admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:37.224280 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 912/1819] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:37 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:37.225107 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d7344-3a50-4acd-bc7f-dff621feb1dc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:37.244485 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d7344-3a50-4acd-bc7f-dff621feb1dc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:37.348866 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e818e1-2a76-4cd4-bff3-0c3404cf04ab admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:37.350628 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b0e818e1-2a76-4cd4-bff3-0c3404cf04ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:37.371461 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8af9fb-f63a-44e1-b6de-465c386d16a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:37.374376 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8af9fb-f63a-44e1-b6de-465c386d16a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:37.374789 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8af9fb-f63a-44e1-b6de-465c386d16a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:37.375050 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8af9fb-f63a-44e1-b6de-465c386d16a3 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:37.375788 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8af9fb-f63a-44e1-b6de-465c386d16a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:37.377816 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8af9fb-f63a-44e1-b6de-465c386d16a3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:37.412944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 908/1820] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:37 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:58:37.417538 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8af9fb-f63a-44e1-b6de-465c386d16a3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:37.454300 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e818e1-2a76-4cd4-bff3-0c3404cf04ab admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:37.457437 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8af9fb-f63a-44e1-b6de-465c386d16a3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:37.463262 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68b7d5-78d3-4785-924e-5b61165a821c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:37.464325 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68b7d5-78d3-4785-924e-5b61165a821c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:37.464588 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f5dfb-38f5-40ae-afc8-99bb61bdba4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:37.464909 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68b7d5-78d3-4785-924e-5b61165a821c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:37.465337 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68b7d5-78d3-4785-924e-5b61165a821c admin admin] PATH_INFO: `/v3/users/36197be3ba9242429495bee469a52255` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:37.466687 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68b7d5-78d3-4785-924e-5b61165a821c admin admin] RBAC: Authorizing `identity:delete_user(user_id=36197be3ba9242429495bee469a52255)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:37.468020 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f5dfb-38f5-40ae-afc8-99bb61bdba4c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:37.468655 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f5dfb-38f5-40ae-afc8-99bb61bdba4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:37.468768 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68b7d5-78d3-4785-924e-5b61165a821c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:37.469091 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f5dfb-38f5-40ae-afc8-99bb61bdba4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:37.470415 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f5dfb-38f5-40ae-afc8-99bb61bdba4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:37.472877 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f5dfb-38f5-40ae-afc8-99bb61bdba4c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:37.494256 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 909/1821] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:37.515668 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f5dfb-38f5-40ae-afc8-99bb61bdba4c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:37.529141 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f5dfb-38f5-40ae-afc8-99bb61bdba4c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:37.542699 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-bf68b7d5-78d3-4785-924e-5b61165a821c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36197be3ba9242429495bee469a52255'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:37.546771 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c9cea-9efd-4621-8dd3-5408058cb77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:37.549585 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c9cea-9efd-4621-8dd3-5408058cb77e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:37.550233 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c9cea-9efd-4621-8dd3-5408058cb77e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:37.550512 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c9cea-9efd-4621-8dd3-5408058cb77e admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:37.551548 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c9cea-9efd-4621-8dd3-5408058cb77e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:37.551731 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-bf68b7d5-78d3-4785-924e-5b61165a821c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36197be3ba9242429495bee469a52255'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:37.554167 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c9cea-9efd-4621-8dd3-5408058cb77e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:37.564261 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-bf68b7d5-78d3-4785-924e-5b61165a821c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36197be3ba9242429495bee469a52255'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:37.565058 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-bf68b7d5-78d3-4785-924e-5b61165a821c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36197be3ba9242429495bee469a52255'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:37.565751 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-bf68b7d5-78d3-4785-924e-5b61165a821c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36197be3ba9242429495bee469a52255'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:37.569145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 910/1822] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:37.570774 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c9cea-9efd-4621-8dd3-5408058cb77e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:37.572564 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-728c9cea-9efd-4621-8dd3-5408058cb77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:37.584822 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 913/1823] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:37 2022] DELETE /identity/v3/users/36197be3ba9242429495bee469a52255 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:37.590036 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a25215-43de-4301-b84a-bcac1e02d670 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:37.590437 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a25215-43de-4301-b84a-bcac1e02d670 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:37.590810 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a25215-43de-4301-b84a-bcac1e02d670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:37.600417 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c9cea-9efd-4621-8dd3-5408058cb77e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:37.610824 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-b5a25215-43de-4301-b84a-bcac1e02d670 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:37.612463 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b5a25215-43de-4301-b84a-bcac1e02d670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:37.683919 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c542f-6954-4517-9eb4-f7cca88564de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:37.684978 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c542f-6954-4517-9eb4-f7cca88564de admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:37.685324 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c542f-6954-4517-9eb4-f7cca88564de admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:37.685725 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c542f-6954-4517-9eb4-f7cca88564de admin admin] PATH_INFO: `/v3/projects/2ffa2dee1ea74794a5d618db4e462902/users/d52f941d73d24330acdf28787b71af81/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:37.720974 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 914/1824] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:37.722671 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c542f-6954-4517-9eb4-f7cca88564de admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ffa2dee1ea74794a5d618db4e462902, user_id=d52f941d73d24330acdf28787b71af81, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:37.725493 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c542f-6954-4517-9eb4-f7cca88564de admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:37.732029 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a25215-43de-4301-b84a-bcac1e02d670 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:37.733666 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b5a25215-43de-4301-b84a-bcac1e02d670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:37.746817 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 911/1825] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:37 2022] PUT /identity/v3/projects/2ffa2dee1ea74794a5d618db4e462902/users/d52f941d73d24330acdf28787b71af81/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:37.757209 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d0278-8009-41f9-a9e5-f186e64b43d8 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:37.757539 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d0278-8009-41f9-a9e5-f186e64b43d8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:37.757811 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d0278-8009-41f9-a9e5-f186e64b43d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:37.785400 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-064d0278-8009-41f9-a9e5-f186e64b43d8 None None] MFA Rules not processed for user `d52f941d73d24330acdf28787b71af81`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:37.786605 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-064d0278-8009-41f9-a9e5-f186e64b43d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:37.802937 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a25215-43de-4301-b84a-bcac1e02d670 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:37.855110 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e5f6c-e142-4969-a74c-6c941cd7c277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:37.856053 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e5f6c-e142-4969-a74c-6c941cd7c277 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:37.856332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e5f6c-e142-4969-a74c-6c941cd7c277 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:37.856604 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e5f6c-e142-4969-a74c-6c941cd7c277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:37.865718 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 912/1826] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:37.866900 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d0278-8009-41f9-a9e5-f186e64b43d8 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:37.923314 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e5f6c-e142-4969-a74c-6c941cd7c277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:37.925281 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e5f6c-e142-4969-a74c-6c941cd7c277 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:37.934433 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d0278-8009-41f9-a9e5-f186e64b43d8 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:37.937209 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 915/1827] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:37.939688 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577a680-6f59-4012-baa9-4dadaac1c8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:37.940352 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577a680-6f59-4012-baa9-4dadaac1c8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:37.940691 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577a680-6f59-4012-baa9-4dadaac1c8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:37.940893 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577a680-6f59-4012-baa9-4dadaac1c8c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:37.941631 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577a680-6f59-4012-baa9-4dadaac1c8c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:37.943515 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577a680-6f59-4012-baa9-4dadaac1c8c8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:37.981003 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 913/1828] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:37 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:58:37.985199 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e5f6c-e142-4969-a74c-6c941cd7c277 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:37.996087 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e5f6c-e142-4969-a74c-6c941cd7c277 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:38.051007 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aaa641-4e98-4906-be2a-7bd8c2aff003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:38.051681 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aaa641-4e98-4906-be2a-7bd8c2aff003 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:38.051962 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aaa641-4e98-4906-be2a-7bd8c2aff003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:38.052237 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aaa641-4e98-4906-be2a-7bd8c2aff003 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:38.053317 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aaa641-4e98-4906-be2a-7bd8c2aff003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:38.055477 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aaa641-4e98-4906-be2a-7bd8c2aff003 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:38.077431 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 916/1829] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:37 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:38.082216 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577a680-6f59-4012-baa9-4dadaac1c8c8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:38.093670 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577a680-6f59-4012-baa9-4dadaac1c8c8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:38.099472 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0cde0-2c11-4953-b8e0-064f135f349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:38.100446 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0cde0-2c11-4953-b8e0-064f135f349a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:38.100911 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0cde0-2c11-4953-b8e0-064f135f349a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:38.101336 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0cde0-2c11-4953-b8e0-064f135f349a admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:38.102328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0cde0-2c11-4953-b8e0-064f135f349a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:38.104146 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0cde0-2c11-4953-b8e0-064f135f349a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:38.119614 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 914/1830] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:38.123884 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aaa641-4e98-4906-be2a-7bd8c2aff003 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:38.134770 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aaa641-4e98-4906-be2a-7bd8c2aff003 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:38.139772 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f7d05-66f8-4699-9297-0672d1583200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:38.140589 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f7d05-66f8-4699-9297-0672d1583200 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:38.140929 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f7d05-66f8-4699-9297-0672d1583200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:38.141272 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f7d05-66f8-4699-9297-0672d1583200 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:38.142115 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f7d05-66f8-4699-9297-0672d1583200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:38.143786 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f7d05-66f8-4699-9297-0672d1583200 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:38.160180 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 917/1831] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:38.165177 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0cde0-2c11-4953-b8e0-064f135f349a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:38.185606 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0cde0-2c11-4953-b8e0-064f135f349a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:38.195542 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf1a8c-5629-4894-84d8-89d5e0b3b1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:38.197754 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf1a8c-5629-4894-84d8-89d5e0b3b1ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:38.198081 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf1a8c-5629-4894-84d8-89d5e0b3b1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:38.198460 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf1a8c-5629-4894-84d8-89d5e0b3b1ca admin admin] PATH_INFO: `/v3/projects/ab4f1d4485634f09a20c422b8e3d6094/users/bb89982050684d9f81a4d6fafdb97ea8/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:38.223015 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf1a8c-5629-4894-84d8-89d5e0b3b1ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4f1d4485634f09a20c422b8e3d6094, user_id=bb89982050684d9f81a4d6fafdb97ea8, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:38.226738 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf1a8c-5629-4894-84d8-89d5e0b3b1ca admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:38.243241 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f7d05-66f8-4699-9297-0672d1583200 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:38.245378 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b38f7d05-66f8-4699-9297-0672d1583200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:38.260065 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 915/1832] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:38 2022] PUT /identity/v3/projects/ab4f1d4485634f09a20c422b8e3d6094/users/bb89982050684d9f81a4d6fafdb97ea8/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:38.262360 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f7d05-66f8-4699-9297-0672d1583200 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:38.271948 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625c2dc-9ff5-48b8-9550-8ac3e2d719d8 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:38.272238 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625c2dc-9ff5-48b8-9550-8ac3e2d719d8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:38.272504 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625c2dc-9ff5-48b8-9550-8ac3e2d719d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:38.301466 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-c625c2dc-9ff5-48b8-9550-8ac3e2d719d8 None None] MFA Rules not processed for user `bb89982050684d9f81a4d6fafdb97ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:38.303123 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c625c2dc-9ff5-48b8-9550-8ac3e2d719d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:38.325960 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f50a9-fd46-4062-890c-0a1cb938033a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:38.326827 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f50a9-fd46-4062-890c-0a1cb938033a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:38.327101 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f50a9-fd46-4062-890c-0a1cb938033a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:38.327375 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f50a9-fd46-4062-890c-0a1cb938033a admin admin] PATH_INFO: `/v3/projects/a3c39b180653407b844b26d3b2658938` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:38.328613 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f50a9-fd46-4062-890c-0a1cb938033a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3c39b180653407b844b26d3b2658938)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:38.330735 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f50a9-fd46-4062-890c-0a1cb938033a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:38.385815 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 916/1833] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:38.386578 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ac7f50a9-fd46-4062-890c-0a1cb938033a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3c39b180653407b844b26d3b2658938', 'request_id': 'req-ac7f50a9-fd46-4062-890c-0a1cb938033a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:38.388739 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625c2dc-9ff5-48b8-9550-8ac3e2d719d8 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:38.392887 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ac7f50a9-fd46-4062-890c-0a1cb938033a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3c39b180653407b844b26d3b2658938', 'request_id': 'req-ac7f50a9-fd46-4062-890c-0a1cb938033a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:38.399361 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ac7f50a9-fd46-4062-890c-0a1cb938033a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3c39b180653407b844b26d3b2658938', 'request_id': 'req-ac7f50a9-fd46-4062-890c-0a1cb938033a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:38.404957 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625c2dc-9ff5-48b8-9550-8ac3e2d719d8 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:38.416483 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ac7f50a9-fd46-4062-890c-0a1cb938033a admin admin] The token cache is being invalidate because project a3c39b180653407b844b26d3b2658938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:38.416843 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ac7f50a9-fd46-4062-890c-0a1cb938033a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:38.417617 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ac7f50a9-fd46-4062-890c-0a1cb938033a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:38.419483 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 918/1834] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:38 2022] DELETE /identity/v3/projects/a3c39b180653407b844b26d3b2658938 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:38.423743 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f50a9-fd46-4062-890c-0a1cb938033a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:38.425677 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ac7f50a9-fd46-4062-890c-0a1cb938033a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:38.494814 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea336e-17b9-4ec3-97be-78816eb90509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:38.495474 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea336e-17b9-4ec3-97be-78816eb90509 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:38.495746 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea336e-17b9-4ec3-97be-78816eb90509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:38.496013 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea336e-17b9-4ec3-97be-78816eb90509 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:38.496712 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea336e-17b9-4ec3-97be-78816eb90509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:38.498618 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea336e-17b9-4ec3-97be-78816eb90509 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:38.505220 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f50a9-fd46-4062-890c-0a1cb938033a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:38.517024 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bd5cd-853f-4747-a170-1ed6fe0587da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:38.517024 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bd5cd-853f-4747-a170-1ed6fe0587da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:38.517024 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bd5cd-853f-4747-a170-1ed6fe0587da admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:38.517024 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bd5cd-853f-4747-a170-1ed6fe0587da admin admin] PATH_INFO: `/v3/users/8b98f2909dbf4f8d9a926b515087eb60` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:38.517332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bd5cd-853f-4747-a170-1ed6fe0587da admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b98f2909dbf4f8d9a926b515087eb60)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:38.522182 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bd5cd-853f-4747-a170-1ed6fe0587da admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:38.529638 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 917/1835] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:38 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:38.533490 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea336e-17b9-4ec3-97be-78816eb90509 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:38.535304 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5dea336e-17b9-4ec3-97be-78816eb90509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:38.591297 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b52bd5cd-853f-4747-a170-1ed6fe0587da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b98f2909dbf4f8d9a926b515087eb60'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:38.603247 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b52bd5cd-853f-4747-a170-1ed6fe0587da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b98f2909dbf4f8d9a926b515087eb60'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:38.620465 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b52bd5cd-853f-4747-a170-1ed6fe0587da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b98f2909dbf4f8d9a926b515087eb60'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:38.621871 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b52bd5cd-853f-4747-a170-1ed6fe0587da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b98f2909dbf4f8d9a926b515087eb60'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:38.622488 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b52bd5cd-853f-4747-a170-1ed6fe0587da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b98f2909dbf4f8d9a926b515087eb60'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:38.629757 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea336e-17b9-4ec3-97be-78816eb90509 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:38.635155 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd7090-a9c9-4bba-858a-9d04f8dde41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:38.636280 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 919/1836] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:38 2022] DELETE /identity/v3/users/8b98f2909dbf4f8d9a926b515087eb60 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:38.636482 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd7090-a9c9-4bba-858a-9d04f8dde41d admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:38.636895 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd7090-a9c9-4bba-858a-9d04f8dde41d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:38.637160 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd7090-a9c9-4bba-858a-9d04f8dde41d admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:38.637951 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd7090-a9c9-4bba-858a-9d04f8dde41d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:38.639845 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd7090-a9c9-4bba-858a-9d04f8dde41d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:38.663328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 918/1837] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:38 2022] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:38.667392 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bd5cd-853f-4747-a170-1ed6fe0587da admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:38.669244 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b52bd5cd-853f-4747-a170-1ed6fe0587da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:38.778418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bd5cd-853f-4747-a170-1ed6fe0587da admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:38.785148 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a1e4e-d5ed-49f0-a348-a4e14de6a0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:38.785649 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a1e4e-d5ed-49f0-a348-a4e14de6a0ec admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:38.786656 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a1e4e-d5ed-49f0-a348-a4e14de6a0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:38.787010 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a1e4e-d5ed-49f0-a348-a4e14de6a0ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:38.787832 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a1e4e-d5ed-49f0-a348-a4e14de6a0ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:38.789739 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a1e4e-d5ed-49f0-a348-a4e14de6a0ec admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:38.806065 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 920/1838] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:38.810704 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd7090-a9c9-4bba-858a-9d04f8dde41d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:38.823748 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd7090-a9c9-4bba-858a-9d04f8dde41d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:38.836789 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43a29d-26dc-4786-932e-03391737f027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:38.838388 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43a29d-26dc-4786-932e-03391737f027 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:38.839561 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43a29d-26dc-4786-932e-03391737f027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:38.840321 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43a29d-26dc-4786-932e-03391737f027 admin admin] PATH_INFO: `/v3/projects/9ac5317e229c4b4bb0ed87069e4ddc72/users/650178f4f6994b71b22327298c630fe8/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:38.866209 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43a29d-26dc-4786-932e-03391737f027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac5317e229c4b4bb0ed87069e4ddc72, user_id=650178f4f6994b71b22327298c630fe8, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:38.869153 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43a29d-26dc-4786-932e-03391737f027 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:38.899543 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 919/1839] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:38 2022] PUT /identity/v3/projects/9ac5317e229c4b4bb0ed87069e4ddc72/users/650178f4f6994b71b22327298c630fe8/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:38.903508 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a1e4e-d5ed-49f0-a348-a4e14de6a0ec admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:38.916483 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a1e4e-d5ed-49f0-a348-a4e14de6a0ec admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:39.018567 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43a29d-26dc-4786-932e-03391737f027 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:39.021089 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-af43a29d-26dc-4786-932e-03391737f027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:39.044213 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df9188-ccb7-4e9a-908d-b099be07d9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:39.044213 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df9188-ccb7-4e9a-908d-b099be07d9db admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:39.044878 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df9188-ccb7-4e9a-908d-b099be07d9db admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:39.045289 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df9188-ccb7-4e9a-908d-b099be07d9db admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:39.046382 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df9188-ccb7-4e9a-908d-b099be07d9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:39.048845 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df9188-ccb7-4e9a-908d-b099be07d9db admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:39.064418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 921/1840] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:39.069565 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df9188-ccb7-4e9a-908d-b099be07d9db admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:39.100508 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df9188-ccb7-4e9a-908d-b099be07d9db admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:39.114113 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a592374-8fc0-4050-bc5f-d93e0bcc7b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:39.116085 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a592374-8fc0-4050-bc5f-d93e0bcc7b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:39.117204 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a592374-8fc0-4050-bc5f-d93e0bcc7b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:39.117516 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a592374-8fc0-4050-bc5f-d93e0bcc7b30 admin admin] PATH_INFO: `/v3/projects/9ac5317e229c4b4bb0ed87069e4ddc72/users/650178f4f6994b71b22327298c630fe8/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:39.128244 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a592374-8fc0-4050-bc5f-d93e0bcc7b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac5317e229c4b4bb0ed87069e4ddc72, user_id=650178f4f6994b71b22327298c630fe8, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:39.137324 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a592374-8fc0-4050-bc5f-d93e0bcc7b30 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:39.150846 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43a29d-26dc-4786-932e-03391737f027 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:39.166682 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 922/1841] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:39 2022] PUT /identity/v3/projects/9ac5317e229c4b4bb0ed87069e4ddc72/users/650178f4f6994b71b22327298c630fe8/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:39.176550 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df1442-2fe8-48d4-aa71-e1a96806348e None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:39.176840 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df1442-2fe8-48d4-aa71-e1a96806348e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:39.177134 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df1442-2fe8-48d4-aa71-e1a96806348e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:39.215765 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-60df1442-2fe8-48d4-aa71-e1a96806348e None None] MFA Rules not processed for user `650178f4f6994b71b22327298c630fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:39.217135 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-60df1442-2fe8-48d4-aa71-e1a96806348e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:39.219693 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c150e0-1e60-4d60-bf7c-507f75a34d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:39.220566 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c150e0-1e60-4d60-bf7c-507f75a34d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:39.220841 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c150e0-1e60-4d60-bf7c-507f75a34d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:39.221106 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c150e0-1e60-4d60-bf7c-507f75a34d9e admin admin] PATH_INFO: `/v3/projects/940235144fbc4c73af3787e4fb400e27` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:39.222350 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c150e0-1e60-4d60-bf7c-507f75a34d9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=940235144fbc4c73af3787e4fb400e27)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:39.224242 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c150e0-1e60-4d60-bf7c-507f75a34d9e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:39.278455 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-12c150e0-1e60-4d60-bf7c-507f75a34d9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '940235144fbc4c73af3787e4fb400e27', 'request_id': 'req-12c150e0-1e60-4d60-bf7c-507f75a34d9e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:39.284841 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-12c150e0-1e60-4d60-bf7c-507f75a34d9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '940235144fbc4c73af3787e4fb400e27', 'request_id': 'req-12c150e0-1e60-4d60-bf7c-507f75a34d9e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:39.293508 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-12c150e0-1e60-4d60-bf7c-507f75a34d9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '940235144fbc4c73af3787e4fb400e27', 'request_id': 'req-12c150e0-1e60-4d60-bf7c-507f75a34d9e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:39.294287 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 923/1842] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:39.305040 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df1442-2fe8-48d4-aa71-e1a96806348e None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:39.306623 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-60df1442-2fe8-48d4-aa71-e1a96806348e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:39.310011 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-12c150e0-1e60-4d60-bf7c-507f75a34d9e admin admin] The token cache is being invalidate because project 940235144fbc4c73af3787e4fb400e27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:39.310302 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-12c150e0-1e60-4d60-bf7c-507f75a34d9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:39.310941 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-12c150e0-1e60-4d60-bf7c-507f75a34d9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:39.312745 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 920/1843] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:39 2022] DELETE /identity/v3/projects/940235144fbc4c73af3787e4fb400e27 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:39.317954 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a481084-2579-4dc3-bcd1-8bcaa6c9cd8e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:39.318184 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a481084-2579-4dc3-bcd1-8bcaa6c9cd8e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:39.318476 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a481084-2579-4dc3-bcd1-8bcaa6c9cd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:39.340161 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-2a481084-2579-4dc3-bcd1-8bcaa6c9cd8e None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:39.342137 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2a481084-2579-4dc3-bcd1-8bcaa6c9cd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:39.370767 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df1442-2fe8-48d4-aa71-e1a96806348e None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:39.411053 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 921/1844] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:39.420187 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f19ad-def9-4586-9364-27edc809c682 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:39.420495 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f19ad-def9-4586-9364-27edc809c682 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:39.420755 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f19ad-def9-4586-9364-27edc809c682 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:39.422751 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 922/1845] 10.222.0.31 () {54 vars in 921 bytes} [Thu Feb 10 20:58:39 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 20:58:39.423378 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289eb06d-7f80-4297-a4f3-a91d546cf894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:39.424006 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea3dcc-b85a-4128-af61-5cd7d28e1627 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:39.424137 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea3dcc-b85a-4128-af61-5cd7d28e1627 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:39.424379 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea3dcc-b85a-4128-af61-5cd7d28e1627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:39.425337 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289eb06d-7f80-4297-a4f3-a91d546cf894 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:39.425835 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289eb06d-7f80-4297-a4f3-a91d546cf894 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:39.426269 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289eb06d-7f80-4297-a4f3-a91d546cf894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:39.428809 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-289eb06d-7f80-4297-a4f3-a91d546cf894 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:39.443809 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-09ea3dcc-b85a-4128-af61-5cd7d28e1627 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:39.445145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-09ea3dcc-b85a-4128-af61-5cd7d28e1627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:39.453690 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 923/1846] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:39.455010 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7f6fc-da28-483e-8c3d-fb7a0c189ded None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:39.455352 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7f6fc-da28-483e-8c3d-fb7a0c189ded None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:39.455699 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7f6fc-da28-483e-8c3d-fb7a0c189ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:39.477022 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-58e7f6fc-da28-483e-8c3d-fb7a0c189ded None None] MFA Rules not processed for user `c0d84b0d7e3d423aa972e58be27c772c`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:39.478276 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-58e7f6fc-da28-483e-8c3d-fb7a0c189ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:39.498988 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289eb06d-7f80-4297-a4f3-a91d546cf894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:39.501764 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289eb06d-7f80-4297-a4f3-a91d546cf894 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:39.513090 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 924/1847] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:39.514130 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289eb06d-7f80-4297-a4f3-a91d546cf894 service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:39.530170 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289eb06d-7f80-4297-a4f3-a91d546cf894 service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:39.535472 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa99fcb-91d6-4fd1-953e-18aa3124d38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:39.536204 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa99fcb-91d6-4fd1-953e-18aa3124d38b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:39.536482 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa99fcb-91d6-4fd1-953e-18aa3124d38b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:39.536751 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa99fcb-91d6-4fd1-953e-18aa3124d38b admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:39.537572 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa99fcb-91d6-4fd1-953e-18aa3124d38b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:58:39.537874 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa99fcb-91d6-4fd1-953e-18aa3124d38b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:39.544808 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa99fcb-91d6-4fd1-953e-18aa3124d38b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:39.559381 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 924/1848] 10.222.0.31 () {58 vars in 1018 bytes} [Thu Feb 10 20:58:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:39.560128 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 925/1849] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:58:39.563674 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7f6fc-da28-483e-8c3d-fb7a0c189ded None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:39.564946 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa99fcb-91d6-4fd1-953e-18aa3124d38b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:39.565155 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-58e7f6fc-da28-483e-8c3d-fb7a0c189ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:39.575036 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa99fcb-91d6-4fd1-953e-18aa3124d38b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:39.579809 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b89d2-c9f7-4874-a87d-3e2d1241e998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:39.580501 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b89d2-c9f7-4874-a87d-3e2d1241e998 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:39.580741 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b89d2-c9f7-4874-a87d-3e2d1241e998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:39.581013 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b89d2-c9f7-4874-a87d-3e2d1241e998 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:39.581548 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7f6fc-da28-483e-8c3d-fb7a0c189ded None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:39.581924 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b89d2-c9f7-4874-a87d-3e2d1241e998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:39.584011 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b89d2-c9f7-4874-a87d-3e2d1241e998 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:39.585416 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae91d8-f953-4d36-9d74-8e9bb5865f39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:39.586068 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae91d8-f953-4d36-9d74-8e9bb5865f39 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:39.586325 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae91d8-f953-4d36-9d74-8e9bb5865f39 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:39.586588 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae91d8-f953-4d36-9d74-8e9bb5865f39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:39.588488 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4eae91d8-f953-4d36-9d74-8e9bb5865f39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:39.616470 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 926/1850] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:39 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:39.617611 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b89d2-c9f7-4874-a87d-3e2d1241e998 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:39.619412 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-5b6b89d2-c9f7-4874-a87d-3e2d1241e998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:39.649932 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae91d8-f953-4d36-9d74-8e9bb5865f39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:39.651511 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae91d8-f953-4d36-9d74-8e9bb5865f39 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:39.661444 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 925/1851] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:58:39.663815 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae91d8-f953-4d36-9d74-8e9bb5865f39 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:39.679093 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae91d8-f953-4d36-9d74-8e9bb5865f39 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:39.702338 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b89d2-c9f7-4874-a87d-3e2d1241e998 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:39.709330 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f809a-3ab6-45c7-8e08-c5158e5e5c05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:39.710168 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f809a-3ab6-45c7-8e08-c5158e5e5c05 service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:39.710440 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f809a-3ab6-45c7-8e08-c5158e5e5c05 service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:39.710718 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f809a-3ab6-45c7-8e08-c5158e5e5c05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:39.720561 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f809a-3ab6-45c7-8e08-c5158e5e5c05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:39.722489 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f809a-3ab6-45c7-8e08-c5158e5e5c05 service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:39.734165 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 927/1852] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:39.738878 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596d24a-e2dd-430a-9957-153122b7e055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:39.739649 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596d24a-e2dd-430a-9957-153122b7e055 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:39.739819 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596d24a-e2dd-430a-9957-153122b7e055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:39.740092 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596d24a-e2dd-430a-9957-153122b7e055 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:39.740944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596d24a-e2dd-430a-9957-153122b7e055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:39.742721 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596d24a-e2dd-430a-9957-153122b7e055 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:39.767196 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 926/1853] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:39 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:39.768879 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f809a-3ab6-45c7-8e08-c5158e5e5c05 service nova] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:39.779646 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f809a-3ab6-45c7-8e08-c5158e5e5c05 service nova] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:39.785002 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e7ca2-4b6a-485e-b17b-510e9adce3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:39.785830 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e7ca2-4b6a-485e-b17b-510e9adce3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:39.786250 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e7ca2-4b6a-485e-b17b-510e9adce3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:39.786586 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e7ca2-4b6a-485e-b17b-510e9adce3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:39.787401 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e7ca2-4b6a-485e-b17b-510e9adce3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:39.789151 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e7ca2-4b6a-485e-b17b-510e9adce3f6 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:39.803000 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 928/1854] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:39.804313 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596d24a-e2dd-430a-9957-153122b7e055 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:39.815713 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596d24a-e2dd-430a-9957-153122b7e055 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:39.822160 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd189e0d-d847-4c73-b15f-c2c79dc4a347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:39.823236 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd189e0d-d847-4c73-b15f-c2c79dc4a347 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:39.823585 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd189e0d-d847-4c73-b15f-c2c79dc4a347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:39.823921 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd189e0d-d847-4c73-b15f-c2c79dc4a347 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:39.825571 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd189e0d-d847-4c73-b15f-c2c79dc4a347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:39.827298 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd189e0d-d847-4c73-b15f-c2c79dc4a347 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:39.840849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 927/1855] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:39.846514 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e7ca2-4b6a-485e-b17b-510e9adce3f6 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:39.867084 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e7ca2-4b6a-485e-b17b-510e9adce3f6 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:39.874118 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9e7fa-cf26-4fb2-b31e-2a534864404c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:39.875550 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9e7fa-cf26-4fb2-b31e-2a534864404c admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:39.875865 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9e7fa-cf26-4fb2-b31e-2a534864404c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:39.876150 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9e7fa-cf26-4fb2-b31e-2a534864404c admin admin] PATH_INFO: `/v3/projects/3d920c691f914502bd8d8d4c0462132e/users/175ae9fd0a05417288d9ed2ca2b86519/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:39.896058 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9e7fa-cf26-4fb2-b31e-2a534864404c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d920c691f914502bd8d8d4c0462132e, user_id=175ae9fd0a05417288d9ed2ca2b86519, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:39.898876 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9e7fa-cf26-4fb2-b31e-2a534864404c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:39.922087 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 929/1856] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:39 2022] PUT /identity/v3/projects/3d920c691f914502bd8d8d4c0462132e/users/175ae9fd0a05417288d9ed2ca2b86519/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:39.932383 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42246a4-ee1c-42e3-910a-11db5249a008 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:39.932676 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42246a4-ee1c-42e3-910a-11db5249a008 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:39.932947 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42246a4-ee1c-42e3-910a-11db5249a008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:39.962782 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-f42246a4-ee1c-42e3-910a-11db5249a008 None None] MFA Rules not processed for user `175ae9fd0a05417288d9ed2ca2b86519`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:39.964469 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f42246a4-ee1c-42e3-910a-11db5249a008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:40.098914 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 928/1857] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:40.102966 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9e7fa-cf26-4fb2-b31e-2a534864404c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:40.184618 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9e7fa-cf26-4fb2-b31e-2a534864404c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:40.191001 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3afa8-baae-42f0-9238-dfd5170db344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:40.191988 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3afa8-baae-42f0-9238-dfd5170db344 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:40.191988 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3afa8-baae-42f0-9238-dfd5170db344 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:40.192351 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3afa8-baae-42f0-9238-dfd5170db344 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:40.193190 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3afa8-baae-42f0-9238-dfd5170db344 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:40.202182 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3afa8-baae-42f0-9238-dfd5170db344 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:40.217796 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42246a4-ee1c-42e3-910a-11db5249a008 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:40.219977 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f42246a4-ee1c-42e3-910a-11db5249a008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:40.254685 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42246a4-ee1c-42e3-910a-11db5249a008 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:40.258120 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 930/1858] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:40 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:40.262582 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3afa8-baae-42f0-9238-dfd5170db344 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:40.263624 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e01b95-b652-4c5b-9558-7b156b6d0365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:40.266109 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e01b95-b652-4c5b-9558-7b156b6d0365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:40.266386 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e01b95-b652-4c5b-9558-7b156b6d0365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:40.266874 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e01b95-b652-4c5b-9558-7b156b6d0365 admin admin] PATH_INFO: `/v3/users/f6fc3abb4e374979b6757fb5f0e38409` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:40.270495 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e01b95-b652-4c5b-9558-7b156b6d0365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6fc3abb4e374979b6757fb5f0e38409)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:40.275057 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e01b95-b652-4c5b-9558-7b156b6d0365 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:40.368774 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3afa8-baae-42f0-9238-dfd5170db344 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:40.376875 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e190ae-03de-4bd5-8faf-b37e4a5b80fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:40.377589 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e190ae-03de-4bd5-8faf-b37e4a5b80fd admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:40.379085 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e190ae-03de-4bd5-8faf-b37e4a5b80fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:40.379369 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e190ae-03de-4bd5-8faf-b37e4a5b80fd admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:40.380088 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e190ae-03de-4bd5-8faf-b37e4a5b80fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:40.382276 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e190ae-03de-4bd5-8faf-b37e4a5b80fd admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:40.393049 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-55e01b95-b652-4c5b-9558-7b156b6d0365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6fc3abb4e374979b6757fb5f0e38409'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:40.402039 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-55e01b95-b652-4c5b-9558-7b156b6d0365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6fc3abb4e374979b6757fb5f0e38409'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:40.410682 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 931/1859] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:40 2022] POST /identity/v3/users => generated 299 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:40.413634 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e190ae-03de-4bd5-8faf-b37e4a5b80fd admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:40.434954 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e190ae-03de-4bd5-8faf-b37e4a5b80fd admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:40.440592 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eeba12-e609-46a1-b234-2ad2a8c12d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:40.441286 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeba12-e609-46a1-b234-2ad2a8c12d6e admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:40.442979 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeba12-e609-46a1-b234-2ad2a8c12d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:40.442979 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeba12-e609-46a1-b234-2ad2a8c12d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:40.443269 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eeba12-e609-46a1-b234-2ad2a8c12d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:40.445175 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eeba12-e609-46a1-b234-2ad2a8c12d6e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:40.453427 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-55e01b95-b652-4c5b-9558-7b156b6d0365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6fc3abb4e374979b6757fb5f0e38409'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:40.455986 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-55e01b95-b652-4c5b-9558-7b156b6d0365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6fc3abb4e374979b6757fb5f0e38409'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:40.458653 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 932/1860] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:40.464105 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eeba12-e609-46a1-b234-2ad2a8c12d6e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:40.480003 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eeba12-e609-46a1-b234-2ad2a8c12d6e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:40.483139 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-55e01b95-b652-4c5b-9558-7b156b6d0365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6fc3abb4e374979b6757fb5f0e38409'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:40.502939 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 929/1861] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:40 2022] DELETE /identity/v3/users/f6fc3abb4e374979b6757fb5f0e38409 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:40.505681 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffb622-0c72-4970-a62a-68f2e5b71e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:40.507283 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9abc4c-2bd7-45de-87c5-b5835d61de6a None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:40.507669 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9abc4c-2bd7-45de-87c5-b5835d61de6a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:40.508037 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9abc4c-2bd7-45de-87c5-b5835d61de6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:40.511008 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffb622-0c72-4970-a62a-68f2e5b71e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:40.511888 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffb622-0c72-4970-a62a-68f2e5b71e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:40.513090 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffb622-0c72-4970-a62a-68f2e5b71e1e admin admin] PATH_INFO: `/v3/projects/3e1fa78993354aa080b6096bdadfd9b1/users/ebcc36a7ec7d421bb40acb6cef677324/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:40.533935 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-4a9abc4c-2bd7-45de-87c5-b5835d61de6a None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:40.535230 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4a9abc4c-2bd7-45de-87c5-b5835d61de6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:40.556239 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaffb622-0c72-4970-a62a-68f2e5b71e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e1fa78993354aa080b6096bdadfd9b1, user_id=ebcc36a7ec7d421bb40acb6cef677324, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:40.559136 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaffb622-0c72-4970-a62a-68f2e5b71e1e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:40.574055 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 933/1862] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:40 2022] PUT /identity/v3/projects/3e1fa78993354aa080b6096bdadfd9b1/users/ebcc36a7ec7d421bb40acb6cef677324/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:40.578183 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffb622-0c72-4970-a62a-68f2e5b71e1e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:40.580585 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-aaffb622-0c72-4970-a62a-68f2e5b71e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:40.625031 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 930/1863] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:40.638525 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9abc4c-2bd7-45de-87c5-b5835d61de6a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:40.639893 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4a9abc4c-2bd7-45de-87c5-b5835d61de6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:40.672125 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffb622-0c72-4970-a62a-68f2e5b71e1e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:40.676739 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065677a1-871b-40aa-ad80-07e7f7201803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:40.677805 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065677a1-871b-40aa-ad80-07e7f7201803 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:40.678087 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065677a1-871b-40aa-ad80-07e7f7201803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:40.678371 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065677a1-871b-40aa-ad80-07e7f7201803 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:40.679102 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065677a1-871b-40aa-ad80-07e7f7201803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:40.680710 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065677a1-871b-40aa-ad80-07e7f7201803 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:40.690836 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 934/1864] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 20:58:40.695908 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065677a1-871b-40aa-ad80-07e7f7201803 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:40.696226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9abc4c-2bd7-45de-87c5-b5835d61de6a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:40.705166 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065677a1-871b-40aa-ad80-07e7f7201803 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:40.710171 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d102eca-ae3c-4890-a3bd-63070a26c7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:40.711050 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d102eca-ae3c-4890-a3bd-63070a26c7e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:40.711326 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d102eca-ae3c-4890-a3bd-63070a26c7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:40.711599 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d102eca-ae3c-4890-a3bd-63070a26c7e1 admin admin] PATH_INFO: `/v3/projects/3e1fa78993354aa080b6096bdadfd9b1/users/ebcc36a7ec7d421bb40acb6cef677324/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:40.713639 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d102eca-ae3c-4890-a3bd-63070a26c7e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e1fa78993354aa080b6096bdadfd9b1, user_id=ebcc36a7ec7d421bb40acb6cef677324, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:40.716242 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d102eca-ae3c-4890-a3bd-63070a26c7e1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:40.726868 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 935/1865] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:40 2022] PUT /identity/v3/projects/3e1fa78993354aa080b6096bdadfd9b1/users/ebcc36a7ec7d421bb40acb6cef677324/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:40.737444 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b1839-cbd0-4ac7-9812-06c53a2f8540 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:40.737731 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b1839-cbd0-4ac7-9812-06c53a2f8540 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:40.738003 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b1839-cbd0-4ac7-9812-06c53a2f8540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:40.747215 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd130cc0-32e2-4443-8070-f9e33ca2d74a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:40.747855 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd130cc0-32e2-4443-8070-f9e33ca2d74a service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:40.748132 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd130cc0-32e2-4443-8070-f9e33ca2d74a service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:40.748399 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd130cc0-32e2-4443-8070-f9e33ca2d74a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:40.758888 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd130cc0-32e2-4443-8070-f9e33ca2d74a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:40.760317 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd130cc0-32e2-4443-8070-f9e33ca2d74a service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:40.765210 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-8d7b1839-cbd0-4ac7-9812-06c53a2f8540 None None] MFA Rules not processed for user `ebcc36a7ec7d421bb40acb6cef677324`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:40.766438 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-8d7b1839-cbd0-4ac7-9812-06c53a2f8540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:40.769837 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 931/1866] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:40.838251 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 936/1867] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:40.848921 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd130cc0-32e2-4443-8070-f9e33ca2d74a service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:40.850328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-dd130cc0-32e2-4443-8070-f9e33ca2d74a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:40.907103 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd130cc0-32e2-4443-8070-f9e33ca2d74a service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:40.958343 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bac2e6-9b60-48c1-b2f6-79022eb51ed1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:40.958992 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bac2e6-9b60-48c1-b2f6-79022eb51ed1 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:40.959266 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bac2e6-9b60-48c1-b2f6-79022eb51ed1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:40.959528 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bac2e6-9b60-48c1-b2f6-79022eb51ed1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:40.961430 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-99bac2e6-9b60-48c1-b2f6-79022eb51ed1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:41.014947 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bac2e6-9b60-48c1-b2f6-79022eb51ed1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:41.016432 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bac2e6-9b60-48c1-b2f6-79022eb51ed1 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:41.025286 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 932/1868] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:41.038333 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b1839-cbd0-4ac7-9812-06c53a2f8540 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:41.040307 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-8d7b1839-cbd0-4ac7-9812-06c53a2f8540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:41.111523 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b1839-cbd0-4ac7-9812-06c53a2f8540 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:41.117380 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30aa03-6648-4821-8ccc-57e57ff8b30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:41.118542 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30aa03-6648-4821-8ccc-57e57ff8b30b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:41.118733 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30aa03-6648-4821-8ccc-57e57ff8b30b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:41.119072 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30aa03-6648-4821-8ccc-57e57ff8b30b admin admin] PATH_INFO: `/v3/projects/83785ff9e8874e4eb9be53d2802168dc` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:41.120392 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30aa03-6648-4821-8ccc-57e57ff8b30b admin admin] RBAC: Authorizing `identity:delete_project(project_id=83785ff9e8874e4eb9be53d2802168dc)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:41.122464 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30aa03-6648-4821-8ccc-57e57ff8b30b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:41.204748 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2e30aa03-6648-4821-8ccc-57e57ff8b30b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83785ff9e8874e4eb9be53d2802168dc', 'request_id': 'req-2e30aa03-6648-4821-8ccc-57e57ff8b30b'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:41.213092 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2e30aa03-6648-4821-8ccc-57e57ff8b30b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83785ff9e8874e4eb9be53d2802168dc', 'request_id': 'req-2e30aa03-6648-4821-8ccc-57e57ff8b30b'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:41.220905 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2e30aa03-6648-4821-8ccc-57e57ff8b30b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83785ff9e8874e4eb9be53d2802168dc', 'request_id': 'req-2e30aa03-6648-4821-8ccc-57e57ff8b30b'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:41.244562 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2e30aa03-6648-4821-8ccc-57e57ff8b30b admin admin] The token cache is being invalidate because project 83785ff9e8874e4eb9be53d2802168dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:41.244847 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2e30aa03-6648-4821-8ccc-57e57ff8b30b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:41.246804 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2e30aa03-6648-4821-8ccc-57e57ff8b30b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:41.252334 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 937/1869] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:41 2022] DELETE /identity/v3/projects/83785ff9e8874e4eb9be53d2802168dc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:41.256083 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd75c0-bbbb-467d-bbdb-1cef6d26f576 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:41.256592 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd75c0-bbbb-467d-bbdb-1cef6d26f576 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:41.257656 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd75c0-bbbb-467d-bbdb-1cef6d26f576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:41.282478 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ddfd75c0-bbbb-467d-bbdb-1cef6d26f576 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:41.296731 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ddfd75c0-bbbb-467d-bbdb-1cef6d26f576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:41.414755 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 933/1870] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:41.426369 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc116e79-ac51-4b9d-8da0-1b8cac2863ea None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:41.426369 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc116e79-ac51-4b9d-8da0-1b8cac2863ea None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:41.426369 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc116e79-ac51-4b9d-8da0-1b8cac2863ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:41.465298 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-bc116e79-ac51-4b9d-8da0-1b8cac2863ea None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:41.466591 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-bc116e79-ac51-4b9d-8da0-1b8cac2863ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:41.492074 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 938/1871] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:41.492659 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd75c0-bbbb-467d-bbdb-1cef6d26f576 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:41.507494 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd75c0-bbbb-467d-bbdb-1cef6d26f576 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:41.518516 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac5ffc-5f81-40e9-9651-db1d273fcfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:41.519312 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac5ffc-5f81-40e9-9651-db1d273fcfee admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:41.519829 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac5ffc-5f81-40e9-9651-db1d273fcfee admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:41.520198 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac5ffc-5f81-40e9-9651-db1d273fcfee admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:41.521057 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac5ffc-5f81-40e9-9651-db1d273fcfee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:58:41.523329 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac5ffc-5f81-40e9-9651-db1d273fcfee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:41.532469 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac5ffc-5f81-40e9-9651-db1d273fcfee admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:41.564870 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 934/1872] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:58:41.569330 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc116e79-ac51-4b9d-8da0-1b8cac2863ea None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:41.581871 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc116e79-ac51-4b9d-8da0-1b8cac2863ea None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:41.596742 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6523eda-a0b6-4897-b9d2-059ba8757b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:41.597563 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6523eda-a0b6-4897-b9d2-059ba8757b99 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:41.597903 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6523eda-a0b6-4897-b9d2-059ba8757b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:41.598296 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6523eda-a0b6-4897-b9d2-059ba8757b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:41.599067 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6523eda-a0b6-4897-b9d2-059ba8757b99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:41.601087 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6523eda-a0b6-4897-b9d2-059ba8757b99 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:41.650037 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 939/1873] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:41 2022] POST /identity/v3/projects => generated 367 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:41.651303 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac5ffc-5f81-40e9-9651-db1d273fcfee admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:41.671033 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac5ffc-5f81-40e9-9651-db1d273fcfee admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:41.781688 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4634838-e1da-4f53-a0d5-27f9fbdf77ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:41.781688 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4634838-e1da-4f53-a0d5-27f9fbdf77ae admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:41.781688 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4634838-e1da-4f53-a0d5-27f9fbdf77ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:41.781688 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4634838-e1da-4f53-a0d5-27f9fbdf77ae admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:41.782163 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4634838-e1da-4f53-a0d5-27f9fbdf77ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:41.782163 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4634838-e1da-4f53-a0d5-27f9fbdf77ae admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:41.818531 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 935/1874] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:41 2022] POST /identity/v3/users => generated 284 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:41.822936 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6523eda-a0b6-4897-b9d2-059ba8757b99 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:41.839913 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6523eda-a0b6-4897-b9d2-059ba8757b99 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:41.851910 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a1b5b-0ffc-406b-9e2e-e4ded07fec1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:41.852708 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a1b5b-0ffc-406b-9e2e-e4ded07fec1e admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:41.853078 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a1b5b-0ffc-406b-9e2e-e4ded07fec1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:41.853444 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a1b5b-0ffc-406b-9e2e-e4ded07fec1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:41.854648 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a1b5b-0ffc-406b-9e2e-e4ded07fec1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:41.856313 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a1b5b-0ffc-406b-9e2e-e4ded07fec1e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:41.870780 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 940/1875] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:41.876446 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4634838-e1da-4f53-a0d5-27f9fbdf77ae admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:41.892947 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4634838-e1da-4f53-a0d5-27f9fbdf77ae admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:41.903876 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e0950-6015-431d-a6bc-03c97fe9c6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:41.904756 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e0950-6015-431d-a6bc-03c97fe9c6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:41.905772 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e0950-6015-431d-a6bc-03c97fe9c6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:41.905772 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e0950-6015-431d-a6bc-03c97fe9c6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:41.911501 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e0950-6015-431d-a6bc-03c97fe9c6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:41.913117 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e0950-6015-431d-a6bc-03c97fe9c6d2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:41.925148 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 936/1876] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:41.930252 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a1b5b-0ffc-406b-9e2e-e4ded07fec1e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:41.945593 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a1b5b-0ffc-406b-9e2e-e4ded07fec1e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:41.951770 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4ace8-a21e-4dd0-9c40-01f2579e1ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:41.953162 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4ace8-a21e-4dd0-9c40-01f2579e1ff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:41.953633 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4ace8-a21e-4dd0-9c40-01f2579e1ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:41.954071 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4ace8-a21e-4dd0-9c40-01f2579e1ff0 admin admin] PATH_INFO: `/v3/projects/b74107f11b7643b981cf80532dfda614/users/3f1da0dcea1c481391ada4db03c97d57/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:41.973828 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4ace8-a21e-4dd0-9c40-01f2579e1ff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74107f11b7643b981cf80532dfda614, user_id=3f1da0dcea1c481391ada4db03c97d57, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:41.976622 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4ace8-a21e-4dd0-9c40-01f2579e1ff0 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:42.005743 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 941/1877] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:41 2022] PUT /identity/v3/projects/b74107f11b7643b981cf80532dfda614/users/3f1da0dcea1c481391ada4db03c97d57/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:42.012630 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3b0c6-6965-42ea-852a-c382f3b7d0e8 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:42.013037 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3b0c6-6965-42ea-852a-c382f3b7d0e8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:42.013926 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3b0c6-6965-42ea-852a-c382f3b7d0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:42.049431 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-16f3b0c6-6965-42ea-852a-c382f3b7d0e8 None None] MFA Rules not processed for user `3f1da0dcea1c481391ada4db03c97d57`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:42.050604 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-16f3b0c6-6965-42ea-852a-c382f3b7d0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:42.204500 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 937/1878] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:42.214382 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4ace8-a21e-4dd0-9c40-01f2579e1ff0 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:42.312194 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4ace8-a21e-4dd0-9c40-01f2579e1ff0 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:42.317056 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64883d8-19d2-461b-9aa6-71bac5bdaa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:42.317765 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64883d8-19d2-461b-9aa6-71bac5bdaa44 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:42.318043 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64883d8-19d2-461b-9aa6-71bac5bdaa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:42.318317 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64883d8-19d2-461b-9aa6-71bac5bdaa44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:42.319070 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64883d8-19d2-461b-9aa6-71bac5bdaa44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:42.321430 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64883d8-19d2-461b-9aa6-71bac5bdaa44 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:42.355217 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 942/1879] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:42 2022] POST /identity/v3/projects => generated 369 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:42.359308 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3b0c6-6965-42ea-852a-c382f3b7d0e8 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:42.371073 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3b0c6-6965-42ea-852a-c382f3b7d0e8 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:42.440066 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169464ab-a468-49e6-b03e-dd10d585ed15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:42.441054 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169464ab-a468-49e6-b03e-dd10d585ed15 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:42.441543 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169464ab-a468-49e6-b03e-dd10d585ed15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:42.441993 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169464ab-a468-49e6-b03e-dd10d585ed15 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:42.442902 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169464ab-a468-49e6-b03e-dd10d585ed15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:42.444971 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169464ab-a468-49e6-b03e-dd10d585ed15 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:42.470846 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 938/1880] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:42 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:42.474828 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64883d8-19d2-461b-9aa6-71bac5bdaa44 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:42.484995 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64883d8-19d2-461b-9aa6-71bac5bdaa44 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:42.489789 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c4fdc-d722-4490-bc56-07cf216ffc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:42.490453 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c4fdc-d722-4490-bc56-07cf216ffc03 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:42.490728 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c4fdc-d722-4490-bc56-07cf216ffc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:42.490994 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c4fdc-d722-4490-bc56-07cf216ffc03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:42.491731 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c4fdc-d722-4490-bc56-07cf216ffc03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:42.493332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c4fdc-d722-4490-bc56-07cf216ffc03 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:42.503675 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 943/1881] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:42.507859 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169464ab-a468-49e6-b03e-dd10d585ed15 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:42.518303 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169464ab-a468-49e6-b03e-dd10d585ed15 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:42.523546 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b308bd7-f9f3-4b9b-a9bb-7487dc3e259e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:42.524442 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b308bd7-f9f3-4b9b-a9bb-7487dc3e259e admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:42.524715 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b308bd7-f9f3-4b9b-a9bb-7487dc3e259e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:42.524971 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b308bd7-f9f3-4b9b-a9bb-7487dc3e259e admin admin] PATH_INFO: `/v3/projects/a493587db72f49679f96a50168c3035b/users/63dfb21914684628b1f582ddf16fe0d5/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:42.541342 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b308bd7-f9f3-4b9b-a9bb-7487dc3e259e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a493587db72f49679f96a50168c3035b, user_id=63dfb21914684628b1f582ddf16fe0d5, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:42.544105 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b308bd7-f9f3-4b9b-a9bb-7487dc3e259e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:42.558976 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 939/1882] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:42 2022] PUT /identity/v3/projects/a493587db72f49679f96a50168c3035b/users/63dfb21914684628b1f582ddf16fe0d5/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:42.563327 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c4fdc-d722-4490-bc56-07cf216ffc03 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:42.573210 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c4fdc-d722-4490-bc56-07cf216ffc03 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:42.628628 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b389509-c837-409a-a058-07059dd04832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:42.629302 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b389509-c837-409a-a058-07059dd04832 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:42.629609 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b389509-c837-409a-a058-07059dd04832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:42.629877 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b389509-c837-409a-a058-07059dd04832 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:42.630642 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b389509-c837-409a-a058-07059dd04832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:42.632214 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b389509-c837-409a-a058-07059dd04832 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:42.642671 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 944/1883] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:42.646847 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b308bd7-f9f3-4b9b-a9bb-7487dc3e259e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:42.656777 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b308bd7-f9f3-4b9b-a9bb-7487dc3e259e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:42.661679 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cc2bb-8737-4d21-95ce-7a009fb8bb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:42.662550 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cc2bb-8737-4d21-95ce-7a009fb8bb2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:42.662827 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cc2bb-8737-4d21-95ce-7a009fb8bb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:42.663115 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cc2bb-8737-4d21-95ce-7a009fb8bb2d admin admin] PATH_INFO: `/v3/projects/a493587db72f49679f96a50168c3035b/users/63dfb21914684628b1f582ddf16fe0d5/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:42.665287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646cc2bb-8737-4d21-95ce-7a009fb8bb2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a493587db72f49679f96a50168c3035b, user_id=63dfb21914684628b1f582ddf16fe0d5, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:42.668042 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646cc2bb-8737-4d21-95ce-7a009fb8bb2d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:42.678487 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 940/1884] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:42 2022] PUT /identity/v3/projects/a493587db72f49679f96a50168c3035b/users/63dfb21914684628b1f582ddf16fe0d5/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:42.689962 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcd40c-58ac-4ca8-b9f8-881c7aef4f5b None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:42.690253 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcd40c-58ac-4ca8-b9f8-881c7aef4f5b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:42.690523 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcd40c-58ac-4ca8-b9f8-881c7aef4f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:42.718629 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-64fcd40c-58ac-4ca8-b9f8-881c7aef4f5b None None] MFA Rules not processed for user `63dfb21914684628b1f582ddf16fe0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:42.719852 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-64fcd40c-58ac-4ca8-b9f8-881c7aef4f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:42.818425 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 945/1885] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:42 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:42.825381 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cc2bb-8737-4d21-95ce-7a009fb8bb2d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:42.827701 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-646cc2bb-8737-4d21-95ce-7a009fb8bb2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:42.834734 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcd40c-58ac-4ca8-b9f8-881c7aef4f5b None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:42.836313 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-64fcd40c-58ac-4ca8-b9f8-881c7aef4f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:42.909857 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cc2bb-8737-4d21-95ce-7a009fb8bb2d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:42.917784 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd4685-3829-4224-9a09-473f65b061e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:42.918730 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd4685-3829-4224-9a09-473f65b061e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:42.919080 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd4685-3829-4224-9a09-473f65b061e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:42.919331 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd4685-3829-4224-9a09-473f65b061e0 admin admin] PATH_INFO: `/v3/users/d52f941d73d24330acdf28787b71af81` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:42.920788 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd4685-3829-4224-9a09-473f65b061e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d52f941d73d24330acdf28787b71af81)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:42.923177 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd4685-3829-4224-9a09-473f65b061e0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:42.924819 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcd40c-58ac-4ca8-b9f8-881c7aef4f5b None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:42.930303 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3707d-3350-4a27-b9c0-6c5c28ba0e02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:42.931215 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3707d-3350-4a27-b9c0-6c5c28ba0e02 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:42.931664 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3707d-3350-4a27-b9c0-6c5c28ba0e02 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:42.932097 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3707d-3350-4a27-b9c0-6c5c28ba0e02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:42.944887 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3707d-3350-4a27-b9c0-6c5c28ba0e02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:42.946744 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3707d-3350-4a27-b9c0-6c5c28ba0e02 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:42.961250 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 946/1886] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:42 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:42.994237 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-22fd4685-3829-4224-9a09-473f65b061e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd52f941d73d24330acdf28787b71af81'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:43.003690 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-22fd4685-3829-4224-9a09-473f65b061e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd52f941d73d24330acdf28787b71af81'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:43.022901 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3707d-3350-4a27-b9c0-6c5c28ba0e02 service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:43.024586 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-a2d3707d-3350-4a27-b9c0-6c5c28ba0e02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:43.026132 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-22fd4685-3829-4224-9a09-473f65b061e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd52f941d73d24330acdf28787b71af81'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:43.027084 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-22fd4685-3829-4224-9a09-473f65b061e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd52f941d73d24330acdf28787b71af81'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:43.039306 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3707d-3350-4a27-b9c0-6c5c28ba0e02 service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:43.039833 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-22fd4685-3829-4224-9a09-473f65b061e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd52f941d73d24330acdf28787b71af81'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:43.043700 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a051b0-4218-4c28-8fac-a54e00b9af11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:43.044459 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a051b0-4218-4c28-8fac-a54e00b9af11 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:43.044846 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a051b0-4218-4c28-8fac-a54e00b9af11 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:43.045281 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a051b0-4218-4c28-8fac-a54e00b9af11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:43.047229 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-07a051b0-4218-4c28-8fac-a54e00b9af11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:43.048662 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 941/1887] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:42 2022] DELETE /identity/v3/users/d52f941d73d24330acdf28787b71af81 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:43.054661 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59922fa-00b5-4574-bf74-cd2518e8dade None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:43.054976 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59922fa-00b5-4574-bf74-cd2518e8dade None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:43.055830 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59922fa-00b5-4574-bf74-cd2518e8dade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:43.073103 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e59922fa-00b5-4574-bf74-cd2518e8dade None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:43.074359 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e59922fa-00b5-4574-bf74-cd2518e8dade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:43.128617 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a051b0-4218-4c28-8fac-a54e00b9af11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:43.130098 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a051b0-4218-4c28-8fac-a54e00b9af11 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:43.140038 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 947/1888] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:58:43.148478 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 942/1889] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:43.160118 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a051b0-4218-4c28-8fac-a54e00b9af11 service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:43.161707 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-07a051b0-4218-4c28-8fac-a54e00b9af11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:43.237051 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a051b0-4218-4c28-8fac-a54e00b9af11 service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:43.314889 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503cd11-ebd3-4368-b8d0-dbebfc307d63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:43.316504 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503cd11-ebd3-4368-b8d0-dbebfc307d63 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:43.317001 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503cd11-ebd3-4368-b8d0-dbebfc307d63 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:43.317675 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503cd11-ebd3-4368-b8d0-dbebfc307d63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:43.335259 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503cd11-ebd3-4368-b8d0-dbebfc307d63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:43.339493 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503cd11-ebd3-4368-b8d0-dbebfc307d63 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:43.358158 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 948/1890] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:58:43.676097 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59922fa-00b5-4574-bf74-cd2518e8dade None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:43.678183 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e59922fa-00b5-4574-bf74-cd2518e8dade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:43.691719 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59922fa-00b5-4574-bf74-cd2518e8dade None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:43.697309 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6015701-b00c-406f-947c-ba372eab5d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:43.698227 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6015701-b00c-406f-947c-ba372eab5d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:43.698504 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6015701-b00c-406f-947c-ba372eab5d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:43.698774 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6015701-b00c-406f-947c-ba372eab5d56 admin admin] PATH_INFO: `/v3/projects/2ffa2dee1ea74794a5d618db4e462902` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:43.700057 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6015701-b00c-406f-947c-ba372eab5d56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ffa2dee1ea74794a5d618db4e462902)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:43.702037 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6015701-b00c-406f-947c-ba372eab5d56 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:43.747345 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f6015701-b00c-406f-947c-ba372eab5d56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ffa2dee1ea74794a5d618db4e462902', 'request_id': 'req-f6015701-b00c-406f-947c-ba372eab5d56'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:43.752343 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f6015701-b00c-406f-947c-ba372eab5d56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ffa2dee1ea74794a5d618db4e462902', 'request_id': 'req-f6015701-b00c-406f-947c-ba372eab5d56'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:43.758164 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f6015701-b00c-406f-947c-ba372eab5d56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ffa2dee1ea74794a5d618db4e462902', 'request_id': 'req-f6015701-b00c-406f-947c-ba372eab5d56'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:43.772569 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f6015701-b00c-406f-947c-ba372eab5d56 admin admin] The token cache is being invalidate because project 2ffa2dee1ea74794a5d618db4e462902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:43.772881 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f6015701-b00c-406f-947c-ba372eab5d56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:43.773520 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f6015701-b00c-406f-947c-ba372eab5d56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:43.775162 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 943/1891] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:43 2022] DELETE /identity/v3/projects/2ffa2dee1ea74794a5d618db4e462902 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:43.780250 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503cd11-ebd3-4368-b8d0-dbebfc307d63 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:43.790369 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503cd11-ebd3-4368-b8d0-dbebfc307d63 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:43.847600 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a29fd-7b12-4bc4-9f11-23ce7e48af14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:43.848501 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a29fd-7b12-4bc4-9f11-23ce7e48af14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:43.848774 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a29fd-7b12-4bc4-9f11-23ce7e48af14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:43.849041 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a29fd-7b12-4bc4-9f11-23ce7e48af14 admin admin] PATH_INFO: `/v3/users/bb89982050684d9f81a4d6fafdb97ea8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:43.850248 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a29fd-7b12-4bc4-9f11-23ce7e48af14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb89982050684d9f81a4d6fafdb97ea8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:43.852149 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a29fd-7b12-4bc4-9f11-23ce7e48af14 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:43.904769 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-107a29fd-7b12-4bc4-9f11-23ce7e48af14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb89982050684d9f81a4d6fafdb97ea8'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:43.912209 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-107a29fd-7b12-4bc4-9f11-23ce7e48af14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb89982050684d9f81a4d6fafdb97ea8'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:43.925907 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-107a29fd-7b12-4bc4-9f11-23ce7e48af14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb89982050684d9f81a4d6fafdb97ea8'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:43.926931 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-107a29fd-7b12-4bc4-9f11-23ce7e48af14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb89982050684d9f81a4d6fafdb97ea8'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:43.928269 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-107a29fd-7b12-4bc4-9f11-23ce7e48af14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb89982050684d9f81a4d6fafdb97ea8'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:43.945760 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 949/1892] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:43 2022] DELETE /identity/v3/users/bb89982050684d9f81a4d6fafdb97ea8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:44.592881 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6015701-b00c-406f-947c-ba372eab5d56 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:44.594742 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f6015701-b00c-406f-947c-ba372eab5d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:44.608940 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6015701-b00c-406f-947c-ba372eab5d56 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:44.701298 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf40c3f-beb4-4939-9e75-f700a70a9864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:44.702205 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf40c3f-beb4-4939-9e75-f700a70a9864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:44.702725 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf40c3f-beb4-4939-9e75-f700a70a9864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:44.703008 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf40c3f-beb4-4939-9e75-f700a70a9864 admin admin] PATH_INFO: `/v3/projects/ab4f1d4485634f09a20c422b8e3d6094` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:44.704252 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf40c3f-beb4-4939-9e75-f700a70a9864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab4f1d4485634f09a20c422b8e3d6094)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:44.706396 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf40c3f-beb4-4939-9e75-f700a70a9864 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:44.800235 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4cf40c3f-beb4-4939-9e75-f700a70a9864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab4f1d4485634f09a20c422b8e3d6094', 'request_id': 'req-4cf40c3f-beb4-4939-9e75-f700a70a9864'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:44.818061 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4cf40c3f-beb4-4939-9e75-f700a70a9864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab4f1d4485634f09a20c422b8e3d6094', 'request_id': 'req-4cf40c3f-beb4-4939-9e75-f700a70a9864'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:44.826316 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4cf40c3f-beb4-4939-9e75-f700a70a9864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab4f1d4485634f09a20c422b8e3d6094', 'request_id': 'req-4cf40c3f-beb4-4939-9e75-f700a70a9864'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:44.850743 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4cf40c3f-beb4-4939-9e75-f700a70a9864 admin admin] The token cache is being invalidate because project ab4f1d4485634f09a20c422b8e3d6094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:44.851285 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4cf40c3f-beb4-4939-9e75-f700a70a9864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:44.852072 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4cf40c3f-beb4-4939-9e75-f700a70a9864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:44.853822 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 944/1893] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:44 2022] DELETE /identity/v3/projects/ab4f1d4485634f09a20c422b8e3d6094 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:44.858186 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a29fd-7b12-4bc4-9f11-23ce7e48af14 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:44.860365 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-107a29fd-7b12-4bc4-9f11-23ce7e48af14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:44.882919 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a29fd-7b12-4bc4-9f11-23ce7e48af14 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:44.970382 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f35c0f-55f4-49d8-8dd5-de828a827fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:44.971751 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f35c0f-55f4-49d8-8dd5-de828a827fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:44.972256 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f35c0f-55f4-49d8-8dd5-de828a827fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:44.973169 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f35c0f-55f4-49d8-8dd5-de828a827fa0 admin admin] PATH_INFO: `/v3/users/650178f4f6994b71b22327298c630fe8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:44.975508 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f35c0f-55f4-49d8-8dd5-de828a827fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=650178f4f6994b71b22327298c630fe8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:44.977657 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f35c0f-55f4-49d8-8dd5-de828a827fa0 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:45.052840 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-51f35c0f-55f4-49d8-8dd5-de828a827fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '650178f4f6994b71b22327298c630fe8'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:45.059963 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-51f35c0f-55f4-49d8-8dd5-de828a827fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '650178f4f6994b71b22327298c630fe8'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:45.072398 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-51f35c0f-55f4-49d8-8dd5-de828a827fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '650178f4f6994b71b22327298c630fe8'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:45.073332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-51f35c0f-55f4-49d8-8dd5-de828a827fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '650178f4f6994b71b22327298c630fe8'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:45.074525 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-51f35c0f-55f4-49d8-8dd5-de828a827fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '650178f4f6994b71b22327298c630fe8'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:45.088663 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 950/1894] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:44 2022] DELETE /identity/v3/users/650178f4f6994b71b22327298c630fe8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:45.476539 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf40c3f-beb4-4939-9e75-f700a70a9864 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:45.478516 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4cf40c3f-beb4-4939-9e75-f700a70a9864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:45.533069 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f35c0f-55f4-49d8-8dd5-de828a827fa0 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:45.534661 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-51f35c0f-55f4-49d8-8dd5-de828a827fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:45.540163 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf40c3f-beb4-4939-9e75-f700a70a9864 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:45.595231 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b2806-086c-4c64-b691-d93332a18157 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:45.596038 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b2806-086c-4c64-b691-d93332a18157 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:45.596250 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b2806-086c-4c64-b691-d93332a18157 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:45.596519 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b2806-086c-4c64-b691-d93332a18157 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:45.598699 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ea6b2806-086c-4c64-b691-d93332a18157 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:45.614914 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f35c0f-55f4-49d8-8dd5-de828a827fa0 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:45.620282 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b396326-71c6-4ae9-ba78-fe621e3a0bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:45.621613 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b396326-71c6-4ae9-ba78-fe621e3a0bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:45.622032 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b396326-71c6-4ae9-ba78-fe621e3a0bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:45.622431 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b396326-71c6-4ae9-ba78-fe621e3a0bf1 admin admin] PATH_INFO: `/v3/projects/9ac5317e229c4b4bb0ed87069e4ddc72` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:45.623769 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b396326-71c6-4ae9-ba78-fe621e3a0bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac5317e229c4b4bb0ed87069e4ddc72)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:45.625930 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b396326-71c6-4ae9-ba78-fe621e3a0bf1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:45.663524 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b2806-086c-4c64-b691-d93332a18157 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:45.665010 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b2806-086c-4c64-b691-d93332a18157 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:45.675216 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-7b396326-71c6-4ae9-ba78-fe621e3a0bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac5317e229c4b4bb0ed87069e4ddc72', 'request_id': 'req-7b396326-71c6-4ae9-ba78-fe621e3a0bf1'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:45.675969 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 945/1895] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:45.687540 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-7b396326-71c6-4ae9-ba78-fe621e3a0bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac5317e229c4b4bb0ed87069e4ddc72', 'request_id': 'req-7b396326-71c6-4ae9-ba78-fe621e3a0bf1'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:45.696221 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-7b396326-71c6-4ae9-ba78-fe621e3a0bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac5317e229c4b4bb0ed87069e4ddc72', 'request_id': 'req-7b396326-71c6-4ae9-ba78-fe621e3a0bf1'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:45.715926 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-7b396326-71c6-4ae9-ba78-fe621e3a0bf1 admin admin] The token cache is being invalidate because project 9ac5317e229c4b4bb0ed87069e4ddc72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:45.716215 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-7b396326-71c6-4ae9-ba78-fe621e3a0bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:45.717667 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-7b396326-71c6-4ae9-ba78-fe621e3a0bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:45.722063 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 951/1896] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:45 2022] DELETE /identity/v3/projects/9ac5317e229c4b4bb0ed87069e4ddc72 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:45.727916 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c956742-5922-45e6-8ef9-53961c1d048c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:45.728414 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c956742-5922-45e6-8ef9-53961c1d048c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:45.728414 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c956742-5922-45e6-8ef9-53961c1d048c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:45.747232 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-1c956742-5922-45e6-8ef9-53961c1d048c None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:45.748406 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1c956742-5922-45e6-8ef9-53961c1d048c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:45.826166 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 946/1897] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:45.835314 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424aa6ef-1055-491c-8b2b-747e23e80c9a None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:45.835606 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424aa6ef-1055-491c-8b2b-747e23e80c9a None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:45.835879 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424aa6ef-1055-491c-8b2b-747e23e80c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:45.859164 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-424aa6ef-1055-491c-8b2b-747e23e80c9a None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:45.861464 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-424aa6ef-1055-491c-8b2b-747e23e80c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:45.874024 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 952/1898] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:45.875298 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c956742-5922-45e6-8ef9-53961c1d048c None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:45.889073 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c956742-5922-45e6-8ef9-53961c1d048c None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:45.895220 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2c0d6-202b-4263-9ce8-a9f6ce1a140a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:45.896706 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2c0d6-202b-4263-9ce8-a9f6ce1a140a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:45.897338 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2c0d6-202b-4263-9ce8-a9f6ce1a140a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:45.897895 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2c0d6-202b-4263-9ce8-a9f6ce1a140a admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:45.898892 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2c0d6-202b-4263-9ce8-a9f6ce1a140a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:58:45.899525 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2c0d6-202b-4263-9ce8-a9f6ce1a140a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:45.901892 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2c0d6-202b-4263-9ce8-a9f6ce1a140a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:45.920381 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424aa6ef-1055-491c-8b2b-747e23e80c9a None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:45.929618 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 947/1899] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:58:45.931638 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424aa6ef-1055-491c-8b2b-747e23e80c9a None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:45.937089 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c28c12-a3dc-4a82-986e-f9d4c42e9e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:45.938191 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c28c12-a3dc-4a82-986e-f9d4c42e9e5d admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:45.939310 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c28c12-a3dc-4a82-986e-f9d4c42e9e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:45.940016 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c28c12-a3dc-4a82-986e-f9d4c42e9e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:45.941053 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c28c12-a3dc-4a82-986e-f9d4c42e9e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:45.943295 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c28c12-a3dc-4a82-986e-f9d4c42e9e5d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:46.055346 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 953/1900] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:45 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:46.056470 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2c0d6-202b-4263-9ce8-a9f6ce1a140a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:46.068850 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2c0d6-202b-4263-9ce8-a9f6ce1a140a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:46.146472 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d8cb4-9129-4c06-899e-3488308f8afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:46.147170 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d8cb4-9129-4c06-899e-3488308f8afa admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:46.147580 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d8cb4-9129-4c06-899e-3488308f8afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:46.147925 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d8cb4-9129-4c06-899e-3488308f8afa admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:46.148647 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d8cb4-9129-4c06-899e-3488308f8afa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:46.151043 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d8cb4-9129-4c06-899e-3488308f8afa admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:46.179793 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 948/1901] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:46 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:58:46.181794 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c28c12-a3dc-4a82-986e-f9d4c42e9e5d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:46.192672 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c28c12-a3dc-4a82-986e-f9d4c42e9e5d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:46.198465 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778f620-a188-4a55-b92f-44aafdba94fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:46.199378 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778f620-a188-4a55-b92f-44aafdba94fd admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:46.199722 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778f620-a188-4a55-b92f-44aafdba94fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:46.200057 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778f620-a188-4a55-b92f-44aafdba94fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:46.201035 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778f620-a188-4a55-b92f-44aafdba94fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:46.202809 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778f620-a188-4a55-b92f-44aafdba94fd admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:46.226065 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 954/1902] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:46.228461 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d8cb4-9129-4c06-899e-3488308f8afa admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:46.242382 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d8cb4-9129-4c06-899e-3488308f8afa admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:46.248000 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b692a8d-363c-4483-ae39-03c5a6518212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:46.248760 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b692a8d-363c-4483-ae39-03c5a6518212 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:46.249041 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b692a8d-363c-4483-ae39-03c5a6518212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:46.249341 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b692a8d-363c-4483-ae39-03c5a6518212 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:46.250279 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b692a8d-363c-4483-ae39-03c5a6518212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:46.252017 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b692a8d-363c-4483-ae39-03c5a6518212 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:46.270034 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 949/1903] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:46.275075 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778f620-a188-4a55-b92f-44aafdba94fd admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:46.302896 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778f620-a188-4a55-b92f-44aafdba94fd admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:46.317137 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e469f-9ad2-441f-898c-813706b7b42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:46.318260 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e469f-9ad2-441f-898c-813706b7b42c admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:46.318817 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e469f-9ad2-441f-898c-813706b7b42c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:46.319269 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e469f-9ad2-441f-898c-813706b7b42c admin admin] PATH_INFO: `/v3/projects/6082171fc85c4fc69790b47239efc2fc/users/96053bc4c9d9420480b0abbd07ca88c7/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:46.345622 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e469f-9ad2-441f-898c-813706b7b42c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6082171fc85c4fc69790b47239efc2fc, user_id=96053bc4c9d9420480b0abbd07ca88c7, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:46.349855 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e469f-9ad2-441f-898c-813706b7b42c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:46.377880 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 955/1904] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:46 2022] PUT /identity/v3/projects/6082171fc85c4fc69790b47239efc2fc/users/96053bc4c9d9420480b0abbd07ca88c7/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:46.391775 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd1ee8-47fc-468b-be80-320991a7ab11 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:46.392082 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd1ee8-47fc-468b-be80-320991a7ab11 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:46.392317 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd1ee8-47fc-468b-be80-320991a7ab11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:46.461008 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-3cbd1ee8-47fc-468b-be80-320991a7ab11 None None] MFA Rules not processed for user `96053bc4c9d9420480b0abbd07ca88c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:46.462250 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3cbd1ee8-47fc-468b-be80-320991a7ab11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:46.595834 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 950/1905] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:46.618073 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e469f-9ad2-441f-898c-813706b7b42c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:46.619921 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-6c2e469f-9ad2-441f-898c-813706b7b42c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:46.698468 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e469f-9ad2-441f-898c-813706b7b42c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:46.702349 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e59506-6dd1-4277-a489-146c8c4ba9eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:46.702995 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e59506-6dd1-4277-a489-146c8c4ba9eb service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:46.703272 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e59506-6dd1-4277-a489-146c8c4ba9eb service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:46.703537 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e59506-6dd1-4277-a489-146c8c4ba9eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:46.712151 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e59506-6dd1-4277-a489-146c8c4ba9eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:46.713813 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e59506-6dd1-4277-a489-146c8c4ba9eb service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:46.722815 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 956/1906] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:47.055628 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd1ee8-47fc-468b-be80-320991a7ab11 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:47.057213 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3cbd1ee8-47fc-468b-be80-320991a7ab11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:47.176592 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd1ee8-47fc-468b-be80-320991a7ab11 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:47.182024 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2eb6d-dad6-4864-a8ab-b7782bf819cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:47.183189 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2eb6d-dad6-4864-a8ab-b7782bf819cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:47.183539 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2eb6d-dad6-4864-a8ab-b7782bf819cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:47.183882 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2eb6d-dad6-4864-a8ab-b7782bf819cb admin admin] PATH_INFO: `/v3/users/3f1da0dcea1c481391ada4db03c97d57` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:47.185275 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf2eb6d-dad6-4864-a8ab-b7782bf819cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f1da0dcea1c481391ada4db03c97d57)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:47.187414 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf2eb6d-dad6-4864-a8ab-b7782bf819cb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:47.263019 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-fdf2eb6d-dad6-4864-a8ab-b7782bf819cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f1da0dcea1c481391ada4db03c97d57'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:47.271068 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-fdf2eb6d-dad6-4864-a8ab-b7782bf819cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f1da0dcea1c481391ada4db03c97d57'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:47.302588 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-fdf2eb6d-dad6-4864-a8ab-b7782bf819cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f1da0dcea1c481391ada4db03c97d57'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:47.303773 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-fdf2eb6d-dad6-4864-a8ab-b7782bf819cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f1da0dcea1c481391ada4db03c97d57'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:47.318053 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-fdf2eb6d-dad6-4864-a8ab-b7782bf819cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f1da0dcea1c481391ada4db03c97d57'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:47.330066 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 951/1907] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:47 2022] DELETE /identity/v3/users/3f1da0dcea1c481391ada4db03c97d57 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:47.334813 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b295bc9-88c5-4b05-a21d-63d1356ffd9f None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:47.335313 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b295bc9-88c5-4b05-a21d-63d1356ffd9f None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:47.335592 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b295bc9-88c5-4b05-a21d-63d1356ffd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:47.364615 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-2b295bc9-88c5-4b05-a21d-63d1356ffd9f None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:47.366124 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-2b295bc9-88c5-4b05-a21d-63d1356ffd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:47.477823 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 957/1908] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:47.492957 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2eb6d-dad6-4864-a8ab-b7782bf819cb admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:47.495296 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-fdf2eb6d-dad6-4864-a8ab-b7782bf819cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:47.607642 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2eb6d-dad6-4864-a8ab-b7782bf819cb admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:47.613721 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbdc45-e430-4017-8b19-cd4d1f292b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:47.615295 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbdc45-e430-4017-8b19-cd4d1f292b65 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:47.615901 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbdc45-e430-4017-8b19-cd4d1f292b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:47.616529 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbdc45-e430-4017-8b19-cd4d1f292b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:47.628744 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbdc45-e430-4017-8b19-cd4d1f292b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:47.630552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbdc45-e430-4017-8b19-cd4d1f292b65 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:47.642793 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 952/1909] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:48.088721 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b295bc9-88c5-4b05-a21d-63d1356ffd9f None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:48.090487 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-2b295bc9-88c5-4b05-a21d-63d1356ffd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:48.104210 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b295bc9-88c5-4b05-a21d-63d1356ffd9f None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:48.111146 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840d711-0755-4676-8de1-13755446b7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:48.112016 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840d711-0755-4676-8de1-13755446b7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:48.112016 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840d711-0755-4676-8de1-13755446b7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:48.112225 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840d711-0755-4676-8de1-13755446b7d8 admin admin] PATH_INFO: `/v3/users/445960f7ae734f3cb90b670862264180` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:48.113802 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840d711-0755-4676-8de1-13755446b7d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=445960f7ae734f3cb90b670862264180)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:48.116515 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840d711-0755-4676-8de1-13755446b7d8 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:48.163534 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbdc45-e430-4017-8b19-cd4d1f292b65 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:48.165855 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0ffbdc45-e430-4017-8b19-cd4d1f292b65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:48.184986 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbdc45-e430-4017-8b19-cd4d1f292b65 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:48.216620 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1288fb3-f2ae-48ac-8f90-26bf01244c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:48.218197 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1288fb3-f2ae-48ac-8f90-26bf01244c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:48.218674 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1288fb3-f2ae-48ac-8f90-26bf01244c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:48.219290 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1288fb3-f2ae-48ac-8f90-26bf01244c6e admin admin] PATH_INFO: `/v3/projects/b74107f11b7643b981cf80532dfda614` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:48.221444 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1288fb3-f2ae-48ac-8f90-26bf01244c6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b74107f11b7643b981cf80532dfda614)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:48.225338 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1288fb3-f2ae-48ac-8f90-26bf01244c6e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:48.236717 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d840d711-0755-4676-8de1-13755446b7d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445960f7ae734f3cb90b670862264180'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:48.254595 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d840d711-0755-4676-8de1-13755446b7d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445960f7ae734f3cb90b670862264180'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:48.279473 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d840d711-0755-4676-8de1-13755446b7d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445960f7ae734f3cb90b670862264180'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:48.280897 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d840d711-0755-4676-8de1-13755446b7d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445960f7ae734f3cb90b670862264180'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:48.281669 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d840d711-0755-4676-8de1-13755446b7d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445960f7ae734f3cb90b670862264180'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:48.288587 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b1288fb3-f2ae-48ac-8f90-26bf01244c6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b74107f11b7643b981cf80532dfda614', 'request_id': 'req-b1288fb3-f2ae-48ac-8f90-26bf01244c6e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:48.294617 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b1288fb3-f2ae-48ac-8f90-26bf01244c6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b74107f11b7643b981cf80532dfda614', 'request_id': 'req-b1288fb3-f2ae-48ac-8f90-26bf01244c6e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:48.302872 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b1288fb3-f2ae-48ac-8f90-26bf01244c6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b74107f11b7643b981cf80532dfda614', 'request_id': 'req-b1288fb3-f2ae-48ac-8f90-26bf01244c6e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:48.307981 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 958/1910] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:48 2022] DELETE /identity/v3/users/445960f7ae734f3cb90b670862264180 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:48.309566 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db83030-564e-42f0-80e5-34e0c62175c5 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:48.309860 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db83030-564e-42f0-80e5-34e0c62175c5 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:48.310168 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db83030-564e-42f0-80e5-34e0c62175c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:48.342772 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-3db83030-564e-42f0-80e5-34e0c62175c5 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:48.343502 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b1288fb3-f2ae-48ac-8f90-26bf01244c6e admin admin] The token cache is being invalidate because project b74107f11b7643b981cf80532dfda614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:48.343502 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b1288fb3-f2ae-48ac-8f90-26bf01244c6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:48.344010 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-3db83030-564e-42f0-80e5-34e0c62175c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:48.344965 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b1288fb3-f2ae-48ac-8f90-26bf01244c6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:48.352292 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 953/1911] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:48 2022] DELETE /identity/v3/projects/b74107f11b7643b981cf80532dfda614 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:48.353212 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1288fb3-f2ae-48ac-8f90-26bf01244c6e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:48.356349 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b1288fb3-f2ae-48ac-8f90-26bf01244c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:48.455735 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 959/1912] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:48.456884 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1288fb3-f2ae-48ac-8f90-26bf01244c6e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:48.462062 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06628d1-51ce-4b71-b50f-6fb6c89db57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:48.462953 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06628d1-51ce-4b71-b50f-6fb6c89db57a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:48.463226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06628d1-51ce-4b71-b50f-6fb6c89db57a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:48.463488 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06628d1-51ce-4b71-b50f-6fb6c89db57a admin admin] PATH_INFO: `/v3/users/63dfb21914684628b1f582ddf16fe0d5` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:48.465755 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06628d1-51ce-4b71-b50f-6fb6c89db57a admin admin] RBAC: Authorizing `identity:delete_user(user_id=63dfb21914684628b1f582ddf16fe0d5)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:48.466917 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db83030-564e-42f0-80e5-34e0c62175c5 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:48.467675 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06628d1-51ce-4b71-b50f-6fb6c89db57a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:48.468655 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-3db83030-564e-42f0-80e5-34e0c62175c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:48.559054 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b06628d1-51ce-4b71-b50f-6fb6c89db57a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63dfb21914684628b1f582ddf16fe0d5'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:48.576624 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b06628d1-51ce-4b71-b50f-6fb6c89db57a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63dfb21914684628b1f582ddf16fe0d5'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:48.583526 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db83030-564e-42f0-80e5-34e0c62175c5 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:48.594423 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f6bab-ad26-4185-8690-7ff46f2c7b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:48.595126 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f6bab-ad26-4185-8690-7ff46f2c7b6c service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:48.595411 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f6bab-ad26-4185-8690-7ff46f2c7b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:48.595690 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f6bab-ad26-4185-8690-7ff46f2c7b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:48.610692 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b06628d1-51ce-4b71-b50f-6fb6c89db57a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63dfb21914684628b1f582ddf16fe0d5'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:48.611944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b06628d1-51ce-4b71-b50f-6fb6c89db57a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63dfb21914684628b1f582ddf16fe0d5'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:48.615359 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f6bab-ad26-4185-8690-7ff46f2c7b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:48.617071 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f6bab-ad26-4185-8690-7ff46f2c7b6c service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:48.636060 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 960/1913] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:48.639042 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b06628d1-51ce-4b71-b50f-6fb6c89db57a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63dfb21914684628b1f582ddf16fe0d5'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:48.646267 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 954/1914] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:48 2022] DELETE /identity/v3/users/63dfb21914684628b1f582ddf16fe0d5 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:49.346616 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f6bab-ad26-4185-8690-7ff46f2c7b6c service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:49.363138 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f6bab-ad26-4185-8690-7ff46f2c7b6c service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:49.474320 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357e910-6c72-4376-bd89-4a1aaf1be894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:49.477078 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357e910-6c72-4376-bd89-4a1aaf1be894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:49.477882 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357e910-6c72-4376-bd89-4a1aaf1be894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:49.478223 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357e910-6c72-4376-bd89-4a1aaf1be894 admin admin] PATH_INFO: `/v3/projects/a493587db72f49679f96a50168c3035b` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:49.494681 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357e910-6c72-4376-bd89-4a1aaf1be894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a493587db72f49679f96a50168c3035b)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:49.499840 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357e910-6c72-4376-bd89-4a1aaf1be894 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:49.613012 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f357e910-6c72-4376-bd89-4a1aaf1be894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a493587db72f49679f96a50168c3035b', 'request_id': 'req-f357e910-6c72-4376-bd89-4a1aaf1be894'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:49.631086 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f357e910-6c72-4376-bd89-4a1aaf1be894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a493587db72f49679f96a50168c3035b', 'request_id': 'req-f357e910-6c72-4376-bd89-4a1aaf1be894'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:49.632682 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06628d1-51ce-4b71-b50f-6fb6c89db57a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:49.635642 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b06628d1-51ce-4b71-b50f-6fb6c89db57a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:49.645945 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f357e910-6c72-4376-bd89-4a1aaf1be894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a493587db72f49679f96a50168c3035b', 'request_id': 'req-f357e910-6c72-4376-bd89-4a1aaf1be894'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:49.674174 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06628d1-51ce-4b71-b50f-6fb6c89db57a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:49.676219 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f357e910-6c72-4376-bd89-4a1aaf1be894 admin admin] The token cache is being invalidate because project a493587db72f49679f96a50168c3035b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:49.676575 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f357e910-6c72-4376-bd89-4a1aaf1be894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:49.677704 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f357e910-6c72-4376-bd89-4a1aaf1be894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:49.680031 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 961/1915] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:49 2022] DELETE /identity/v3/projects/a493587db72f49679f96a50168c3035b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:49.684967 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657b305-8c63-46c9-a564-74134acdb5af None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:49.685257 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657b305-8c63-46c9-a564-74134acdb5af None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:49.685593 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657b305-8c63-46c9-a564-74134acdb5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:49.704778 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-d657b305-8c63-46c9-a564-74134acdb5af None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:49.706106 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d657b305-8c63-46c9-a564-74134acdb5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:49.740968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4eab2-ab67-45e4-965c-87f1afaab5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:49.741908 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4eab2-ab67-45e4-965c-87f1afaab5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:49.742188 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4eab2-ab67-45e4-965c-87f1afaab5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:49.742493 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4eab2-ab67-45e4-965c-87f1afaab5c5 admin admin] PATH_INFO: `/v3/projects/4e5dd18e290040eb881548ce1b3118c0` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:49.743889 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4eab2-ab67-45e4-965c-87f1afaab5c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e5dd18e290040eb881548ce1b3118c0)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:49.745884 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4eab2-ab67-45e4-965c-87f1afaab5c5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:49.786127 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 962/1916] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:49.793769 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d41489-4b83-464b-b937-2708c55b5991 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:49.794062 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d41489-4b83-464b-b937-2708c55b5991 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:49.794343 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d41489-4b83-464b-b937-2708c55b5991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:49.799302 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-09c4eab2-ab67-45e4-965c-87f1afaab5c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e5dd18e290040eb881548ce1b3118c0', 'request_id': 'req-09c4eab2-ab67-45e4-965c-87f1afaab5c5'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:49.806800 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-09c4eab2-ab67-45e4-965c-87f1afaab5c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e5dd18e290040eb881548ce1b3118c0', 'request_id': 'req-09c4eab2-ab67-45e4-965c-87f1afaab5c5'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:49.813678 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-09c4eab2-ab67-45e4-965c-87f1afaab5c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e5dd18e290040eb881548ce1b3118c0', 'request_id': 'req-09c4eab2-ab67-45e4-965c-87f1afaab5c5'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:49.818501 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-56d41489-4b83-464b-b937-2708c55b5991 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:49.819854 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-56d41489-4b83-464b-b937-2708c55b5991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:49.833190 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-09c4eab2-ab67-45e4-965c-87f1afaab5c5 admin admin] The token cache is being invalidate because project 4e5dd18e290040eb881548ce1b3118c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:49.833586 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-09c4eab2-ab67-45e4-965c-87f1afaab5c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:49.834887 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-09c4eab2-ab67-45e4-965c-87f1afaab5c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:49.836515 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 955/1917] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:49 2022] DELETE /identity/v3/projects/4e5dd18e290040eb881548ce1b3118c0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:49.842128 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4eab2-ab67-45e4-965c-87f1afaab5c5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:49.844129 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-09c4eab2-ab67-45e4-965c-87f1afaab5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:49.895064 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 963/1918] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:49.899306 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d41489-4b83-464b-b937-2708c55b5991 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:49.909952 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d41489-4b83-464b-b937-2708c55b5991 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:49.912561 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4eab2-ab67-45e4-965c-87f1afaab5c5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:49.915388 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef854b-584b-452a-80a4-acc158861df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:49.916238 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef854b-584b-452a-80a4-acc158861df1 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:49.916565 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef854b-584b-452a-80a4-acc158861df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:49.916889 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef854b-584b-452a-80a4-acc158861df1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:49.917863 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef854b-584b-452a-80a4-acc158861df1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:58:49.918262 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef854b-584b-452a-80a4-acc158861df1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:49.918835 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb945b-51da-4309-b172-01d862948264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:49.919872 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb945b-51da-4309-b172-01d862948264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:49.920201 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb945b-51da-4309-b172-01d862948264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:49.920299 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef854b-584b-452a-80a4-acc158861df1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:49.920422 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb945b-51da-4309-b172-01d862948264 admin admin] PATH_INFO: `/v3/users/ffc825bfd0a642f991ade0324d8db66c` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:49.922899 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb945b-51da-4309-b172-01d862948264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc825bfd0a642f991ade0324d8db66c)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:49.925324 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb945b-51da-4309-b172-01d862948264 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:49.937060 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 964/1919] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:58:49.938201 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef854b-584b-452a-80a4-acc158861df1 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:49.956157 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef854b-584b-452a-80a4-acc158861df1 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:49.966304 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc3def-cdbd-4f13-9623-c134e0712574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:49.967057 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc3def-cdbd-4f13-9623-c134e0712574 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:49.967401 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc3def-cdbd-4f13-9623-c134e0712574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:49.967978 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc3def-cdbd-4f13-9623-c134e0712574 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:49.968864 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc3def-cdbd-4f13-9623-c134e0712574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:49.972227 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc3def-cdbd-4f13-9623-c134e0712574 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:49.994395 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c5eb945b-51da-4309-b172-01d862948264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc825bfd0a642f991ade0324d8db66c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:50.001770 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c5eb945b-51da-4309-b172-01d862948264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc825bfd0a642f991ade0324d8db66c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:50.004376 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 965/1920] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:49 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:50.008804 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc3def-cdbd-4f13-9623-c134e0712574 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:50.014294 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c5eb945b-51da-4309-b172-01d862948264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc825bfd0a642f991ade0324d8db66c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:50.015117 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c5eb945b-51da-4309-b172-01d862948264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc825bfd0a642f991ade0324d8db66c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:50.026051 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c5eb945b-51da-4309-b172-01d862948264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc825bfd0a642f991ade0324d8db66c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:50.033802 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 956/1921] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:49 2022] DELETE /identity/v3/users/ffc825bfd0a642f991ade0324d8db66c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:50.090748 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc3def-cdbd-4f13-9623-c134e0712574 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:50.160933 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9ca00-a13a-4af9-ac70-baec5ee64eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:50.162073 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9ca00-a13a-4af9-ac70-baec5ee64eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:50.162627 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9ca00-a13a-4af9-ac70-baec5ee64eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:50.163081 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9ca00-a13a-4af9-ac70-baec5ee64eb9 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:50.164112 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9ca00-a13a-4af9-ac70-baec5ee64eb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:50.166837 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9ca00-a13a-4af9-ac70-baec5ee64eb9 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:50.226782 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 966/1922] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:50 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:50.230950 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb945b-51da-4309-b172-01d862948264 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:50.232542 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c5eb945b-51da-4309-b172-01d862948264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:50.249617 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb945b-51da-4309-b172-01d862948264 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:50.254950 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60352ed6-6e9d-4588-9077-02c4dcbc1256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:50.255803 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60352ed6-6e9d-4588-9077-02c4dcbc1256 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:50.256273 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60352ed6-6e9d-4588-9077-02c4dcbc1256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:50.256667 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60352ed6-6e9d-4588-9077-02c4dcbc1256 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:50.257665 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60352ed6-6e9d-4588-9077-02c4dcbc1256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:50.259390 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60352ed6-6e9d-4588-9077-02c4dcbc1256 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:50.273699 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 957/1923] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:50.277877 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9ca00-a13a-4af9-ac70-baec5ee64eb9 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:50.292837 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9ca00-a13a-4af9-ac70-baec5ee64eb9 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:50.301582 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073642d2-d281-4983-b5be-8b0385207193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:50.302633 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073642d2-d281-4983-b5be-8b0385207193 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:50.302998 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073642d2-d281-4983-b5be-8b0385207193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:50.303239 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073642d2-d281-4983-b5be-8b0385207193 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:50.303995 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073642d2-d281-4983-b5be-8b0385207193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:50.305702 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073642d2-d281-4983-b5be-8b0385207193 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:50.335632 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60352ed6-6e9d-4588-9077-02c4dcbc1256 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:50.337410 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 967/1924] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:50.364285 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60352ed6-6e9d-4588-9077-02c4dcbc1256 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:50.381919 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039ee4a-a368-45ce-9dd4-3455d1300fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:50.383605 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039ee4a-a368-45ce-9dd4-3455d1300fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:50.385551 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039ee4a-a368-45ce-9dd4-3455d1300fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:50.385865 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039ee4a-a368-45ce-9dd4-3455d1300fd0 admin admin] PATH_INFO: `/v3/projects/fe3dbbd3934344ceba1d9f4399630733/users/e204e83dc0804748a974a92949581e5e/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:50.405864 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073642d2-d281-4983-b5be-8b0385207193 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:50.407706 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-073642d2-d281-4983-b5be-8b0385207193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:50.417239 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039ee4a-a368-45ce-9dd4-3455d1300fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3dbbd3934344ceba1d9f4399630733, user_id=e204e83dc0804748a974a92949581e5e, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:50.425883 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039ee4a-a368-45ce-9dd4-3455d1300fd0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:50.429412 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073642d2-d281-4983-b5be-8b0385207193 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:50.438190 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8c675-a4bf-427c-ba5f-e94108a548ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:50.439391 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8c675-a4bf-427c-ba5f-e94108a548ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:50.439732 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8c675-a4bf-427c-ba5f-e94108a548ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:50.440016 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8c675-a4bf-427c-ba5f-e94108a548ea admin admin] PATH_INFO: `/v3/projects/1db9855252a4405881bea15a9a47336d` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:50.442515 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8c675-a4bf-427c-ba5f-e94108a548ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db9855252a4405881bea15a9a47336d)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:50.452953 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8c675-a4bf-427c-ba5f-e94108a548ea admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:50.453598 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 958/1925] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:50 2022] PUT /identity/v3/projects/fe3dbbd3934344ceba1d9f4399630733/users/e204e83dc0804748a974a92949581e5e/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:50.466786 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ffe7a-1c4a-40f7-88ec-c692c5071157 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:50.467073 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ffe7a-1c4a-40f7-88ec-c692c5071157 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:50.467346 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ffe7a-1c4a-40f7-88ec-c692c5071157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:50.525616 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-957ffe7a-1c4a-40f7-88ec-c692c5071157 None None] MFA Rules not processed for user `e204e83dc0804748a974a92949581e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:50.528617 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-957ffe7a-1c4a-40f7-88ec-c692c5071157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:50.553899 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ebf8c675-a4bf-427c-ba5f-e94108a548ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db9855252a4405881bea15a9a47336d', 'request_id': 'req-ebf8c675-a4bf-427c-ba5f-e94108a548ea'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:50.559533 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ebf8c675-a4bf-427c-ba5f-e94108a548ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db9855252a4405881bea15a9a47336d', 'request_id': 'req-ebf8c675-a4bf-427c-ba5f-e94108a548ea'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:50.577594 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ebf8c675-a4bf-427c-ba5f-e94108a548ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db9855252a4405881bea15a9a47336d', 'request_id': 'req-ebf8c675-a4bf-427c-ba5f-e94108a548ea'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:50.599764 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ebf8c675-a4bf-427c-ba5f-e94108a548ea admin admin] The token cache is being invalidate because project 1db9855252a4405881bea15a9a47336d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:50.600402 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ebf8c675-a4bf-427c-ba5f-e94108a548ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:50.601193 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ebf8c675-a4bf-427c-ba5f-e94108a548ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:50.604610 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 968/1926] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:50 2022] DELETE /identity/v3/projects/1db9855252a4405881bea15a9a47336d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:50.605718 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8c675-a4bf-427c-ba5f-e94108a548ea admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:50.609022 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ebf8c675-a4bf-427c-ba5f-e94108a548ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:50.636897 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 959/1927] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:50.638378 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debed917-3507-47a4-ba28-9d2b948d3464 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:50.642343 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debed917-3507-47a4-ba28-9d2b948d3464 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:50.642697 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debed917-3507-47a4-ba28-9d2b948d3464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:50.674310 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-debed917-3507-47a4-ba28-9d2b948d3464 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:50.676604 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-debed917-3507-47a4-ba28-9d2b948d3464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:50.695422 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8c675-a4bf-427c-ba5f-e94108a548ea admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:50.709282 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2688f99-2870-472d-882f-b7732e8dcd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:50.710440 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2688f99-2870-472d-882f-b7732e8dcd36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:50.710787 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2688f99-2870-472d-882f-b7732e8dcd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:50.711123 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2688f99-2870-472d-882f-b7732e8dcd36 admin admin] PATH_INFO: `/v3/users/96053bc4c9d9420480b0abbd07ca88c7` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:50.713424 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2688f99-2870-472d-882f-b7732e8dcd36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96053bc4c9d9420480b0abbd07ca88c7)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:50.715479 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2688f99-2870-472d-882f-b7732e8dcd36 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:50.765673 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 960/1928] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:50.769028 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debed917-3507-47a4-ba28-9d2b948d3464 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:50.770441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-debed917-3507-47a4-ba28-9d2b948d3464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:50.818808 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d2688f99-2870-472d-882f-b7732e8dcd36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96053bc4c9d9420480b0abbd07ca88c7'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:50.825709 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d2688f99-2870-472d-882f-b7732e8dcd36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96053bc4c9d9420480b0abbd07ca88c7'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:50.838963 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debed917-3507-47a4-ba28-9d2b948d3464 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:50.842343 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e78d3-fa8f-4f77-923d-dcf7cee1880e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '256860d94eb142c6b2175ae89f977e4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:50.843173 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e78d3-fa8f-4f77-923d-dcf7cee1880e service glance] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:50.843515 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e78d3-fa8f-4f77-923d-dcf7cee1880e service glance] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:50.843785 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d2688f99-2870-472d-882f-b7732e8dcd36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96053bc4c9d9420480b0abbd07ca88c7'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:50.843898 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e78d3-fa8f-4f77-923d-dcf7cee1880e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:50.844782 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d2688f99-2870-472d-882f-b7732e8dcd36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96053bc4c9d9420480b0abbd07ca88c7'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:50.845617 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d2688f99-2870-472d-882f-b7732e8dcd36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96053bc4c9d9420480b0abbd07ca88c7'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:50.864373 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 969/1929] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:50 2022] DELETE /identity/v3/users/96053bc4c9d9420480b0abbd07ca88c7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:50.864373 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab903437-245b-4529-b081-ddac4b01921e None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:50.864373 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab903437-245b-4529-b081-ddac4b01921e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:50.864373 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab903437-245b-4529-b081-ddac4b01921e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:50.884347 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-ab903437-245b-4529-b081-ddac4b01921e None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:50.885755 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ab903437-245b-4529-b081-ddac4b01921e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:50.903330 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e78d3-fa8f-4f77-923d-dcf7cee1880e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:50.904777 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e78d3-fa8f-4f77-923d-dcf7cee1880e service glance] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:50.914334 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 961/1930] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:50.917260 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56647c84-e944-44a4-8d24-22974c17cf64 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:50.917627 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56647c84-e944-44a4-8d24-22974c17cf64 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:50.917988 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56647c84-e944-44a4-8d24-22974c17cf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:50.941841 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-56647c84-e944-44a4-8d24-22974c17cf64 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:50.943039 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-56647c84-e944-44a4-8d24-22974c17cf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:50.967393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 970/1931] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:50.975066 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab903437-245b-4529-b081-ddac4b01921e None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:50.986096 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab903437-245b-4529-b081-ddac4b01921e None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:50.992980 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0560e85-09b9-41ee-9ed3-e528c61de930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:50.993887 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0560e85-09b9-41ee-9ed3-e528c61de930 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:50.994313 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0560e85-09b9-41ee-9ed3-e528c61de930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:50.994776 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0560e85-09b9-41ee-9ed3-e528c61de930 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:50.995656 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0560e85-09b9-41ee-9ed3-e528c61de930 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:58:50.996103 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0560e85-09b9-41ee-9ed3-e528c61de930 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:50.998732 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0560e85-09b9-41ee-9ed3-e528c61de930 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:51.015419 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 971/1932] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:58:51.020340 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0560e85-09b9-41ee-9ed3-e528c61de930 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:51.023030 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 962/1933] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:51.033975 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56647c84-e944-44a4-8d24-22974c17cf64 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:51.035913 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0560e85-09b9-41ee-9ed3-e528c61de930 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:51.036039 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-56647c84-e944-44a4-8d24-22974c17cf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:51.042120 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9b4a9-a02c-4b1c-bf67-f7714a5ff313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:51.043004 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9b4a9-a02c-4b1c-bf67-f7714a5ff313 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:51.043305 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9b4a9-a02c-4b1c-bf67-f7714a5ff313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:51.043667 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9b4a9-a02c-4b1c-bf67-f7714a5ff313 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:51.044591 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9b4a9-a02c-4b1c-bf67-f7714a5ff313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:51.046979 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9b4a9-a02c-4b1c-bf67-f7714a5ff313 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:51.079548 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 972/1934] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:51 2022] POST /identity/v3/projects => generated 363 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:51.083941 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9b4a9-a02c-4b1c-bf67-f7714a5ff313 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:51.108988 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56647c84-e944-44a4-8d24-22974c17cf64 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:51.169132 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9b4a9-a02c-4b1c-bf67-f7714a5ff313 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:51.174262 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5478e89-a061-40c5-a750-8c06122dbced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:51.175109 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5478e89-a061-40c5-a750-8c06122dbced admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:51.175543 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5478e89-a061-40c5-a750-8c06122dbced admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:51.175925 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5478e89-a061-40c5-a750-8c06122dbced admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:51.176639 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5478e89-a061-40c5-a750-8c06122dbced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:51.178906 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f133b-6465-4e2e-9baf-28189c2c7297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:51.179036 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5478e89-a061-40c5-a750-8c06122dbced admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:51.180542 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f133b-6465-4e2e-9baf-28189c2c7297 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:51.181121 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f133b-6465-4e2e-9baf-28189c2c7297 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:51.181830 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f133b-6465-4e2e-9baf-28189c2c7297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:51.195653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f133b-6465-4e2e-9baf-28189c2c7297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:51.197508 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f133b-6465-4e2e-9baf-28189c2c7297 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:51.205130 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 973/1935] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:51 2022] POST /identity/v3/users => generated 282 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:51.208121 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5478e89-a061-40c5-a750-8c06122dbced admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:51.210920 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 963/1936] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:58:51.223279 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5478e89-a061-40c5-a750-8c06122dbced admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:51.230722 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bcbf8-ceb1-4a10-a9f6-18c5c5a46067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:51.231992 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bcbf8-ceb1-4a10-a9f6-18c5c5a46067 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:51.233207 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bcbf8-ceb1-4a10-a9f6-18c5c5a46067 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:51.234176 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bcbf8-ceb1-4a10-a9f6-18c5c5a46067 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:51.235034 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bcbf8-ceb1-4a10-a9f6-18c5c5a46067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:51.236879 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bcbf8-ceb1-4a10-a9f6-18c5c5a46067 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:51.253485 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 974/1937] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:51.254702 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f133b-6465-4e2e-9baf-28189c2c7297 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:51.264956 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f133b-6465-4e2e-9baf-28189c2c7297 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:51.271337 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c6cd3-5475-4ebf-9189-7a2235b1c546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:51.272010 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c6cd3-5475-4ebf-9189-7a2235b1c546 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:51.272291 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c6cd3-5475-4ebf-9189-7a2235b1c546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:51.272561 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c6cd3-5475-4ebf-9189-7a2235b1c546 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:51.273298 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c6cd3-5475-4ebf-9189-7a2235b1c546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:51.274968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c6cd3-5475-4ebf-9189-7a2235b1c546 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:51.288397 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 964/1938] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:51.292823 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bcbf8-ceb1-4a10-a9f6-18c5c5a46067 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:51.304480 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bcbf8-ceb1-4a10-a9f6-18c5c5a46067 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:51.310915 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cfd38-eb80-4b3e-97f9-c585551c4a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:51.311853 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cfd38-eb80-4b3e-97f9-c585551c4a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:51.312162 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cfd38-eb80-4b3e-97f9-c585551c4a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:51.312435 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cfd38-eb80-4b3e-97f9-c585551c4a90 admin admin] PATH_INFO: `/v3/projects/ee8b374c999b404d883bc23afc4fbdd5/users/7abfb54af4a94badb6dc69c81a8506bc/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:51.340298 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27cfd38-eb80-4b3e-97f9-c585551c4a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8b374c999b404d883bc23afc4fbdd5, user_id=7abfb54af4a94badb6dc69c81a8506bc, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:51.343590 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27cfd38-eb80-4b3e-97f9-c585551c4a90 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:51.361094 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 975/1939] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:51 2022] PUT /identity/v3/projects/ee8b374c999b404d883bc23afc4fbdd5/users/7abfb54af4a94badb6dc69c81a8506bc/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:51.371747 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba947c5-3590-4fd3-8253-05f0f79797c0 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:51.372187 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba947c5-3590-4fd3-8253-05f0f79797c0 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:51.372620 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba947c5-3590-4fd3-8253-05f0f79797c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:51.404149 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-bba947c5-3590-4fd3-8253-05f0f79797c0 None None] MFA Rules not processed for user `7abfb54af4a94badb6dc69c81a8506bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:51.405701 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-bba947c5-3590-4fd3-8253-05f0f79797c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:51.487525 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 965/1940] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:51 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:51.492210 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cfd38-eb80-4b3e-97f9-c585551c4a90 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:51.520085 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba947c5-3590-4fd3-8253-05f0f79797c0 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:51.522037 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-bba947c5-3590-4fd3-8253-05f0f79797c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:51.587476 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cfd38-eb80-4b3e-97f9-c585551c4a90 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:51.592637 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c89023-2e1d-4f47-a828-ee5789ba7748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:51.593441 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c89023-2e1d-4f47-a828-ee5789ba7748 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:51.593798 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c89023-2e1d-4f47-a828-ee5789ba7748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:51.594135 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c89023-2e1d-4f47-a828-ee5789ba7748 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:51.594909 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c89023-2e1d-4f47-a828-ee5789ba7748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:51.597248 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c89023-2e1d-4f47-a828-ee5789ba7748 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:51.607481 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba947c5-3590-4fd3-8253-05f0f79797c0 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:51.613099 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b3571-494f-4221-be7d-8bf0fbeda08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:51.614086 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b3571-494f-4221-be7d-8bf0fbeda08a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:51.614478 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b3571-494f-4221-be7d-8bf0fbeda08a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:51.614815 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b3571-494f-4221-be7d-8bf0fbeda08a admin admin] PATH_INFO: `/v3/users/175ae9fd0a05417288d9ed2ca2b86519` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:51.616252 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b3571-494f-4221-be7d-8bf0fbeda08a admin admin] RBAC: Authorizing `identity:delete_user(user_id=175ae9fd0a05417288d9ed2ca2b86519)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:51.618637 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b3571-494f-4221-be7d-8bf0fbeda08a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:51.629431 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 976/1941] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:51 2022] POST /identity/v3/projects => generated 363 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:51.630670 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c89023-2e1d-4f47-a828-ee5789ba7748 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:51.674582 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6a1b3571-494f-4221-be7d-8bf0fbeda08a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '175ae9fd0a05417288d9ed2ca2b86519'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:51.687010 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6a1b3571-494f-4221-be7d-8bf0fbeda08a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '175ae9fd0a05417288d9ed2ca2b86519'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:51.701094 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6a1b3571-494f-4221-be7d-8bf0fbeda08a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '175ae9fd0a05417288d9ed2ca2b86519'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:51.702701 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6a1b3571-494f-4221-be7d-8bf0fbeda08a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '175ae9fd0a05417288d9ed2ca2b86519'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:51.711189 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c89023-2e1d-4f47-a828-ee5789ba7748 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:51.715993 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6a1b3571-494f-4221-be7d-8bf0fbeda08a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '175ae9fd0a05417288d9ed2ca2b86519'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:51.717429 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a459b7-f439-49b2-9bd5-8c76cbc01a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:51.719091 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a459b7-f439-49b2-9bd5-8c76cbc01a01 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:51.719396 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a459b7-f439-49b2-9bd5-8c76cbc01a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:51.719650 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a459b7-f439-49b2-9bd5-8c76cbc01a01 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:51.720650 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a459b7-f439-49b2-9bd5-8c76cbc01a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:51.723128 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a459b7-f439-49b2-9bd5-8c76cbc01a01 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:51.736968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 966/1942] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:51 2022] DELETE /identity/v3/users/175ae9fd0a05417288d9ed2ca2b86519 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:51.738198 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b3571-494f-4221-be7d-8bf0fbeda08a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:51.740431 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6a1b3571-494f-4221-be7d-8bf0fbeda08a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:51.760119 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 977/1943] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:51 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:51.766641 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9e906-59db-45f8-8421-94084a75ca58 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:51.767489 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9e906-59db-45f8-8421-94084a75ca58 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:51.767812 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9e906-59db-45f8-8421-94084a75ca58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:51.797118 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-6be9e906-59db-45f8-8421-94084a75ca58 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:51.798392 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-6be9e906-59db-45f8-8421-94084a75ca58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:51.845108 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b3571-494f-4221-be7d-8bf0fbeda08a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:51.856660 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7773e-9cb3-4f4b-bf8b-952c16358b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:51.857578 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7773e-9cb3-4f4b-bf8b-952c16358b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:51.857858 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7773e-9cb3-4f4b-bf8b-952c16358b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:51.858168 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7773e-9cb3-4f4b-bf8b-952c16358b19 admin admin] PATH_INFO: `/v3/projects/6082171fc85c4fc69790b47239efc2fc` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:51.861183 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7773e-9cb3-4f4b-bf8b-952c16358b19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6082171fc85c4fc69790b47239efc2fc)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:51.867175 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7773e-9cb3-4f4b-bf8b-952c16358b19 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:51.867312 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 978/1944] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:51.871508 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9e906-59db-45f8-8421-94084a75ca58 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:51.872915 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-6be9e906-59db-45f8-8421-94084a75ca58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:51.886083 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9e906-59db-45f8-8421-94084a75ca58 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:51.891525 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8a95b-40f6-4b19-947a-e8b45c1e149c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:51.892209 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8a95b-40f6-4b19-947a-e8b45c1e149c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:51.892486 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8a95b-40f6-4b19-947a-e8b45c1e149c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:51.892971 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8a95b-40f6-4b19-947a-e8b45c1e149c admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:51.893677 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8a95b-40f6-4b19-947a-e8b45c1e149c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:51.896022 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8a95b-40f6-4b19-947a-e8b45c1e149c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:51.913825 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 979/1945] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:51.913825 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8a95b-40f6-4b19-947a-e8b45c1e149c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:51.913825 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d9a8a95b-40f6-4b19-947a-e8b45c1e149c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:51.958929 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4da7773e-9cb3-4f4b-bf8b-952c16358b19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6082171fc85c4fc69790b47239efc2fc', 'request_id': 'req-4da7773e-9cb3-4f4b-bf8b-952c16358b19'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:51.967181 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4da7773e-9cb3-4f4b-bf8b-952c16358b19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6082171fc85c4fc69790b47239efc2fc', 'request_id': 'req-4da7773e-9cb3-4f4b-bf8b-952c16358b19'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:51.975599 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4da7773e-9cb3-4f4b-bf8b-952c16358b19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6082171fc85c4fc69790b47239efc2fc', 'request_id': 'req-4da7773e-9cb3-4f4b-bf8b-952c16358b19'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:51.988089 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8a95b-40f6-4b19-947a-e8b45c1e149c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:51.999207 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4da7773e-9cb3-4f4b-bf8b-952c16358b19 admin admin] The token cache is being invalidate because project 6082171fc85c4fc69790b47239efc2fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:52.000221 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4da7773e-9cb3-4f4b-bf8b-952c16358b19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:52.001521 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4da7773e-9cb3-4f4b-bf8b-952c16358b19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:52.003823 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 967/1946] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:51 2022] DELETE /identity/v3/projects/6082171fc85c4fc69790b47239efc2fc => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:52.008403 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7773e-9cb3-4f4b-bf8b-952c16358b19 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:52.028087 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4da7773e-9cb3-4f4b-bf8b-952c16358b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:52.111283 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded718c3-c8ab-4d5a-901e-8b7c81dc9ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:52.111959 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded718c3-c8ab-4d5a-901e-8b7c81dc9ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:52.112240 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded718c3-c8ab-4d5a-901e-8b7c81dc9ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:52.112512 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded718c3-c8ab-4d5a-901e-8b7c81dc9ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:52.114559 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ded718c3-c8ab-4d5a-901e-8b7c81dc9ab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:52.144786 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7773e-9cb3-4f4b-bf8b-952c16358b19 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:52.160877 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56f9f5-cf25-4c4f-a747-9f2fa25eeb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:52.162464 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56f9f5-cf25-4c4f-a747-9f2fa25eeb35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:52.162590 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56f9f5-cf25-4c4f-a747-9f2fa25eeb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:52.162884 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56f9f5-cf25-4c4f-a747-9f2fa25eeb35 admin admin] PATH_INFO: `/v3/projects/340461c11f2b4087b8b2d476e30e8a6f/users/814ae6489d314dccbd7c9d2ac76fe4bd/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:52.184466 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56f9f5-cf25-4c4f-a747-9f2fa25eeb35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=340461c11f2b4087b8b2d476e30e8a6f, user_id=814ae6489d314dccbd7c9d2ac76fe4bd, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:52.191429 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56f9f5-cf25-4c4f-a747-9f2fa25eeb35 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:52.210421 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 968/1947] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:52 2022] PUT /identity/v3/projects/340461c11f2b4087b8b2d476e30e8a6f/users/814ae6489d314dccbd7c9d2ac76fe4bd/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:52.211711 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebd774-f373-44bb-8252-327599719bcf None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:52.212008 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebd774-f373-44bb-8252-327599719bcf None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:52.212287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebd774-f373-44bb-8252-327599719bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:52.234679 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded718c3-c8ab-4d5a-901e-8b7c81dc9ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:52.235509 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7cebd774-f373-44bb-8252-327599719bcf None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:52.236998 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded718c3-c8ab-4d5a-901e-8b7c81dc9ab3 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:52.239336 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7cebd774-f373-44bb-8252-327599719bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:52.259149 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 980/1948] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:52.262209 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded718c3-c8ab-4d5a-901e-8b7c81dc9ab3 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:52.282487 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded718c3-c8ab-4d5a-901e-8b7c81dc9ab3 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:52.357399 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 969/1949] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:52.366633 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203f92c-fcfe-4af0-8f17-daea869977b9 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:52.366920 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203f92c-fcfe-4af0-8f17-daea869977b9 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:52.367291 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203f92c-fcfe-4af0-8f17-daea869977b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:52.383408 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841a773-489f-4d6a-a128-b3c36a3285b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:52.384331 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841a773-489f-4d6a-a128-b3c36a3285b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:52.384880 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841a773-489f-4d6a-a128-b3c36a3285b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:52.385050 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841a773-489f-4d6a-a128-b3c36a3285b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:52.386014 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841a773-489f-4d6a-a128-b3c36a3285b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:52.389262 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841a773-489f-4d6a-a128-b3c36a3285b5 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:52.400669 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-4203f92c-fcfe-4af0-8f17-daea869977b9 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:52.404113 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4203f92c-fcfe-4af0-8f17-daea869977b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:52.406930 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 981/1950] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:52.411499 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841a773-489f-4d6a-a128-b3c36a3285b5 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:52.424722 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841a773-489f-4d6a-a128-b3c36a3285b5 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:52.431775 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 970/1951] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:52.435770 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203f92c-fcfe-4af0-8f17-daea869977b9 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:52.441735 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb895cd-400e-4cfa-83fc-2b40c7cdbd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:52.441735 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb895cd-400e-4cfa-83fc-2b40c7cdbd92 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:52.441735 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb895cd-400e-4cfa-83fc-2b40c7cdbd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:52.443303 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb895cd-400e-4cfa-83fc-2b40c7cdbd92 admin admin] PATH_INFO: `/v3/projects/340461c11f2b4087b8b2d476e30e8a6f/users/814ae6489d314dccbd7c9d2ac76fe4bd/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:52.448123 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb895cd-400e-4cfa-83fc-2b40c7cdbd92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=340461c11f2b4087b8b2d476e30e8a6f, user_id=814ae6489d314dccbd7c9d2ac76fe4bd, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:52.448360 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203f92c-fcfe-4af0-8f17-daea869977b9 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:52.453196 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb895cd-400e-4cfa-83fc-2b40c7cdbd92 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:52.463018 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f424018-4b9b-4f11-aaaa-c587700cb8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:52.463295 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f424018-4b9b-4f11-aaaa-c587700cb8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:52.463578 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f424018-4b9b-4f11-aaaa-c587700cb8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:52.463850 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f424018-4b9b-4f11-aaaa-c587700cb8e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:52.464585 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f424018-4b9b-4f11-aaaa-c587700cb8e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:58:52.464887 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f424018-4b9b-4f11-aaaa-c587700cb8e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:52.466524 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f424018-4b9b-4f11-aaaa-c587700cb8e2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:52.472106 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 982/1952] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:52 2022] PUT /identity/v3/projects/340461c11f2b4087b8b2d476e30e8a6f/users/814ae6489d314dccbd7c9d2ac76fe4bd/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:52.483230 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34698236-f907-4100-882b-f0fea0d76fb2 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:52.483645 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34698236-f907-4100-882b-f0fea0d76fb2 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:52.484013 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34698236-f907-4100-882b-f0fea0d76fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:52.511513 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 971/1953] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:58:52.515811 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f424018-4b9b-4f11-aaaa-c587700cb8e2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:52.528669 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f424018-4b9b-4f11-aaaa-c587700cb8e2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:52.578379 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-34698236-f907-4100-882b-f0fea0d76fb2 None None] MFA Rules not processed for user `814ae6489d314dccbd7c9d2ac76fe4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:52.579678 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-34698236-f907-4100-882b-f0fea0d76fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:52.662439 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a958d-46b9-41d4-83cf-fe1bf1755c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:52.663437 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a958d-46b9-41d4-83cf-fe1bf1755c1e admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:52.663972 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a958d-46b9-41d4-83cf-fe1bf1755c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:52.664329 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a958d-46b9-41d4-83cf-fe1bf1755c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:52.665334 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a958d-46b9-41d4-83cf-fe1bf1755c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:52.667527 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a958d-46b9-41d4-83cf-fe1bf1755c1e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:52.684548 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 983/1954] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:52 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:52.697197 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34698236-f907-4100-882b-f0fea0d76fb2 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:52.699738 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-34698236-f907-4100-882b-f0fea0d76fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:52.715322 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 972/1955] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:52 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:52.719783 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a958d-46b9-41d4-83cf-fe1bf1755c1e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:52.721621 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-639a958d-46b9-41d4-83cf-fe1bf1755c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:52.770086 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34698236-f907-4100-882b-f0fea0d76fb2 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:52.800868 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a958d-46b9-41d4-83cf-fe1bf1755c1e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:52.807168 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09f447-41c4-416a-adcf-d3a197c389df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:52.808053 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09f447-41c4-416a-adcf-d3a197c389df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:52.808334 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09f447-41c4-416a-adcf-d3a197c389df admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:52.808655 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09f447-41c4-416a-adcf-d3a197c389df admin admin] PATH_INFO: `/v3/projects/3d920c691f914502bd8d8d4c0462132e` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:52.809945 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09f447-41c4-416a-adcf-d3a197c389df admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d920c691f914502bd8d8d4c0462132e)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:52.811907 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09f447-41c4-416a-adcf-d3a197c389df admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:52.825491 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6736d-d5d4-46b0-a8ef-b7f24816a76c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:52.826280 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6736d-d5d4-46b0-a8ef-b7f24816a76c service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:52.826746 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6736d-d5d4-46b0-a8ef-b7f24816a76c service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:52.827090 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6736d-d5d4-46b0-a8ef-b7f24816a76c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:52.867529 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ed09f447-41c4-416a-adcf-d3a197c389df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d920c691f914502bd8d8d4c0462132e', 'request_id': 'req-ed09f447-41c4-416a-adcf-d3a197c389df'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:52.878058 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ed09f447-41c4-416a-adcf-d3a197c389df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d920c691f914502bd8d8d4c0462132e', 'request_id': 'req-ed09f447-41c4-416a-adcf-d3a197c389df'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:52.891467 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ed09f447-41c4-416a-adcf-d3a197c389df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d920c691f914502bd8d8d4c0462132e', 'request_id': 'req-ed09f447-41c4-416a-adcf-d3a197c389df'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:52.914093 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ed09f447-41c4-416a-adcf-d3a197c389df admin admin] The token cache is being invalidate because project 3d920c691f914502bd8d8d4c0462132e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:52.914416 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ed09f447-41c4-416a-adcf-d3a197c389df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:52.916178 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ed09f447-41c4-416a-adcf-d3a197c389df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:52.920461 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 973/1956] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:52 2022] DELETE /identity/v3/projects/3d920c691f914502bd8d8d4c0462132e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:52.921446 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09f447-41c4-416a-adcf-d3a197c389df admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:52.923844 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ed09f447-41c4-416a-adcf-d3a197c389df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:52.927314 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6736d-d5d4-46b0-a8ef-b7f24816a76c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:52.940646 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6736d-d5d4-46b0-a8ef-b7f24816a76c service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:52.962893 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 984/1957] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:52 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:52.963890 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6736d-d5d4-46b0-a8ef-b7f24816a76c service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:52.981858 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6736d-d5d4-46b0-a8ef-b7f24816a76c service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:53.053795 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09f447-41c4-416a-adcf-d3a197c389df admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:53.059930 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d1369-b7b1-4269-a057-9c38f496f577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:53.060624 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d1369-b7b1-4269-a057-9c38f496f577 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:53.061058 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d1369-b7b1-4269-a057-9c38f496f577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:53.061290 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d1369-b7b1-4269-a057-9c38f496f577 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:53.062343 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d1369-b7b1-4269-a057-9c38f496f577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:53.066691 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d1369-b7b1-4269-a057-9c38f496f577 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:53.081679 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b10d5-6706-413c-8fbe-f5ee9eb445a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:53.082687 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b10d5-6706-413c-8fbe-f5ee9eb445a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:53.083144 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b10d5-6706-413c-8fbe-f5ee9eb445a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:53.083421 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b10d5-6706-413c-8fbe-f5ee9eb445a7 admin admin] PATH_INFO: `/v3/users/ebcc36a7ec7d421bb40acb6cef677324` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:53.084917 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b10d5-6706-413c-8fbe-f5ee9eb445a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebcc36a7ec7d421bb40acb6cef677324)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:53.086982 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b10d5-6706-413c-8fbe-f5ee9eb445a7 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:53.096751 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 974/1958] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:52 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:53.097690 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d1369-b7b1-4269-a057-9c38f496f577 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:53.099599 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-803d1369-b7b1-4269-a057-9c38f496f577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:53.148797 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-241b10d5-6706-413c-8fbe-f5ee9eb445a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebcc36a7ec7d421bb40acb6cef677324'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:53.156965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-241b10d5-6706-413c-8fbe-f5ee9eb445a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebcc36a7ec7d421bb40acb6cef677324'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:53.167226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d1369-b7b1-4269-a057-9c38f496f577 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:53.170099 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed4190-4420-46e5-b038-797843922015 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:53.171010 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed4190-4420-46e5-b038-797843922015 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:53.171352 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed4190-4420-46e5-b038-797843922015 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:53.171712 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed4190-4420-46e5-b038-797843922015 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:53.173685 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-75ed4190-4420-46e5-b038-797843922015 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:53.179812 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-241b10d5-6706-413c-8fbe-f5ee9eb445a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebcc36a7ec7d421bb40acb6cef677324'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:53.181086 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-241b10d5-6706-413c-8fbe-f5ee9eb445a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebcc36a7ec7d421bb40acb6cef677324'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:53.182083 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-241b10d5-6706-413c-8fbe-f5ee9eb445a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebcc36a7ec7d421bb40acb6cef677324'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:53.201930 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 985/1959] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:52 2022] DELETE /identity/v3/users/ebcc36a7ec7d421bb40acb6cef677324 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:53.202553 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b10d5-6706-413c-8fbe-f5ee9eb445a7 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:53.204671 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-241b10d5-6706-413c-8fbe-f5ee9eb445a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:53.253626 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed4190-4420-46e5-b038-797843922015 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:53.255085 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed4190-4420-46e5-b038-797843922015 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:53.268020 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 975/1960] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:53 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:53.347439 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b10d5-6706-413c-8fbe-f5ee9eb445a7 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:53.357743 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b55e0e-6916-4786-b944-729762102d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:53.358887 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b55e0e-6916-4786-b944-729762102d62 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:53.359177 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b55e0e-6916-4786-b944-729762102d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:53.359457 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b55e0e-6916-4786-b944-729762102d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:53.360262 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b55e0e-6916-4786-b944-729762102d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:53.364715 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b55e0e-6916-4786-b944-729762102d62 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:53.376518 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 986/1961] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:53.381113 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed4190-4420-46e5-b038-797843922015 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:53.393941 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed4190-4420-46e5-b038-797843922015 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:53.400348 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f8819-75e5-481c-8b2a-0c678a89f7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:53.401538 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f8819-75e5-481c-8b2a-0c678a89f7bb admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:53.402045 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f8819-75e5-481c-8b2a-0c678a89f7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:53.413077 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f8819-75e5-481c-8b2a-0c678a89f7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:53.414337 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f8819-75e5-481c-8b2a-0c678a89f7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:53.416384 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f8819-75e5-481c-8b2a-0c678a89f7bb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:53.436624 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 976/1962] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:53.438050 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b55e0e-6916-4786-b944-729762102d62 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:53.454097 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b55e0e-6916-4786-b944-729762102d62 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:53.460103 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1fdfc-9f1c-44f4-9e90-090355a45ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:53.461303 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1fdfc-9f1c-44f4-9e90-090355a45ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:53.461618 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1fdfc-9f1c-44f4-9e90-090355a45ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:53.462021 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1fdfc-9f1c-44f4-9e90-090355a45ad4 admin admin] PATH_INFO: `/v3/projects/98a2beb89ce3428abc7f2e0345bdfa5d/users/b851bf7577f84c06aaa128f18b61b23a/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:53.483140 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1fdfc-9f1c-44f4-9e90-090355a45ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a2beb89ce3428abc7f2e0345bdfa5d, user_id=b851bf7577f84c06aaa128f18b61b23a, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:53.483140 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1fdfc-9f1c-44f4-9e90-090355a45ad4 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:53.513897 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 987/1963] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:53 2022] PUT /identity/v3/projects/98a2beb89ce3428abc7f2e0345bdfa5d/users/b851bf7577f84c06aaa128f18b61b23a/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:53.524627 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ce2ef-1531-460b-9e46-7f4d7fd7d60c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:53.525007 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ce2ef-1531-460b-9e46-7f4d7fd7d60c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:53.525679 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ce2ef-1531-460b-9e46-7f4d7fd7d60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:53.582306 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e32ce2ef-1531-460b-9e46-7f4d7fd7d60c None None] MFA Rules not processed for user `b851bf7577f84c06aaa128f18b61b23a`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:53.583485 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e32ce2ef-1531-460b-9e46-7f4d7fd7d60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:53.637316 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1fdfc-9f1c-44f4-9e90-090355a45ad4 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:53.639497 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-caf1fdfc-9f1c-44f4-9e90-090355a45ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:53.680849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 977/1964] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:53.686430 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ce2ef-1531-460b-9e46-7f4d7fd7d60c None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:53.716453 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1fdfc-9f1c-44f4-9e90-090355a45ad4 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:53.721085 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361323c-120d-4d42-a95f-5ca95eb2f741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:53.722099 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361323c-120d-4d42-a95f-5ca95eb2f741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:53.722370 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361323c-120d-4d42-a95f-5ca95eb2f741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:53.722654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361323c-120d-4d42-a95f-5ca95eb2f741 admin admin] PATH_INFO: `/v3/projects/3e1fa78993354aa080b6096bdadfd9b1` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:53.724079 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361323c-120d-4d42-a95f-5ca95eb2f741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e1fa78993354aa080b6096bdadfd9b1)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:53.726142 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361323c-120d-4d42-a95f-5ca95eb2f741 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:53.764037 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ce2ef-1531-460b-9e46-7f4d7fd7d60c None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:53.769789 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3ac24-2b20-475b-80e8-1543f64c999c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:53.770466 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3ac24-2b20-475b-80e8-1543f64c999c admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:53.770747 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3ac24-2b20-475b-80e8-1543f64c999c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:53.771044 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3ac24-2b20-475b-80e8-1543f64c999c admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:53.771738 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3ac24-2b20-475b-80e8-1543f64c999c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:53.773693 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3ac24-2b20-475b-80e8-1543f64c999c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:53.787970 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d361323c-120d-4d42-a95f-5ca95eb2f741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e1fa78993354aa080b6096bdadfd9b1', 'request_id': 'req-d361323c-120d-4d42-a95f-5ca95eb2f741'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:53.793769 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d361323c-120d-4d42-a95f-5ca95eb2f741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e1fa78993354aa080b6096bdadfd9b1', 'request_id': 'req-d361323c-120d-4d42-a95f-5ca95eb2f741'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:53.801415 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 978/1965] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:53 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:53.801606 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d361323c-120d-4d42-a95f-5ca95eb2f741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e1fa78993354aa080b6096bdadfd9b1', 'request_id': 'req-d361323c-120d-4d42-a95f-5ca95eb2f741'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:53.806221 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3ac24-2b20-475b-80e8-1543f64c999c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:53.816827 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d361323c-120d-4d42-a95f-5ca95eb2f741 admin admin] The token cache is being invalidate because project 3e1fa78993354aa080b6096bdadfd9b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:53.817110 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d361323c-120d-4d42-a95f-5ca95eb2f741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:53.817771 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d361323c-120d-4d42-a95f-5ca95eb2f741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:53.819321 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 988/1966] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:53 2022] DELETE /identity/v3/projects/3e1fa78993354aa080b6096bdadfd9b1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:53.825113 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5fda9-4728-4ca3-b101-464be221ee9e None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:53.825418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5fda9-4728-4ca3-b101-464be221ee9e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:53.825688 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5fda9-4728-4ca3-b101-464be221ee9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:53.847748 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-93b5fda9-4728-4ca3-b101-464be221ee9e None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:53.849040 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-93b5fda9-4728-4ca3-b101-464be221ee9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:53.868204 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3ac24-2b20-475b-80e8-1543f64c999c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:53.872857 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128fa99-24c6-453a-9fe4-bbc8098a7aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:53.873590 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128fa99-24c6-453a-9fe4-bbc8098a7aca admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:53.873872 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128fa99-24c6-453a-9fe4-bbc8098a7aca admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:53.874143 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128fa99-24c6-453a-9fe4-bbc8098a7aca admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:53.874859 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128fa99-24c6-453a-9fe4-bbc8098a7aca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:53.876764 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128fa99-24c6-453a-9fe4-bbc8098a7aca admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:53.896566 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 979/1967] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:53 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:53.903709 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128fa99-24c6-453a-9fe4-bbc8098a7aca admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:53.905473 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a128fa99-24c6-453a-9fe4-bbc8098a7aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:53.907641 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 989/1968] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:53.917423 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e847fdd-fd75-439b-bced-80aefe20ec57 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:53.917586 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128fa99-24c6-453a-9fe4-bbc8098a7aca admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:53.917712 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e847fdd-fd75-439b-bced-80aefe20ec57 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:53.918002 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e847fdd-fd75-439b-bced-80aefe20ec57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:53.922077 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c0064-e3b4-44a5-a287-2ace558cb6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:53.922734 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c0064-e3b4-44a5-a287-2ace558cb6bf admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:53.923013 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c0064-e3b4-44a5-a287-2ace558cb6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:53.923285 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c0064-e3b4-44a5-a287-2ace558cb6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:53.924045 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c0064-e3b4-44a5-a287-2ace558cb6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:53.925664 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c0064-e3b4-44a5-a287-2ace558cb6bf admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:53.938819 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 980/1969] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:53.938987 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-3e847fdd-fd75-439b-bced-80aefe20ec57 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:53.938987 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-3e847fdd-fd75-439b-bced-80aefe20ec57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:53.939746 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c0064-e3b4-44a5-a287-2ace558cb6bf admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:53.946891 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 990/1970] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:53.949064 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c0064-e3b4-44a5-a287-2ace558cb6bf admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:53.951016 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e847fdd-fd75-439b-bced-80aefe20ec57 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:53.954381 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa0343-73a6-4521-9eae-14b0283f8bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:53.954991 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa0343-73a6-4521-9eae-14b0283f8bfc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:53.955268 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa0343-73a6-4521-9eae-14b0283f8bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:53.955537 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa0343-73a6-4521-9eae-14b0283f8bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:53.956362 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa0343-73a6-4521-9eae-14b0283f8bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:53.958085 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa0343-73a6-4521-9eae-14b0283f8bfc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:53.960922 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e847fdd-fd75-439b-bced-80aefe20ec57 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:53.968510 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e73106-1c24-46d3-93cb-e53f3de0a518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:53.969600 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e73106-1c24-46d3-93cb-e53f3de0a518 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:53.969743 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 981/1971] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 20:58:53.969856 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e73106-1c24-46d3-93cb-e53f3de0a518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:53.969953 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e73106-1c24-46d3-93cb-e53f3de0a518 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:53.970761 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e73106-1c24-46d3-93cb-e53f3de0a518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:58:53.971033 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e73106-1c24-46d3-93cb-e53f3de0a518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:53.972773 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e73106-1c24-46d3-93cb-e53f3de0a518 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:53.973667 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa0343-73a6-4521-9eae-14b0283f8bfc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:53.983181 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa0343-73a6-4521-9eae-14b0283f8bfc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:53.984632 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 991/1972] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:58:53.987984 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba7882-8c7d-4c09-bb0f-8cdf67afb0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:53.989065 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba7882-8c7d-4c09-bb0f-8cdf67afb0ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:53.989299 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e73106-1c24-46d3-93cb-e53f3de0a518 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:53.989421 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba7882-8c7d-4c09-bb0f-8cdf67afb0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:53.989794 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba7882-8c7d-4c09-bb0f-8cdf67afb0ce admin admin] PATH_INFO: `/v3/projects/63f5e8c9faef40cabed03a249577fdd7/users/6fe1340af9404d519de9d5521e2e8e43/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:53.999583 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e73106-1c24-46d3-93cb-e53f3de0a518 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:54.005951 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba7882-8c7d-4c09-bb0f-8cdf67afb0ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f5e8c9faef40cabed03a249577fdd7, user_id=6fe1340af9404d519de9d5521e2e8e43, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:54.008876 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe75a4-75ca-4689-a864-ffb739cfd791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:54.009585 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe75a4-75ca-4689-a864-ffb739cfd791 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:54.009861 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe75a4-75ca-4689-a864-ffb739cfd791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:54.010126 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe75a4-75ca-4689-a864-ffb739cfd791 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:54.010843 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe75a4-75ca-4689-a864-ffb739cfd791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:54.011719 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba7882-8c7d-4c09-bb0f-8cdf67afb0ce admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:54.012790 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe75a4-75ca-4689-a864-ffb739cfd791 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:54.028352 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 982/1973] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:53 2022] PUT /identity/v3/projects/63f5e8c9faef40cabed03a249577fdd7/users/6fe1340af9404d519de9d5521e2e8e43/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:54.040212 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afd0a8-cdc9-4029-8954-7148589d2df9 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:54.040508 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afd0a8-cdc9-4029-8954-7148589d2df9 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:54.040774 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afd0a8-cdc9-4029-8954-7148589d2df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:54.053592 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 992/1974] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:53 2022] POST /identity/v3/projects => generated 359 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:54.057484 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe75a4-75ca-4689-a864-ffb739cfd791 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:54.068196 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-13afd0a8-cdc9-4029-8954-7148589d2df9 None None] MFA Rules not processed for user `6fe1340af9404d519de9d5521e2e8e43`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:54.069515 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-13afd0a8-cdc9-4029-8954-7148589d2df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:54.116700 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe75a4-75ca-4689-a864-ffb739cfd791 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:54.128161 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eacca3-63c2-4b8e-ae2c-79a5011a9684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:54.128920 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eacca3-63c2-4b8e-ae2c-79a5011a9684 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:54.129206 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eacca3-63c2-4b8e-ae2c-79a5011a9684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:54.129541 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eacca3-63c2-4b8e-ae2c-79a5011a9684 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:54.130288 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eacca3-63c2-4b8e-ae2c-79a5011a9684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:54.132484 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eacca3-63c2-4b8e-ae2c-79a5011a9684 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:54.137652 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 983/1975] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:54.142306 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afd0a8-cdc9-4029-8954-7148589d2df9 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:54.152595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afd0a8-cdc9-4029-8954-7148589d2df9 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:54.156540 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 993/1976] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:54 2022] POST /identity/v3/users => generated 280 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:58:54.157441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744b951-552c-40e3-9e0f-d81bbc3c766e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:54.157576 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eacca3-63c2-4b8e-ae2c-79a5011a9684 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:54.158167 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744b951-552c-40e3-9e0f-d81bbc3c766e admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:54.158450 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744b951-552c-40e3-9e0f-d81bbc3c766e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:54.158723 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744b951-552c-40e3-9e0f-d81bbc3c766e admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:54.159444 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744b951-552c-40e3-9e0f-d81bbc3c766e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:54.161392 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744b951-552c-40e3-9e0f-d81bbc3c766e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:54.167672 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eacca3-63c2-4b8e-ae2c-79a5011a9684 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:54.173536 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba13e87-a41e-4e16-a611-5e53727c8165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:54.174231 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba13e87-a41e-4e16-a611-5e53727c8165 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:54.174508 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba13e87-a41e-4e16-a611-5e53727c8165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:54.174776 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba13e87-a41e-4e16-a611-5e53727c8165 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:54.175515 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba13e87-a41e-4e16-a611-5e53727c8165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:54.177505 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba13e87-a41e-4e16-a611-5e53727c8165 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:54.191220 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 984/1977] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:54 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:54.191391 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 994/1978] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:54.192386 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744b951-552c-40e3-9e0f-d81bbc3c766e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:54.192596 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba13e87-a41e-4e16-a611-5e53727c8165 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:54.202143 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba13e87-a41e-4e16-a611-5e53727c8165 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:54.254196 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744b951-552c-40e3-9e0f-d81bbc3c766e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:54.256846 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64c2b2-8cc0-4f30-83a9-b5420762ea94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:54.257535 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64c2b2-8cc0-4f30-83a9-b5420762ea94 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:54.257813 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64c2b2-8cc0-4f30-83a9-b5420762ea94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:54.258083 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64c2b2-8cc0-4f30-83a9-b5420762ea94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:54.258873 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64c2b2-8cc0-4f30-83a9-b5420762ea94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:54.260508 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64c2b2-8cc0-4f30-83a9-b5420762ea94 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:54.264728 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fcda5-e0b5-4a86-b4aa-18b75d96a578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:54.265470 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fcda5-e0b5-4a86-b4aa-18b75d96a578 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:54.265762 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fcda5-e0b5-4a86-b4aa-18b75d96a578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:54.266034 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fcda5-e0b5-4a86-b4aa-18b75d96a578 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:54.266747 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68fcda5-e0b5-4a86-b4aa-18b75d96a578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:54.268650 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68fcda5-e0b5-4a86-b4aa-18b75d96a578 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:54.274787 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 995/1979] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 20:58:54.275819 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64c2b2-8cc0-4f30-83a9-b5420762ea94 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:54.286765 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64c2b2-8cc0-4f30-83a9-b5420762ea94 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:54.291345 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 985/1980] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:54 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:54.291486 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03413d-7379-41ff-a7e8-741907590041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:54.292155 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03413d-7379-41ff-a7e8-741907590041 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:54.292344 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fcda5-e0b5-4a86-b4aa-18b75d96a578 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:54.292456 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03413d-7379-41ff-a7e8-741907590041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:54.292688 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03413d-7379-41ff-a7e8-741907590041 admin admin] PATH_INFO: `/v3/projects/60fb840dfaa54deebd30fb28816935b6/users/af81e167332b406fa1848c190ddc285b/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:54.302268 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fcda5-e0b5-4a86-b4aa-18b75d96a578 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:54.309384 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda85f9b-1958-42b9-b932-047864429c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:54.309625 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03413d-7379-41ff-a7e8-741907590041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60fb840dfaa54deebd30fb28816935b6, user_id=af81e167332b406fa1848c190ddc285b, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:54.309725 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda85f9b-1958-42b9-b932-047864429c35 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:54.309725 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda85f9b-1958-42b9-b932-047864429c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:54.309725 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda85f9b-1958-42b9-b932-047864429c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:54.309725 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda85f9b-1958-42b9-b932-047864429c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:54.311884 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03413d-7379-41ff-a7e8-741907590041 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:54.312017 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda85f9b-1958-42b9-b932-047864429c35 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:54.322698 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 986/1981] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:54.325304 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 996/1982] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:54 2022] PUT /identity/v3/projects/60fb840dfaa54deebd30fb28816935b6/users/af81e167332b406fa1848c190ddc285b/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:54.334513 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda85f9b-1958-42b9-b932-047864429c35 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:54.337013 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a121ff9-9baa-4931-b0aa-9b7ef140a8d9 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:54.337166 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda85f9b-1958-42b9-b932-047864429c35 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:54.337310 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a121ff9-9baa-4931-b0aa-9b7ef140a8d9 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:54.337649 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a121ff9-9baa-4931-b0aa-9b7ef140a8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:54.365473 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-6a121ff9-9baa-4931-b0aa-9b7ef140a8d9 None None] MFA Rules not processed for user `af81e167332b406fa1848c190ddc285b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:54.366763 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-6a121ff9-9baa-4931-b0aa-9b7ef140a8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:54.402175 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490cfa6-5dc2-49aa-913d-f47391df41e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:54.403089 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490cfa6-5dc2-49aa-913d-f47391df41e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:54.403371 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490cfa6-5dc2-49aa-913d-f47391df41e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:54.403637 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490cfa6-5dc2-49aa-913d-f47391df41e5 admin admin] PATH_INFO: `/v3/projects/db606515631f4602a60a8ce41870f3e5/users/1361a7166b19460091748ecd6babaddd/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:54.419164 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490cfa6-5dc2-49aa-913d-f47391df41e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db606515631f4602a60a8ce41870f3e5, user_id=1361a7166b19460091748ecd6babaddd, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:54.421903 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490cfa6-5dc2-49aa-913d-f47391df41e5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:54.440533 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 997/1983] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:54 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:54.441098 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 987/1984] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:54 2022] PUT /identity/v3/projects/db606515631f4602a60a8ce41870f3e5/users/1361a7166b19460091748ecd6babaddd/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:54.442435 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a121ff9-9baa-4931-b0aa-9b7ef140a8d9 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:54.457113 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a121ff9-9baa-4931-b0aa-9b7ef140a8d9 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:54.467159 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490cfa6-5dc2-49aa-913d-f47391df41e5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:54.469389 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a490cfa6-5dc2-49aa-913d-f47391df41e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:54.518863 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4c7c5-f5a8-42c6-b548-09dc69054af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:54.519458 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4c7c5-f5a8-42c6-b548-09dc69054af1 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:54.519751 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4c7c5-f5a8-42c6-b548-09dc69054af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:54.520009 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4c7c5-f5a8-42c6-b548-09dc69054af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:54.520906 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4c7c5-f5a8-42c6-b548-09dc69054af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:54.522564 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4c7c5-f5a8-42c6-b548-09dc69054af1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:54.533584 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 998/1985] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:54.537294 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490cfa6-5dc2-49aa-913d-f47391df41e5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:54.537444 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4c7c5-f5a8-42c6-b548-09dc69054af1 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:54.541370 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0e7fe-b743-48f5-9226-44f0e9a27cfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:54.542223 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0e7fe-b743-48f5-9226-44f0e9a27cfa service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:54.542647 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0e7fe-b743-48f5-9226-44f0e9a27cfa service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:54.542934 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0e7fe-b743-48f5-9226-44f0e9a27cfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:54.549693 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4c7c5-f5a8-42c6-b548-09dc69054af1 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:54.556719 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93075dc5-c362-4961-a104-fbf0a80772c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:54.558094 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93075dc5-c362-4961-a104-fbf0a80772c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:54.558368 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93075dc5-c362-4961-a104-fbf0a80772c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:54.558636 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93075dc5-c362-4961-a104-fbf0a80772c7 admin admin] PATH_INFO: `/v3/projects/db606515631f4602a60a8ce41870f3e5/users/1361a7166b19460091748ecd6babaddd/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:54.561568 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93075dc5-c362-4961-a104-fbf0a80772c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db606515631f4602a60a8ce41870f3e5, user_id=1361a7166b19460091748ecd6babaddd, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:54.566177 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93075dc5-c362-4961-a104-fbf0a80772c7 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:54.579907 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 999/1986] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:54 2022] PUT /identity/v3/projects/db606515631f4602a60a8ce41870f3e5/users/1361a7166b19460091748ecd6babaddd/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:54.593345 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866253d8-fd92-4ffe-878e-b2fb64806a11 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:54.593653 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866253d8-fd92-4ffe-878e-b2fb64806a11 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:54.593926 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866253d8-fd92-4ffe-878e-b2fb64806a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:54.619303 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0e7fe-b743-48f5-9226-44f0e9a27cfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:54.625861 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0e7fe-b743-48f5-9226-44f0e9a27cfa service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:54.625966 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-866253d8-fd92-4ffe-878e-b2fb64806a11 None None] MFA Rules not processed for user `1361a7166b19460091748ecd6babaddd`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:54.625966 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-866253d8-fd92-4ffe-878e-b2fb64806a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:54.643624 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 988/1987] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:54 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:54.659312 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0e7fe-b743-48f5-9226-44f0e9a27cfa service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:54.678534 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0e7fe-b743-48f5-9226-44f0e9a27cfa service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:54.720405 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1000/1988] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:54.726259 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866253d8-fd92-4ffe-878e-b2fb64806a11 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:54.727674 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-866253d8-fd92-4ffe-878e-b2fb64806a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:54.753375 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8225ace-1d67-4260-a13c-1e90b697e0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:54.754551 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8225ace-1d67-4260-a13c-1e90b697e0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:54.754759 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8225ace-1d67-4260-a13c-1e90b697e0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:54.755053 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8225ace-1d67-4260-a13c-1e90b697e0e6 admin admin] PATH_INFO: `/v3/users/af81e167332b406fa1848c190ddc285b` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:54.756306 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8225ace-1d67-4260-a13c-1e90b697e0e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af81e167332b406fa1848c190ddc285b)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:54.758267 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8225ace-1d67-4260-a13c-1e90b697e0e6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:54.794115 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866253d8-fd92-4ffe-878e-b2fb64806a11 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:54.798718 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81383d-1e14-4a1e-b515-4e3fd2f595cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:54.799667 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81383d-1e14-4a1e-b515-4e3fd2f595cc service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:54.800133 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81383d-1e14-4a1e-b515-4e3fd2f595cc service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:54.800655 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81383d-1e14-4a1e-b515-4e3fd2f595cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:54.803760 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ff81383d-1e14-4a1e-b515-4e3fd2f595cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:54.829106 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d8225ace-1d67-4260-a13c-1e90b697e0e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af81e167332b406fa1848c190ddc285b'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:54.841143 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d8225ace-1d67-4260-a13c-1e90b697e0e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af81e167332b406fa1848c190ddc285b'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:54.858873 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d8225ace-1d67-4260-a13c-1e90b697e0e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af81e167332b406fa1848c190ddc285b'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:54.859921 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d8225ace-1d67-4260-a13c-1e90b697e0e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af81e167332b406fa1848c190ddc285b'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:54.873475 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d8225ace-1d67-4260-a13c-1e90b697e0e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af81e167332b406fa1848c190ddc285b'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:54.886742 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 989/1989] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:54 2022] DELETE /identity/v3/users/af81e167332b406fa1848c190ddc285b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:54.888989 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81383d-1e14-4a1e-b515-4e3fd2f595cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:54.889293 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce92d8-2ddd-40d2-bcb0-d1dd2d6c372a None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:54.889725 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce92d8-2ddd-40d2-bcb0-d1dd2d6c372a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:54.890165 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce92d8-2ddd-40d2-bcb0-d1dd2d6c372a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:54.891459 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81383d-1e14-4a1e-b515-4e3fd2f595cc service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:54.902202 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1001/1990] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:54.916178 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ebce92d8-2ddd-40d2-bcb0-d1dd2d6c372a None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:54.918404 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ebce92d8-2ddd-40d2-bcb0-d1dd2d6c372a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:54.997027 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 990/1991] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:55.006745 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81383d-1e14-4a1e-b515-4e3fd2f595cc service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:55.008159 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ff81383d-1e14-4a1e-b515-4e3fd2f595cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:55.074675 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81383d-1e14-4a1e-b515-4e3fd2f595cc service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:55.128292 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bdba7-e5b3-473e-afbc-dc9f2b54ae34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:55.128952 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bdba7-e5b3-473e-afbc-dc9f2b54ae34 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:55.129323 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bdba7-e5b3-473e-afbc-dc9f2b54ae34 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:55.129620 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bdba7-e5b3-473e-afbc-dc9f2b54ae34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:55.140032 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bdba7-e5b3-473e-afbc-dc9f2b54ae34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:55.141511 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bdba7-e5b3-473e-afbc-dc9f2b54ae34 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:55.151103 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1002/1992] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:58:55.441835 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce92d8-2ddd-40d2-bcb0-d1dd2d6c372a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:55.443801 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ebce92d8-2ddd-40d2-bcb0-d1dd2d6c372a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:55.456329 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce92d8-2ddd-40d2-bcb0-d1dd2d6c372a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:55.461245 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5f93d-5b2a-4765-a5dd-ea43ddf0ae5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:55.462136 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5f93d-5b2a-4765-a5dd-ea43ddf0ae5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:55.462899 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5f93d-5b2a-4765-a5dd-ea43ddf0ae5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:55.463178 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5f93d-5b2a-4765-a5dd-ea43ddf0ae5f admin admin] PATH_INFO: `/v3/projects/60fb840dfaa54deebd30fb28816935b6` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:55.464686 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5f93d-5b2a-4765-a5dd-ea43ddf0ae5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=60fb840dfaa54deebd30fb28816935b6)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:55.466653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5f93d-5b2a-4765-a5dd-ea43ddf0ae5f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:55.527776 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1be5f93d-5b2a-4765-a5dd-ea43ddf0ae5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60fb840dfaa54deebd30fb28816935b6', 'request_id': 'req-1be5f93d-5b2a-4765-a5dd-ea43ddf0ae5f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:55.535566 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1be5f93d-5b2a-4765-a5dd-ea43ddf0ae5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60fb840dfaa54deebd30fb28816935b6', 'request_id': 'req-1be5f93d-5b2a-4765-a5dd-ea43ddf0ae5f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:55.542488 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1be5f93d-5b2a-4765-a5dd-ea43ddf0ae5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60fb840dfaa54deebd30fb28816935b6', 'request_id': 'req-1be5f93d-5b2a-4765-a5dd-ea43ddf0ae5f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:55.559105 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1be5f93d-5b2a-4765-a5dd-ea43ddf0ae5f admin admin] The token cache is being invalidate because project 60fb840dfaa54deebd30fb28816935b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:55.559516 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1be5f93d-5b2a-4765-a5dd-ea43ddf0ae5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:55.560511 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1be5f93d-5b2a-4765-a5dd-ea43ddf0ae5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:55.562425 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 991/1993] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:55 2022] DELETE /identity/v3/projects/60fb840dfaa54deebd30fb28816935b6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:55.567759 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5170fea-1c29-44a8-af97-048ef2fcfacf None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:55.568047 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5170fea-1c29-44a8-af97-048ef2fcfacf None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:55.568317 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5170fea-1c29-44a8-af97-048ef2fcfacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:55.586196 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-e5170fea-1c29-44a8-af97-048ef2fcfacf None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:55.587401 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-e5170fea-1c29-44a8-af97-048ef2fcfacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:55.646692 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1003/1994] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:55.654561 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540dc57-2790-40a2-bf6c-e5b9e60cef17 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:55.654847 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540dc57-2790-40a2-bf6c-e5b9e60cef17 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:55.655159 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540dc57-2790-40a2-bf6c-e5b9e60cef17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:55.675688 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-d540dc57-2790-40a2-bf6c-e5b9e60cef17 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:55.677252 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d540dc57-2790-40a2-bf6c-e5b9e60cef17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:55.686586 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 992/1995] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:55.691150 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5170fea-1c29-44a8-af97-048ef2fcfacf None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:55.702691 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5170fea-1c29-44a8-af97-048ef2fcfacf None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:55.708214 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc78e7-693b-4d76-a17f-d2259bc1fa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:55.709124 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc78e7-693b-4d76-a17f-d2259bc1fa01 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:55.709658 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc78e7-693b-4d76-a17f-d2259bc1fa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:55.709923 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc78e7-693b-4d76-a17f-d2259bc1fa01 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:55.710654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc78e7-693b-4d76-a17f-d2259bc1fa01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:58:55.710936 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc78e7-693b-4d76-a17f-d2259bc1fa01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:55.712535 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc78e7-693b-4d76-a17f-d2259bc1fa01 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:55.726554 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1004/1996] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:58:55.730605 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540dc57-2790-40a2-bf6c-e5b9e60cef17 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:55.740126 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540dc57-2790-40a2-bf6c-e5b9e60cef17 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:55.745037 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90049ff-46d1-4ac8-8b36-942a464e5845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:55.745805 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90049ff-46d1-4ac8-8b36-942a464e5845 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:55.746258 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90049ff-46d1-4ac8-8b36-942a464e5845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:55.746662 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90049ff-46d1-4ac8-8b36-942a464e5845 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:55.747487 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90049ff-46d1-4ac8-8b36-942a464e5845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:55.749558 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90049ff-46d1-4ac8-8b36-942a464e5845 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:55.775844 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 993/1997] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:55 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:55.779806 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc78e7-693b-4d76-a17f-d2259bc1fa01 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:55.792736 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc78e7-693b-4d76-a17f-d2259bc1fa01 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:55.847864 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6157ee-dc06-42fd-b28c-e05f15055980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:55.848525 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6157ee-dc06-42fd-b28c-e05f15055980 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:55.848798 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6157ee-dc06-42fd-b28c-e05f15055980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:55.849065 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6157ee-dc06-42fd-b28c-e05f15055980 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:55.849819 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6157ee-dc06-42fd-b28c-e05f15055980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:55.851708 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6157ee-dc06-42fd-b28c-e05f15055980 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:55.871992 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1005/1998] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:55 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:55.876374 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90049ff-46d1-4ac8-8b36-942a464e5845 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:55.888641 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90049ff-46d1-4ac8-8b36-942a464e5845 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:55.895295 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44e25e-5fbe-4c35-9457-92057807a4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:55.895971 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44e25e-5fbe-4c35-9457-92057807a4fc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:55.896247 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44e25e-5fbe-4c35-9457-92057807a4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:55.896509 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44e25e-5fbe-4c35-9457-92057807a4fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:55.897248 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44e25e-5fbe-4c35-9457-92057807a4fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:55.898871 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44e25e-5fbe-4c35-9457-92057807a4fc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:55.910476 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 994/1999] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:55.915423 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6157ee-dc06-42fd-b28c-e05f15055980 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:55.927860 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6157ee-dc06-42fd-b28c-e05f15055980 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:55.933504 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0bc8b-c757-45fb-aab1-df146fe7e560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:55.934172 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0bc8b-c757-45fb-aab1-df146fe7e560 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:55.934448 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0bc8b-c757-45fb-aab1-df146fe7e560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:55.934732 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0bc8b-c757-45fb-aab1-df146fe7e560 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:55.935464 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0bc8b-c757-45fb-aab1-df146fe7e560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:55.937377 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0bc8b-c757-45fb-aab1-df146fe7e560 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:55.948389 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1006/2000] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 20:58:55.952800 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44e25e-5fbe-4c35-9457-92057807a4fc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:55.963059 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44e25e-5fbe-4c35-9457-92057807a4fc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:55.968044 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ca7f2-0566-4784-8ef2-397bdfee73f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:55.968913 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ca7f2-0566-4784-8ef2-397bdfee73f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:55.969174 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ca7f2-0566-4784-8ef2-397bdfee73f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:55.969484 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ca7f2-0566-4784-8ef2-397bdfee73f5 admin admin] PATH_INFO: `/v3/projects/e1be6b19d2b14a1e8ed3a589d1e794d3/users/274bc82c1e1448eea969191f725b83a5/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:55.983964 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ca7f2-0566-4784-8ef2-397bdfee73f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1be6b19d2b14a1e8ed3a589d1e794d3, user_id=274bc82c1e1448eea969191f725b83a5, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:55.986785 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ca7f2-0566-4784-8ef2-397bdfee73f5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:56.003023 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 995/2001] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:55 2022] PUT /identity/v3/projects/e1be6b19d2b14a1e8ed3a589d1e794d3/users/274bc82c1e1448eea969191f725b83a5/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:56.014369 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48679435-63db-4a2c-a946-9142d67d8ef3 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:56.014651 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48679435-63db-4a2c-a946-9142d67d8ef3 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:56.014921 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48679435-63db-4a2c-a946-9142d67d8ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:56.042439 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-48679435-63db-4a2c-a946-9142d67d8ef3 None None] MFA Rules not processed for user `274bc82c1e1448eea969191f725b83a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:56.043889 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-48679435-63db-4a2c-a946-9142d67d8ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:56.110638 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1007/2002] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:56.122470 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ca7f2-0566-4784-8ef2-397bdfee73f5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:56.124697 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-874ca7f2-0566-4784-8ef2-397bdfee73f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:56.182047 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ca7f2-0566-4784-8ef2-397bdfee73f5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:56.185997 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb712f-fd67-421c-b82a-236aff8a7eb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:56.186644 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb712f-fd67-421c-b82a-236aff8a7eb2 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:56.186921 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb712f-fd67-421c-b82a-236aff8a7eb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:56.187190 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb712f-fd67-421c-b82a-236aff8a7eb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:56.199354 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb712f-fd67-421c-b82a-236aff8a7eb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:56.201553 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb712f-fd67-421c-b82a-236aff8a7eb2 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:56.211507 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 996/2003] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:56.308650 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48679435-63db-4a2c-a946-9142d67d8ef3 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:56.310189 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-48679435-63db-4a2c-a946-9142d67d8ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:56.391037 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48679435-63db-4a2c-a946-9142d67d8ef3 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:56.395965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187063ba-9d17-4eb5-b7a7-b1b5c0cf7b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:56.396844 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187063ba-9d17-4eb5-b7a7-b1b5c0cf7b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:56.397120 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187063ba-9d17-4eb5-b7a7-b1b5c0cf7b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:56.397659 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187063ba-9d17-4eb5-b7a7-b1b5c0cf7b22 admin admin] PATH_INFO: `/v3/users/7abfb54af4a94badb6dc69c81a8506bc` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:56.402149 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187063ba-9d17-4eb5-b7a7-b1b5c0cf7b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7abfb54af4a94badb6dc69c81a8506bc)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:56.404108 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187063ba-9d17-4eb5-b7a7-b1b5c0cf7b22 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:56.462785 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb712f-fd67-421c-b82a-236aff8a7eb2 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:56.464526 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-22fb712f-fd67-421c-b82a-236aff8a7eb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:56.479665 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-187063ba-9d17-4eb5-b7a7-b1b5c0cf7b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7abfb54af4a94badb6dc69c81a8506bc'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:56.484193 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb712f-fd67-421c-b82a-236aff8a7eb2 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:56.488929 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-187063ba-9d17-4eb5-b7a7-b1b5c0cf7b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7abfb54af4a94badb6dc69c81a8506bc'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:56.490136 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafb3f8-c267-4117-9d56-25b3320fd670 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:56.491036 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafb3f8-c267-4117-9d56-25b3320fd670 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:56.491036 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafb3f8-c267-4117-9d56-25b3320fd670 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:56.491483 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafb3f8-c267-4117-9d56-25b3320fd670 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:56.493424 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-adafb3f8-c267-4117-9d56-25b3320fd670 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:56.501736 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-187063ba-9d17-4eb5-b7a7-b1b5c0cf7b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7abfb54af4a94badb6dc69c81a8506bc'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:56.502558 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-187063ba-9d17-4eb5-b7a7-b1b5c0cf7b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7abfb54af4a94badb6dc69c81a8506bc'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:56.503344 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-187063ba-9d17-4eb5-b7a7-b1b5c0cf7b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7abfb54af4a94badb6dc69c81a8506bc'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:56.529745 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1008/2004] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:56 2022] DELETE /identity/v3/users/7abfb54af4a94badb6dc69c81a8506bc => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:56.534805 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8e0dd-2241-4685-a656-c5e1a9947179 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:56.535304 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8e0dd-2241-4685-a656-c5e1a9947179 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:56.535921 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8e0dd-2241-4685-a656-c5e1a9947179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:56.562999 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-3da8e0dd-2241-4685-a656-c5e1a9947179 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:56.564210 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-3da8e0dd-2241-4685-a656-c5e1a9947179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:56.585701 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafb3f8-c267-4117-9d56-25b3320fd670 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:56.587600 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafb3f8-c267-4117-9d56-25b3320fd670 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:56.597235 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 997/2005] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:58:56.624611 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1009/2006] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:58:56.635413 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafb3f8-c267-4117-9d56-25b3320fd670 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:56.636944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-adafb3f8-c267-4117-9d56-25b3320fd670 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:56.694577 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafb3f8-c267-4117-9d56-25b3320fd670 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:56.742272 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97754a0d-bfa7-4808-b9ae-47f379f94580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:56.742916 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97754a0d-bfa7-4808-b9ae-47f379f94580 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:56.743191 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97754a0d-bfa7-4808-b9ae-47f379f94580 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:56.743462 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97754a0d-bfa7-4808-b9ae-47f379f94580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:56.752703 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97754a0d-bfa7-4808-b9ae-47f379f94580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:56.754211 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97754a0d-bfa7-4808-b9ae-47f379f94580 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:56.764370 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 998/2007] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:57.088342 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8e0dd-2241-4685-a656-c5e1a9947179 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:57.089825 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-3da8e0dd-2241-4685-a656-c5e1a9947179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:57.103401 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8e0dd-2241-4685-a656-c5e1a9947179 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:57.108399 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec856af0-dd07-480f-a0fd-6147d7457ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:57.109261 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec856af0-dd07-480f-a0fd-6147d7457ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:57.109602 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec856af0-dd07-480f-a0fd-6147d7457ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:57.110375 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec856af0-dd07-480f-a0fd-6147d7457ca5 admin admin] PATH_INFO: `/v3/projects/ee8b374c999b404d883bc23afc4fbdd5` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:57.111694 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec856af0-dd07-480f-a0fd-6147d7457ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee8b374c999b404d883bc23afc4fbdd5)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:57.113522 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec856af0-dd07-480f-a0fd-6147d7457ca5 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:57.169713 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97754a0d-bfa7-4808-b9ae-47f379f94580 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:57.171289 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-97754a0d-bfa7-4808-b9ae-47f379f94580 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:57.172517 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ec856af0-dd07-480f-a0fd-6147d7457ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee8b374c999b404d883bc23afc4fbdd5', 'request_id': 'req-ec856af0-dd07-480f-a0fd-6147d7457ca5'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:57.178821 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ec856af0-dd07-480f-a0fd-6147d7457ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee8b374c999b404d883bc23afc4fbdd5', 'request_id': 'req-ec856af0-dd07-480f-a0fd-6147d7457ca5'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:57.185186 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ec856af0-dd07-480f-a0fd-6147d7457ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee8b374c999b404d883bc23afc4fbdd5', 'request_id': 'req-ec856af0-dd07-480f-a0fd-6147d7457ca5'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:57.200330 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ec856af0-dd07-480f-a0fd-6147d7457ca5 admin admin] The token cache is being invalidate because project ee8b374c999b404d883bc23afc4fbdd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:57.200883 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ec856af0-dd07-480f-a0fd-6147d7457ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:57.201564 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ec856af0-dd07-480f-a0fd-6147d7457ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:57.206682 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1010/2008] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:57 2022] DELETE /identity/v3/projects/ee8b374c999b404d883bc23afc4fbdd5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:57.208512 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec856af0-dd07-480f-a0fd-6147d7457ca5 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:57.213412 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ec856af0-dd07-480f-a0fd-6147d7457ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:57.230132 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97754a0d-bfa7-4808-b9ae-47f379f94580 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:57.274553 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec856af0-dd07-480f-a0fd-6147d7457ca5 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:57.278377 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2fa86-b5c5-4cf6-a2ab-0b95dce94ca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:57.279029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2fa86-b5c5-4cf6-a2ab-0b95dce94ca4 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:57.279307 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121218e-b3d3-4c8d-ae02-8ebf147ac588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:57.279426 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2fa86-b5c5-4cf6-a2ab-0b95dce94ca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:57.279629 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2fa86-b5c5-4cf6-a2ab-0b95dce94ca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:57.280239 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121218e-b3d3-4c8d-ae02-8ebf147ac588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:57.280526 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121218e-b3d3-4c8d-ae02-8ebf147ac588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:57.280795 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121218e-b3d3-4c8d-ae02-8ebf147ac588 admin admin] PATH_INFO: `/v3/users/814ae6489d314dccbd7c9d2ac76fe4bd` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:57.281558 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f5f2fa86-b5c5-4cf6-a2ab-0b95dce94ca4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:57.282023 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121218e-b3d3-4c8d-ae02-8ebf147ac588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=814ae6489d314dccbd7c9d2ac76fe4bd)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:57.283953 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121218e-b3d3-4c8d-ae02-8ebf147ac588 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:57.331064 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-8121218e-b3d3-4c8d-ae02-8ebf147ac588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '814ae6489d314dccbd7c9d2ac76fe4bd'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:57.338517 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-8121218e-b3d3-4c8d-ae02-8ebf147ac588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '814ae6489d314dccbd7c9d2ac76fe4bd'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:57.346030 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2fa86-b5c5-4cf6-a2ab-0b95dce94ca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:57.347469 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2fa86-b5c5-4cf6-a2ab-0b95dce94ca4 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:57.351198 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-8121218e-b3d3-4c8d-ae02-8ebf147ac588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '814ae6489d314dccbd7c9d2ac76fe4bd'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:57.352032 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-8121218e-b3d3-4c8d-ae02-8ebf147ac588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '814ae6489d314dccbd7c9d2ac76fe4bd'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:57.352631 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-8121218e-b3d3-4c8d-ae02-8ebf147ac588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '814ae6489d314dccbd7c9d2ac76fe4bd'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:57.357057 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 999/2009] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:58:57.365954 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1011/2010] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:58:57 2022] DELETE /identity/v3/users/814ae6489d314dccbd7c9d2ac76fe4bd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:57.671827 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2fa86-b5c5-4cf6-a2ab-0b95dce94ca4 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:57.684436 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2fa86-b5c5-4cf6-a2ab-0b95dce94ca4 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:57.746253 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9abd8-d628-44d2-8163-57dbfe46812d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:57.747118 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9abd8-d628-44d2-8163-57dbfe46812d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:57.747391 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9abd8-d628-44d2-8163-57dbfe46812d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:57.747686 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9abd8-d628-44d2-8163-57dbfe46812d admin admin] PATH_INFO: `/v3/projects/340461c11f2b4087b8b2d476e30e8a6f` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:57.749068 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9abd8-d628-44d2-8163-57dbfe46812d admin admin] RBAC: Authorizing `identity:delete_project(project_id=340461c11f2b4087b8b2d476e30e8a6f)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:57.751052 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9abd8-d628-44d2-8163-57dbfe46812d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:57.813968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3bf9abd8-d628-44d2-8163-57dbfe46812d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '340461c11f2b4087b8b2d476e30e8a6f', 'request_id': 'req-3bf9abd8-d628-44d2-8163-57dbfe46812d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:57.819818 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3bf9abd8-d628-44d2-8163-57dbfe46812d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '340461c11f2b4087b8b2d476e30e8a6f', 'request_id': 'req-3bf9abd8-d628-44d2-8163-57dbfe46812d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:57.826474 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3bf9abd8-d628-44d2-8163-57dbfe46812d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '340461c11f2b4087b8b2d476e30e8a6f', 'request_id': 'req-3bf9abd8-d628-44d2-8163-57dbfe46812d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:57.839868 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3bf9abd8-d628-44d2-8163-57dbfe46812d admin admin] The token cache is being invalidate because project 340461c11f2b4087b8b2d476e30e8a6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:58:57.840723 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3bf9abd8-d628-44d2-8163-57dbfe46812d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:57.841662 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3bf9abd8-d628-44d2-8163-57dbfe46812d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:58:57.843276 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1000/2011] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:58:57 2022] DELETE /identity/v3/projects/340461c11f2b4087b8b2d476e30e8a6f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:57.848246 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ac3ae-fd47-4476-9b84-3186da2e2ae3 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:57.848537 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ac3ae-fd47-4476-9b84-3186da2e2ae3 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:57.848842 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ac3ae-fd47-4476-9b84-3186da2e2ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:57.868866 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-151ac3ae-fd47-4476-9b84-3186da2e2ae3 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:57.870085 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-151ac3ae-fd47-4476-9b84-3186da2e2ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:57.935596 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1012/2012] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:57.946681 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b0f0e-8eb3-414b-a836-8a6f3bce4b59 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:57.946964 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b0f0e-8eb3-414b-a836-8a6f3bce4b59 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:57.947218 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b0f0e-8eb3-414b-a836-8a6f3bce4b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:57.967783 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7f4b0f0e-8eb3-414b-a836-8a6f3bce4b59 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:57.969139 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7f4b0f0e-8eb3-414b-a836-8a6f3bce4b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:57.977883 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1001/2013] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:57.982159 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ac3ae-fd47-4476-9b84-3186da2e2ae3 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:57.993857 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ac3ae-fd47-4476-9b84-3186da2e2ae3 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:57.999540 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a5319-dd4e-44cd-9a76-baefcfb0ce93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:58.000223 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a5319-dd4e-44cd-9a76-baefcfb0ce93 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:58.000497 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a5319-dd4e-44cd-9a76-baefcfb0ce93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:58.000763 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a5319-dd4e-44cd-9a76-baefcfb0ce93 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:58.001578 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a5319-dd4e-44cd-9a76-baefcfb0ce93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:58:58.001962 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a5319-dd4e-44cd-9a76-baefcfb0ce93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:58.003643 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a5319-dd4e-44cd-9a76-baefcfb0ce93 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:58.015864 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1013/2014] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:58:58.020373 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b0f0e-8eb3-414b-a836-8a6f3bce4b59 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:58.029541 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b0f0e-8eb3-414b-a836-8a6f3bce4b59 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:58.034707 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5cec4-66db-49f2-bf6e-567fe3154ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:58.035379 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5cec4-66db-49f2-bf6e-567fe3154ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:58.035652 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5cec4-66db-49f2-bf6e-567fe3154ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:58.035918 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5cec4-66db-49f2-bf6e-567fe3154ef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:58.036611 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5cec4-66db-49f2-bf6e-567fe3154ef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:58.038517 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5cec4-66db-49f2-bf6e-567fe3154ef3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:58.079201 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1002/2015] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:58 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:58.083293 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a5319-dd4e-44cd-9a76-baefcfb0ce93 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:58.093638 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a5319-dd4e-44cd-9a76-baefcfb0ce93 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:58.151902 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d17c3-5f64-47db-bc10-ae8bae52816c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:58.152578 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d17c3-5f64-47db-bc10-ae8bae52816c admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:58.152856 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d17c3-5f64-47db-bc10-ae8bae52816c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:58.153126 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d17c3-5f64-47db-bc10-ae8bae52816c admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:58.153859 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d17c3-5f64-47db-bc10-ae8bae52816c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:58.155788 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d17c3-5f64-47db-bc10-ae8bae52816c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:58.178101 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1014/2016] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:58 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:58:58.182308 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5cec4-66db-49f2-bf6e-567fe3154ef3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:58.192540 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5cec4-66db-49f2-bf6e-567fe3154ef3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:58.197154 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85390c-b5e1-4c65-a037-9c62a821c8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:58.197844 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85390c-b5e1-4c65-a037-9c62a821c8bd admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:58.198121 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85390c-b5e1-4c65-a037-9c62a821c8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:58.198389 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85390c-b5e1-4c65-a037-9c62a821c8bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:58.199113 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85390c-b5e1-4c65-a037-9c62a821c8bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:58.200700 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85390c-b5e1-4c65-a037-9c62a821c8bd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:58.211119 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1003/2017] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:58.215303 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d17c3-5f64-47db-bc10-ae8bae52816c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:58.225630 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d17c3-5f64-47db-bc10-ae8bae52816c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:58.233188 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13af39c-9c5c-4dec-a4cc-a3038c4cbc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:58.233919 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13af39c-9c5c-4dec-a4cc-a3038c4cbc9f admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:58.234203 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13af39c-9c5c-4dec-a4cc-a3038c4cbc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:58.234474 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13af39c-9c5c-4dec-a4cc-a3038c4cbc9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:58.235215 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13af39c-9c5c-4dec-a4cc-a3038c4cbc9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:58.236827 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13af39c-9c5c-4dec-a4cc-a3038c4cbc9f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:58.249221 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1015/2018] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:58.253929 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85390c-b5e1-4c65-a037-9c62a821c8bd admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:58.264478 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85390c-b5e1-4c65-a037-9c62a821c8bd admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:58.270008 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef5ecf-c4af-42c8-8427-070ad0272671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:58.271455 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef5ecf-c4af-42c8-8427-070ad0272671 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:58.271805 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef5ecf-c4af-42c8-8427-070ad0272671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:58.272143 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef5ecf-c4af-42c8-8427-070ad0272671 admin admin] PATH_INFO: `/v3/projects/7170b914023c45a2b7ec39e85b8a681f/users/e6b613d51a9a48c0ac4d016ecde1f6d5/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:58.288488 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef5ecf-c4af-42c8-8427-070ad0272671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7170b914023c45a2b7ec39e85b8a681f, user_id=e6b613d51a9a48c0ac4d016ecde1f6d5, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:58.291281 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef5ecf-c4af-42c8-8427-070ad0272671 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:58.304533 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1004/2019] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:58 2022] PUT /identity/v3/projects/7170b914023c45a2b7ec39e85b8a681f/users/e6b613d51a9a48c0ac4d016ecde1f6d5/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:58:58.316165 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff67dce-2cdd-46e6-9098-cb5c2241e3b6 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:58.316316 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff67dce-2cdd-46e6-9098-cb5c2241e3b6 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:58.316593 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff67dce-2cdd-46e6-9098-cb5c2241e3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:58.345190 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-2ff67dce-2cdd-46e6-9098-cb5c2241e3b6 None None] MFA Rules not processed for user `e6b613d51a9a48c0ac4d016ecde1f6d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:58.346378 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-2ff67dce-2cdd-46e6-9098-cb5c2241e3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:58.413758 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1016/2020] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:58.419196 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef5ecf-c4af-42c8-8427-070ad0272671 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:58.480724 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef5ecf-c4af-42c8-8427-070ad0272671 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:58.485436 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95ff88-2513-4493-bc18-885562c68079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:58.486108 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95ff88-2513-4493-bc18-885562c68079 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:58.486380 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95ff88-2513-4493-bc18-885562c68079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:58.486649 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95ff88-2513-4493-bc18-885562c68079 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:58.487345 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95ff88-2513-4493-bc18-885562c68079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:58.489235 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95ff88-2513-4493-bc18-885562c68079 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:58.521045 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1005/2021] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:58 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:58.524865 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff67dce-2cdd-46e6-9098-cb5c2241e3b6 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:58.536077 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff67dce-2cdd-46e6-9098-cb5c2241e3b6 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:58.594448 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacf3cd-0183-4488-b49d-233b35f56059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:58.595129 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacf3cd-0183-4488-b49d-233b35f56059 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:58.595477 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacf3cd-0183-4488-b49d-233b35f56059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:58.595649 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacf3cd-0183-4488-b49d-233b35f56059 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:58.596369 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacf3cd-0183-4488-b49d-233b35f56059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:58.598314 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacf3cd-0183-4488-b49d-233b35f56059 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:58.619159 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1017/2022] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:58 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:58.623473 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95ff88-2513-4493-bc18-885562c68079 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:58.634548 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95ff88-2513-4493-bc18-885562c68079 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:58.640078 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7f89c-dd3b-4b72-92db-1997885f37f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:58.640733 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7f89c-dd3b-4b72-92db-1997885f37f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:58.641006 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7f89c-dd3b-4b72-92db-1997885f37f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:58.641272 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7f89c-dd3b-4b72-92db-1997885f37f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:58.642033 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7f89c-dd3b-4b72-92db-1997885f37f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:58.643607 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7f89c-dd3b-4b72-92db-1997885f37f3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:58.659515 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1006/2023] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:58.660919 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacf3cd-0183-4488-b49d-233b35f56059 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:58.671554 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacf3cd-0183-4488-b49d-233b35f56059 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:58.678313 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f579c40-beee-442a-8aeb-eb155306551c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:58.679269 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f579c40-beee-442a-8aeb-eb155306551c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:58.679708 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f579c40-beee-442a-8aeb-eb155306551c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:58.680120 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f579c40-beee-442a-8aeb-eb155306551c admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:58.681045 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f579c40-beee-442a-8aeb-eb155306551c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:58.682925 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f579c40-beee-442a-8aeb-eb155306551c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:58.694715 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1018/2024] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:58.699127 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7f89c-dd3b-4b72-92db-1997885f37f3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:58.709451 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7f89c-dd3b-4b72-92db-1997885f37f3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:58.714183 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a963dc-4303-481e-a9f7-409212ee7390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:58.715058 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a963dc-4303-481e-a9f7-409212ee7390 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:58.715336 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a963dc-4303-481e-a9f7-409212ee7390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:58.715607 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a963dc-4303-481e-a9f7-409212ee7390 admin admin] PATH_INFO: `/v3/projects/b841618cda484b3ea88399a077336f91/users/65276b21615241dcb34e6c2897abadb2/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:58.729979 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a963dc-4303-481e-a9f7-409212ee7390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b841618cda484b3ea88399a077336f91, user_id=65276b21615241dcb34e6c2897abadb2, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:58.732702 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a963dc-4303-481e-a9f7-409212ee7390 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:58.747895 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1007/2025] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:58 2022] PUT /identity/v3/projects/b841618cda484b3ea88399a077336f91/users/65276b21615241dcb34e6c2897abadb2/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:58.758273 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a2164-5db8-4661-bfe1-ce4fc91cd84b None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:58.758661 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a2164-5db8-4661-bfe1-ce4fc91cd84b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:58.759067 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a2164-5db8-4661-bfe1-ce4fc91cd84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:58.787372 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-d94a2164-5db8-4661-bfe1-ce4fc91cd84b None None] MFA Rules not processed for user `65276b21615241dcb34e6c2897abadb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:58.788769 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d94a2164-5db8-4661-bfe1-ce4fc91cd84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:58.856946 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1019/2026] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:58.861553 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a963dc-4303-481e-a9f7-409212ee7390 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:58.937627 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a963dc-4303-481e-a9f7-409212ee7390 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:58.944027 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e46b3-6011-4b4c-b2c3-61dc2fc199b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:58.944784 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e46b3-6011-4b4c-b2c3-61dc2fc199b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:58.945125 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e46b3-6011-4b4c-b2c3-61dc2fc199b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:58.945501 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e46b3-6011-4b4c-b2c3-61dc2fc199b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:58.946268 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e46b3-6011-4b4c-b2c3-61dc2fc199b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:58.949884 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e46b3-6011-4b4c-b2c3-61dc2fc199b7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:58.977697 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1008/2027] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:58:58 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:58.983405 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a2164-5db8-4661-bfe1-ce4fc91cd84b None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:58.994264 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a2164-5db8-4661-bfe1-ce4fc91cd84b None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:59.053723 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b60eb5-031d-47e6-907e-531548c01fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:59.054399 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b60eb5-031d-47e6-907e-531548c01fcc admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:59.054681 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b60eb5-031d-47e6-907e-531548c01fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:59.054952 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b60eb5-031d-47e6-907e-531548c01fcc admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:59.055653 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b60eb5-031d-47e6-907e-531548c01fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:59.057598 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b60eb5-031d-47e6-907e-531548c01fcc admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:59.079812 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1020/2028] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:58:58 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:58:59.083961 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e46b3-6011-4b4c-b2c3-61dc2fc199b7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:59.094407 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e46b3-6011-4b4c-b2c3-61dc2fc199b7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:59.100220 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ca837-21e9-475c-be4d-a459105bbc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:59.100811 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ca837-21e9-475c-be4d-a459105bbc1b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:59.101089 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ca837-21e9-475c-be4d-a459105bbc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:59.101344 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ca837-21e9-475c-be4d-a459105bbc1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:59.102113 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ca837-21e9-475c-be4d-a459105bbc1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:59.103720 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ca837-21e9-475c-be4d-a459105bbc1b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:59.114554 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1009/2029] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:59.118858 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b60eb5-031d-47e6-907e-531548c01fcc admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:59.129535 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b60eb5-031d-47e6-907e-531548c01fcc admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:59.135588 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113ea34-9685-49f2-915d-39b7d5742502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:59.136469 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113ea34-9685-49f2-915d-39b7d5742502 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:59.136753 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113ea34-9685-49f2-915d-39b7d5742502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:59.137028 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113ea34-9685-49f2-915d-39b7d5742502 admin admin] PATH_INFO: `/v3/projects/3f18287f20384e6080dce0b930f347fa/users/7e0ba7b440854f578d9540e462faeb94/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:59.153747 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113ea34-9685-49f2-915d-39b7d5742502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f18287f20384e6080dce0b930f347fa, user_id=7e0ba7b440854f578d9540e462faeb94, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:59.156396 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113ea34-9685-49f2-915d-39b7d5742502 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:59.172777 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1021/2030] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:59 2022] PUT /identity/v3/projects/3f18287f20384e6080dce0b930f347fa/users/7e0ba7b440854f578d9540e462faeb94/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:59.177119 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ca837-21e9-475c-be4d-a459105bbc1b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:59.187220 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ca837-21e9-475c-be4d-a459105bbc1b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:59.251496 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24012b8b-cbb6-45cd-9982-fda97e018967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:59.252200 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24012b8b-cbb6-45cd-9982-fda97e018967 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:59.252479 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24012b8b-cbb6-45cd-9982-fda97e018967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:59.252751 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24012b8b-cbb6-45cd-9982-fda97e018967 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:59.253496 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24012b8b-cbb6-45cd-9982-fda97e018967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:59.255393 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24012b8b-cbb6-45cd-9982-fda97e018967 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:59.267017 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1010/2031] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:58:59.271355 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113ea34-9685-49f2-915d-39b7d5742502 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:59.281849 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113ea34-9685-49f2-915d-39b7d5742502 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:59.286692 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf42f2c-427d-44ca-a4e4-c0321d15527b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:59.287566 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf42f2c-427d-44ca-a4e4-c0321d15527b admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:59.287846 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf42f2c-427d-44ca-a4e4-c0321d15527b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:59.288135 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf42f2c-427d-44ca-a4e4-c0321d15527b admin admin] PATH_INFO: `/v3/projects/3f18287f20384e6080dce0b930f347fa/users/7e0ba7b440854f578d9540e462faeb94/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:59.290147 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf42f2c-427d-44ca-a4e4-c0321d15527b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f18287f20384e6080dce0b930f347fa, user_id=7e0ba7b440854f578d9540e462faeb94, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:59.292759 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf42f2c-427d-44ca-a4e4-c0321d15527b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:59.306122 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1022/2032] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:58:59 2022] PUT /identity/v3/projects/3f18287f20384e6080dce0b930f347fa/users/7e0ba7b440854f578d9540e462faeb94/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:58:59.316300 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf2aa6-d130-4e73-88b3-4ed2d29e601c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:59.316586 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf2aa6-d130-4e73-88b3-4ed2d29e601c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:59.316859 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf2aa6-d130-4e73-88b3-4ed2d29e601c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:59.345192 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ccdf2aa6-d130-4e73-88b3-4ed2d29e601c None None] MFA Rules not processed for user `7e0ba7b440854f578d9540e462faeb94`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:58:59.346438 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ccdf2aa6-d130-4e73-88b3-4ed2d29e601c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:59.432719 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1011/2033] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:58:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:58:59.442583 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf42f2c-427d-44ca-a4e4-c0321d15527b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:58:59.444368 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-7bf42f2c-427d-44ca-a4e4-c0321d15527b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:58:59.506855 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf42f2c-427d-44ca-a4e4-c0321d15527b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:58:59.511667 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95472565-7a26-4222-86e9-7de86d7cae9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:58:59.512418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95472565-7a26-4222-86e9-7de86d7cae9c service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:58:59.512699 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95472565-7a26-4222-86e9-7de86d7cae9c service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:58:59.512969 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95472565-7a26-4222-86e9-7de86d7cae9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:58:59.523639 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95472565-7a26-4222-86e9-7de86d7cae9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:58:59.525126 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95472565-7a26-4222-86e9-7de86d7cae9c service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:58:59.536284 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1023/2034] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:58:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:59:00.037502 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf2aa6-d130-4e73-88b3-4ed2d29e601c None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:00.038990 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ccdf2aa6-d130-4e73-88b3-4ed2d29e601c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:00.052023 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf2aa6-d130-4e73-88b3-4ed2d29e601c None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:00.058105 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01a4e5-a020-410f-863c-2fa3ea04b69f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:00.058976 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01a4e5-a020-410f-863c-2fa3ea04b69f service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:00.059401 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01a4e5-a020-410f-863c-2fa3ea04b69f service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:00.059647 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01a4e5-a020-410f-863c-2fa3ea04b69f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:00.119871 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01a4e5-a020-410f-863c-2fa3ea04b69f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:00.121326 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01a4e5-a020-410f-863c-2fa3ea04b69f service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:00.130650 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1012/2035] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:59:12.962662 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95472565-7a26-4222-86e9-7de86d7cae9c service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:12.964163 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-95472565-7a26-4222-86e9-7de86d7cae9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:13.028035 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95472565-7a26-4222-86e9-7de86d7cae9c service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:13.033202 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b149f59-438d-4253-9547-0e8d20f3824d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:13.034109 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b149f59-438d-4253-9547-0e8d20f3824d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:13.034353 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b149f59-438d-4253-9547-0e8d20f3824d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:13.034635 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b149f59-438d-4253-9547-0e8d20f3824d admin admin] PATH_INFO: `/v3/users/b851bf7577f84c06aaa128f18b61b23a` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:13.035875 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b149f59-438d-4253-9547-0e8d20f3824d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b851bf7577f84c06aaa128f18b61b23a)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:13.037836 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b149f59-438d-4253-9547-0e8d20f3824d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:13.091554 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-8b149f59-438d-4253-9547-0e8d20f3824d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b851bf7577f84c06aaa128f18b61b23a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:13.100365 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-8b149f59-438d-4253-9547-0e8d20f3824d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b851bf7577f84c06aaa128f18b61b23a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:13.114138 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-8b149f59-438d-4253-9547-0e8d20f3824d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b851bf7577f84c06aaa128f18b61b23a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:13.114876 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-8b149f59-438d-4253-9547-0e8d20f3824d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b851bf7577f84c06aaa128f18b61b23a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:13.115478 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-8b149f59-438d-4253-9547-0e8d20f3824d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b851bf7577f84c06aaa128f18b61b23a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:13.131051 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1024/2036] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:59:12 2022] DELETE /identity/v3/users/b851bf7577f84c06aaa128f18b61b23a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:13.135494 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddb8e1-7781-4f64-9d7c-ac1d7b837ad7 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:13.135997 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddb8e1-7781-4f64-9d7c-ac1d7b837ad7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:13.136089 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddb8e1-7781-4f64-9d7c-ac1d7b837ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:13.155667 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-aaddb8e1-7781-4f64-9d7c-ac1d7b837ad7 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:13.156906 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-aaddb8e1-7781-4f64-9d7c-ac1d7b837ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:13.217338 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1013/2037] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:13.227177 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b149f59-438d-4253-9547-0e8d20f3824d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:13.228725 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-8b149f59-438d-4253-9547-0e8d20f3824d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:13.288166 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b149f59-438d-4253-9547-0e8d20f3824d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:13.292123 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff7214-4c4c-43c7-8924-6f5efe8a9f9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:13.292763 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff7214-4c4c-43c7-8924-6f5efe8a9f9a service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:13.293041 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff7214-4c4c-43c7-8924-6f5efe8a9f9a service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:13.293310 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff7214-4c4c-43c7-8924-6f5efe8a9f9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:13.302706 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff7214-4c4c-43c7-8924-6f5efe8a9f9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:13.304132 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff7214-4c4c-43c7-8924-6f5efe8a9f9a service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:13.314178 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1025/2038] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:59:13.609416 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddb8e1-7781-4f64-9d7c-ac1d7b837ad7 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:13.611351 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-aaddb8e1-7781-4f64-9d7c-ac1d7b837ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:13.624220 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddb8e1-7781-4f64-9d7c-ac1d7b837ad7 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:13.629575 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c022b1-2755-4c9e-9381-c8a19c066e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:13.630961 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c022b1-2755-4c9e-9381-c8a19c066e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:13.631241 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c022b1-2755-4c9e-9381-c8a19c066e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:13.631791 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c022b1-2755-4c9e-9381-c8a19c066e16 admin admin] PATH_INFO: `/v3/projects/98a2beb89ce3428abc7f2e0345bdfa5d` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:13.633245 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c022b1-2755-4c9e-9381-c8a19c066e16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98a2beb89ce3428abc7f2e0345bdfa5d)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:13.635665 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c022b1-2755-4c9e-9381-c8a19c066e16 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:13.681999 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-13c022b1-2755-4c9e-9381-c8a19c066e16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98a2beb89ce3428abc7f2e0345bdfa5d', 'request_id': 'req-13c022b1-2755-4c9e-9381-c8a19c066e16'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:13.687349 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-13c022b1-2755-4c9e-9381-c8a19c066e16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98a2beb89ce3428abc7f2e0345bdfa5d', 'request_id': 'req-13c022b1-2755-4c9e-9381-c8a19c066e16'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:13.693703 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-13c022b1-2755-4c9e-9381-c8a19c066e16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98a2beb89ce3428abc7f2e0345bdfa5d', 'request_id': 'req-13c022b1-2755-4c9e-9381-c8a19c066e16'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:13.708799 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-13c022b1-2755-4c9e-9381-c8a19c066e16 admin admin] The token cache is being invalidate because project 98a2beb89ce3428abc7f2e0345bdfa5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:59:13.709077 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-13c022b1-2755-4c9e-9381-c8a19c066e16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:13.709771 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-13c022b1-2755-4c9e-9381-c8a19c066e16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:13.711402 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1014/2039] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:59:13 2022] DELETE /identity/v3/projects/98a2beb89ce3428abc7f2e0345bdfa5d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:13.715567 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff7214-4c4c-43c7-8924-6f5efe8a9f9a service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:13.725472 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff7214-4c4c-43c7-8924-6f5efe8a9f9a service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:13.783034 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773b559-bd22-4779-88ef-824a11ddef84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:13.783917 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773b559-bd22-4779-88ef-824a11ddef84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:13.784672 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773b559-bd22-4779-88ef-824a11ddef84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:13.784950 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773b559-bd22-4779-88ef-824a11ddef84 admin admin] PATH_INFO: `/v3/users/6fe1340af9404d519de9d5521e2e8e43` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:13.786202 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773b559-bd22-4779-88ef-824a11ddef84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe1340af9404d519de9d5521e2e8e43)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:13.788143 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773b559-bd22-4779-88ef-824a11ddef84 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:13.838173 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-e773b559-bd22-4779-88ef-824a11ddef84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe1340af9404d519de9d5521e2e8e43'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:13.845169 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-e773b559-bd22-4779-88ef-824a11ddef84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe1340af9404d519de9d5521e2e8e43'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:13.857208 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-e773b559-bd22-4779-88ef-824a11ddef84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe1340af9404d519de9d5521e2e8e43'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:13.858076 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-e773b559-bd22-4779-88ef-824a11ddef84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe1340af9404d519de9d5521e2e8e43'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:13.858694 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-e773b559-bd22-4779-88ef-824a11ddef84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe1340af9404d519de9d5521e2e8e43'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:13.872266 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1026/2040] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:59:13 2022] DELETE /identity/v3/users/6fe1340af9404d519de9d5521e2e8e43 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:59:14.138912 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c022b1-2755-4c9e-9381-c8a19c066e16 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:14.140610 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-13c022b1-2755-4c9e-9381-c8a19c066e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:14.153912 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c022b1-2755-4c9e-9381-c8a19c066e16 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:14.209221 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ed996-fbdf-4eac-8a5b-0700c1f75bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:14.210121 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ed996-fbdf-4eac-8a5b-0700c1f75bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:14.210397 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ed996-fbdf-4eac-8a5b-0700c1f75bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:14.210667 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ed996-fbdf-4eac-8a5b-0700c1f75bfe admin admin] PATH_INFO: `/v3/projects/63f5e8c9faef40cabed03a249577fdd7` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:14.211916 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ed996-fbdf-4eac-8a5b-0700c1f75bfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f5e8c9faef40cabed03a249577fdd7)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:14.213815 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ed996-fbdf-4eac-8a5b-0700c1f75bfe admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:14.259449 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-208ed996-fbdf-4eac-8a5b-0700c1f75bfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f5e8c9faef40cabed03a249577fdd7', 'request_id': 'req-208ed996-fbdf-4eac-8a5b-0700c1f75bfe'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:14.265843 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-208ed996-fbdf-4eac-8a5b-0700c1f75bfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f5e8c9faef40cabed03a249577fdd7', 'request_id': 'req-208ed996-fbdf-4eac-8a5b-0700c1f75bfe'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:14.272263 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-208ed996-fbdf-4eac-8a5b-0700c1f75bfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f5e8c9faef40cabed03a249577fdd7', 'request_id': 'req-208ed996-fbdf-4eac-8a5b-0700c1f75bfe'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:14.288848 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-208ed996-fbdf-4eac-8a5b-0700c1f75bfe admin admin] The token cache is being invalidate because project 63f5e8c9faef40cabed03a249577fdd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:59:14.289198 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-208ed996-fbdf-4eac-8a5b-0700c1f75bfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:14.290198 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-208ed996-fbdf-4eac-8a5b-0700c1f75bfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:14.292658 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1015/2041] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:59:14 2022] DELETE /identity/v3/projects/63f5e8c9faef40cabed03a249577fdd7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:14.296740 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773b559-bd22-4779-88ef-824a11ddef84 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:14.298413 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-e773b559-bd22-4779-88ef-824a11ddef84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:14.312759 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773b559-bd22-4779-88ef-824a11ddef84 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:14.369238 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00afe5-383a-4e7c-a16d-0780fc408e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:14.370144 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00afe5-383a-4e7c-a16d-0780fc408e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:14.370420 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00afe5-383a-4e7c-a16d-0780fc408e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:14.370688 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00afe5-383a-4e7c-a16d-0780fc408e96 admin admin] PATH_INFO: `/v3/users/1361a7166b19460091748ecd6babaddd` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:14.372054 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00afe5-383a-4e7c-a16d-0780fc408e96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1361a7166b19460091748ecd6babaddd)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:14.374161 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00afe5-383a-4e7c-a16d-0780fc408e96 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:14.425836 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-6a00afe5-383a-4e7c-a16d-0780fc408e96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1361a7166b19460091748ecd6babaddd'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:14.432729 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-6a00afe5-383a-4e7c-a16d-0780fc408e96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1361a7166b19460091748ecd6babaddd'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:14.444780 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-6a00afe5-383a-4e7c-a16d-0780fc408e96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1361a7166b19460091748ecd6babaddd'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:14.445559 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-6a00afe5-383a-4e7c-a16d-0780fc408e96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1361a7166b19460091748ecd6babaddd'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:14.446279 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-6a00afe5-383a-4e7c-a16d-0780fc408e96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1361a7166b19460091748ecd6babaddd'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:14.460817 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1027/2042] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:59:14 2022] DELETE /identity/v3/users/1361a7166b19460091748ecd6babaddd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:59:14.745595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ed996-fbdf-4eac-8a5b-0700c1f75bfe admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:14.747009 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-208ed996-fbdf-4eac-8a5b-0700c1f75bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:14.760258 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ed996-fbdf-4eac-8a5b-0700c1f75bfe admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:14.816106 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7eed3-b0c3-4c49-bcf8-1c35128120d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:14.816960 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7eed3-b0c3-4c49-bcf8-1c35128120d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:14.817236 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7eed3-b0c3-4c49-bcf8-1c35128120d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:14.817529 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7eed3-b0c3-4c49-bcf8-1c35128120d9 admin admin] PATH_INFO: `/v3/projects/db606515631f4602a60a8ce41870f3e5` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:14.818708 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7eed3-b0c3-4c49-bcf8-1c35128120d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db606515631f4602a60a8ce41870f3e5)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:14.820610 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7eed3-b0c3-4c49-bcf8-1c35128120d9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:14.869153 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-19a7eed3-b0c3-4c49-bcf8-1c35128120d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db606515631f4602a60a8ce41870f3e5', 'request_id': 'req-19a7eed3-b0c3-4c49-bcf8-1c35128120d9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:14.874734 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-19a7eed3-b0c3-4c49-bcf8-1c35128120d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db606515631f4602a60a8ce41870f3e5', 'request_id': 'req-19a7eed3-b0c3-4c49-bcf8-1c35128120d9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:14.881197 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-19a7eed3-b0c3-4c49-bcf8-1c35128120d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db606515631f4602a60a8ce41870f3e5', 'request_id': 'req-19a7eed3-b0c3-4c49-bcf8-1c35128120d9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:14.896468 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-19a7eed3-b0c3-4c49-bcf8-1c35128120d9 admin admin] The token cache is being invalidate because project db606515631f4602a60a8ce41870f3e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:59:14.896745 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-19a7eed3-b0c3-4c49-bcf8-1c35128120d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:14.897512 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-19a7eed3-b0c3-4c49-bcf8-1c35128120d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:14.899211 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1016/2043] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:59:14 2022] DELETE /identity/v3/projects/db606515631f4602a60a8ce41870f3e5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:14.905292 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f0f09-c5c3-4ce8-8118-837aab90f2c0 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:14.905612 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f0f09-c5c3-4ce8-8118-837aab90f2c0 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:14.905912 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f0f09-c5c3-4ce8-8118-837aab90f2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:14.923884 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-a91f0f09-c5c3-4ce8-8118-837aab90f2c0 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:14.925443 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-a91f0f09-c5c3-4ce8-8118-837aab90f2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:14.983872 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1028/2044] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:14.992613 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b8366-60bc-43e8-a859-d7d78cdb87a7 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:14.992838 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b8366-60bc-43e8-a859-d7d78cdb87a7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:14.993108 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b8366-60bc-43e8-a859-d7d78cdb87a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:15.011346 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-1e2b8366-60bc-43e8-a859-d7d78cdb87a7 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:15.012514 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1e2b8366-60bc-43e8-a859-d7d78cdb87a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:15.020617 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1017/2045] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:15.024806 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f0f09-c5c3-4ce8-8118-837aab90f2c0 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:15.034777 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f0f09-c5c3-4ce8-8118-837aab90f2c0 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:15.040316 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68fb03-f71e-4e31-a54c-e97aee9c1c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:15.040965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68fb03-f71e-4e31-a54c-e97aee9c1c19 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:15.041243 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68fb03-f71e-4e31-a54c-e97aee9c1c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:15.041552 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68fb03-f71e-4e31-a54c-e97aee9c1c19 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:15.042280 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68fb03-f71e-4e31-a54c-e97aee9c1c19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:59:15.042576 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68fb03-f71e-4e31-a54c-e97aee9c1c19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:15.044158 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68fb03-f71e-4e31-a54c-e97aee9c1c19 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:15.056384 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1029/2046] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:59:15.060623 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b8366-60bc-43e8-a859-d7d78cdb87a7 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:15.070117 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b8366-60bc-43e8-a859-d7d78cdb87a7 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:15.075459 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25640453-3959-4819-96cd-bc04410d2d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:15.076101 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25640453-3959-4819-96cd-bc04410d2d18 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:15.076370 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25640453-3959-4819-96cd-bc04410d2d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:15.076706 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25640453-3959-4819-96cd-bc04410d2d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:15.077386 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25640453-3959-4819-96cd-bc04410d2d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:15.079372 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25640453-3959-4819-96cd-bc04410d2d18 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:15.116081 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1018/2047] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:59:15 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:59:15.120491 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68fb03-f71e-4e31-a54c-e97aee9c1c19 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:15.130376 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68fb03-f71e-4e31-a54c-e97aee9c1c19 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:15.187864 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04103c6-292a-44fa-9da4-d2686ca4f11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:15.188519 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04103c6-292a-44fa-9da4-d2686ca4f11c admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:15.188795 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04103c6-292a-44fa-9da4-d2686ca4f11c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:15.189063 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04103c6-292a-44fa-9da4-d2686ca4f11c admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:15.189817 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04103c6-292a-44fa-9da4-d2686ca4f11c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:15.191711 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04103c6-292a-44fa-9da4-d2686ca4f11c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:15.211982 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1030/2048] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:59:15 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:59:15.216218 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25640453-3959-4819-96cd-bc04410d2d18 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:15.226802 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25640453-3959-4819-96cd-bc04410d2d18 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:15.232452 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1872b-c841-4e04-ba2f-cdf1d0f4d6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:15.233150 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1872b-c841-4e04-ba2f-cdf1d0f4d6df admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:15.233457 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1872b-c841-4e04-ba2f-cdf1d0f4d6df admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:15.233725 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1872b-c841-4e04-ba2f-cdf1d0f4d6df admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:15.234458 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1872b-c841-4e04-ba2f-cdf1d0f4d6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:15.236039 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1872b-c841-4e04-ba2f-cdf1d0f4d6df admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:15.246820 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1019/2049] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:15.251292 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04103c6-292a-44fa-9da4-d2686ca4f11c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:15.266560 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04103c6-292a-44fa-9da4-d2686ca4f11c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:15.274127 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067d245-36f3-4c3f-9e53-c2cfc457e763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:15.274926 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067d245-36f3-4c3f-9e53-c2cfc457e763 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:15.275234 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067d245-36f3-4c3f-9e53-c2cfc457e763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:15.275528 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067d245-36f3-4c3f-9e53-c2cfc457e763 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:15.276425 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067d245-36f3-4c3f-9e53-c2cfc457e763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:15.278506 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067d245-36f3-4c3f-9e53-c2cfc457e763 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:15.289642 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1031/2050] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:15.294335 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1872b-c841-4e04-ba2f-cdf1d0f4d6df admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:15.305034 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1872b-c841-4e04-ba2f-cdf1d0f4d6df admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:15.309953 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d14c26-e48f-446d-bbc7-1514f0256c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:15.310823 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d14c26-e48f-446d-bbc7-1514f0256c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:15.311099 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d14c26-e48f-446d-bbc7-1514f0256c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:15.311407 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d14c26-e48f-446d-bbc7-1514f0256c96 admin admin] PATH_INFO: `/v3/projects/6f0188575e2747459bdab4edb93b8756/users/8a40abb997e44dd5af95e47d333bd6af/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:15.326735 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d14c26-e48f-446d-bbc7-1514f0256c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f0188575e2747459bdab4edb93b8756, user_id=8a40abb997e44dd5af95e47d333bd6af, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:15.329380 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d14c26-e48f-446d-bbc7-1514f0256c96 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:15.345431 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1020/2051] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:59:15 2022] PUT /identity/v3/projects/6f0188575e2747459bdab4edb93b8756/users/8a40abb997e44dd5af95e47d333bd6af/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:15.356032 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2af432-866e-4356-85fb-e52aca7ac16f None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:15.356513 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2af432-866e-4356-85fb-e52aca7ac16f None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:15.356625 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2af432-866e-4356-85fb-e52aca7ac16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:15.386415 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-ed2af432-866e-4356-85fb-e52aca7ac16f None None] MFA Rules not processed for user `8a40abb997e44dd5af95e47d333bd6af`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:15.387598 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ed2af432-866e-4356-85fb-e52aca7ac16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:15.453586 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1032/2052] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:15.467699 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d14c26-e48f-446d-bbc7-1514f0256c96 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:15.469796 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-13d14c26-e48f-446d-bbc7-1514f0256c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:15.530703 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d14c26-e48f-446d-bbc7-1514f0256c96 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:15.536085 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d474b6-d211-4583-ab42-6369461d5347 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:15.537050 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d474b6-d211-4583-ab42-6369461d5347 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:15.537463 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d474b6-d211-4583-ab42-6369461d5347 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:15.537742 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d474b6-d211-4583-ab42-6369461d5347 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:15.547022 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d474b6-d211-4583-ab42-6369461d5347 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:15.548436 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d474b6-d211-4583-ab42-6369461d5347 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:15.558433 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1021/2053] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:59:21.265454 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2af432-866e-4356-85fb-e52aca7ac16f None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:21.266863 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ed2af432-866e-4356-85fb-e52aca7ac16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:21.278580 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2af432-866e-4356-85fb-e52aca7ac16f None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:21.282537 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b14be9-c15d-4ac5-9682-e9d73c87e1fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:21.283176 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b14be9-c15d-4ac5-9682-e9d73c87e1fb service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:21.283469 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b14be9-c15d-4ac5-9682-e9d73c87e1fb service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:21.283735 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b14be9-c15d-4ac5-9682-e9d73c87e1fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:21.285624 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-f6b14be9-c15d-4ac5-9682-e9d73c87e1fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:21.346895 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b14be9-c15d-4ac5-9682-e9d73c87e1fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:21.348290 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b14be9-c15d-4ac5-9682-e9d73c87e1fb service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:21.357527 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1033/2054] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:59:23.439373 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d474b6-d211-4583-ab42-6369461d5347 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:23.461386 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b14be9-c15d-4ac5-9682-e9d73c87e1fb service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:23.463313 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-f6b14be9-c15d-4ac5-9682-e9d73c87e1fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:23.506445 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d474b6-d211-4583-ab42-6369461d5347 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:23.510931 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c413f72-f032-4896-be26-a0056be435b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:23.511797 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c413f72-f032-4896-be26-a0056be435b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:23.512069 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c413f72-f032-4896-be26-a0056be435b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:23.512331 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c413f72-f032-4896-be26-a0056be435b2 admin admin] PATH_INFO: `/v3/users/8a40abb997e44dd5af95e47d333bd6af` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:23.513538 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c413f72-f032-4896-be26-a0056be435b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a40abb997e44dd5af95e47d333bd6af)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:23.515446 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c413f72-f032-4896-be26-a0056be435b2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:23.533047 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b14be9-c15d-4ac5-9682-e9d73c87e1fb service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:23.538467 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928f2fd-9bf2-446b-8cde-6aeeadbc64c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:23.539546 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928f2fd-9bf2-446b-8cde-6aeeadbc64c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:23.539830 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928f2fd-9bf2-446b-8cde-6aeeadbc64c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:23.540135 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928f2fd-9bf2-446b-8cde-6aeeadbc64c0 admin admin] PATH_INFO: `/v3/users/e6b613d51a9a48c0ac4d016ecde1f6d5` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:23.541491 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928f2fd-9bf2-446b-8cde-6aeeadbc64c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6b613d51a9a48c0ac4d016ecde1f6d5)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:23.543703 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928f2fd-9bf2-446b-8cde-6aeeadbc64c0 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:23.569238 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0c413f72-f032-4896-be26-a0056be435b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a40abb997e44dd5af95e47d333bd6af'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:23.577814 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0c413f72-f032-4896-be26-a0056be435b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a40abb997e44dd5af95e47d333bd6af'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:23.591635 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0c413f72-f032-4896-be26-a0056be435b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a40abb997e44dd5af95e47d333bd6af'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:23.592756 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0c413f72-f032-4896-be26-a0056be435b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a40abb997e44dd5af95e47d333bd6af'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:23.595449 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d928f2fd-9bf2-446b-8cde-6aeeadbc64c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6b613d51a9a48c0ac4d016ecde1f6d5'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:23.602041 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0c413f72-f032-4896-be26-a0056be435b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a40abb997e44dd5af95e47d333bd6af'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:23.603431 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d928f2fd-9bf2-446b-8cde-6aeeadbc64c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6b613d51a9a48c0ac4d016ecde1f6d5'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:23.608811 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1022/2055] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:59:23 2022] DELETE /identity/v3/users/8a40abb997e44dd5af95e47d333bd6af => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:23.613662 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e734ad-9e38-4109-a1f4-62924161ae76 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:23.614119 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e734ad-9e38-4109-a1f4-62924161ae76 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:23.614929 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e734ad-9e38-4109-a1f4-62924161ae76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:23.615833 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d928f2fd-9bf2-446b-8cde-6aeeadbc64c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6b613d51a9a48c0ac4d016ecde1f6d5'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:23.616568 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d928f2fd-9bf2-446b-8cde-6aeeadbc64c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6b613d51a9a48c0ac4d016ecde1f6d5'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:23.617760 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d928f2fd-9bf2-446b-8cde-6aeeadbc64c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6b613d51a9a48c0ac4d016ecde1f6d5'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:23.632494 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1034/2056] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:59:23 2022] DELETE /identity/v3/users/e6b613d51a9a48c0ac4d016ecde1f6d5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:59:23.634173 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-96e734ad-9e38-4109-a1f4-62924161ae76 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:23.635677 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-96e734ad-9e38-4109-a1f4-62924161ae76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:23.636845 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6835d7-c1b4-488c-8276-aa76d7c5c36e None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:23.637166 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6835d7-c1b4-488c-8276-aa76d7c5c36e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:23.637509 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6835d7-c1b4-488c-8276-aa76d7c5c36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:23.654366 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-ec6835d7-c1b4-488c-8276-aa76d7c5c36e None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:23.655584 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ec6835d7-c1b4-488c-8276-aa76d7c5c36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:23.693627 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1023/2057] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:59:23.703900 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e734ad-9e38-4109-a1f4-62924161ae76 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:23.705290 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-96e734ad-9e38-4109-a1f4-62924161ae76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:23.715539 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1035/2058] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:23.729931 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6835d7-c1b4-488c-8276-aa76d7c5c36e None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:23.732094 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ec6835d7-c1b4-488c-8276-aa76d7c5c36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:23.777057 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e734ad-9e38-4109-a1f4-62924161ae76 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:23.780657 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebea43-2a02-458c-aaee-9b082ab23756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:23.781341 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebea43-2a02-458c-aaee-9b082ab23756 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:23.781657 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebea43-2a02-458c-aaee-9b082ab23756 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:23.781930 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebea43-2a02-458c-aaee-9b082ab23756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:23.790824 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebea43-2a02-458c-aaee-9b082ab23756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:23.792244 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebea43-2a02-458c-aaee-9b082ab23756 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:23.792444 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6835d7-c1b4-488c-8276-aa76d7c5c36e None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:23.796577 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84871318-6f58-462d-8661-b8b4194e167f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:23.797394 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84871318-6f58-462d-8661-b8b4194e167f service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:23.797688 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84871318-6f58-462d-8661-b8b4194e167f service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:23.797959 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84871318-6f58-462d-8661-b8b4194e167f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:23.802135 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1024/2059] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:59:23.802940 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebea43-2a02-458c-aaee-9b082ab23756 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:23.804205 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-acebea43-2a02-458c-aaee-9b082ab23756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:23.815149 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84871318-6f58-462d-8661-b8b4194e167f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:23.816371 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebea43-2a02-458c-aaee-9b082ab23756 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:23.816726 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84871318-6f58-462d-8661-b8b4194e167f service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:23.821706 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77cd31-fcb5-4a90-8a13-49fe25225e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:23.822573 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77cd31-fcb5-4a90-8a13-49fe25225e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:23.822852 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77cd31-fcb5-4a90-8a13-49fe25225e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:23.823121 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77cd31-fcb5-4a90-8a13-49fe25225e9b admin admin] PATH_INFO: `/v3/users/f7050db935904c5e851384f033ecf4f3` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:23.824328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77cd31-fcb5-4a90-8a13-49fe25225e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7050db935904c5e851384f033ecf4f3)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:23.826318 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77cd31-fcb5-4a90-8a13-49fe25225e9b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:23.827891 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1036/2060] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:59:23.883540 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-2f77cd31-fcb5-4a90-8a13-49fe25225e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7050db935904c5e851384f033ecf4f3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:23.894072 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-2f77cd31-fcb5-4a90-8a13-49fe25225e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7050db935904c5e851384f033ecf4f3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:23.908111 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-2f77cd31-fcb5-4a90-8a13-49fe25225e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7050db935904c5e851384f033ecf4f3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:23.908879 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-2f77cd31-fcb5-4a90-8a13-49fe25225e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7050db935904c5e851384f033ecf4f3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:23.917967 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-2f77cd31-fcb5-4a90-8a13-49fe25225e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7050db935904c5e851384f033ecf4f3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:23.925571 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1025/2061] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:59:23 2022] DELETE /identity/v3/users/f7050db935904c5e851384f033ecf4f3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:24.127631 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84871318-6f58-462d-8661-b8b4194e167f service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:24.131079 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-84871318-6f58-462d-8661-b8b4194e167f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:24.150531 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84871318-6f58-462d-8661-b8b4194e167f service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:24.245492 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa21553-bff3-407c-a474-5d6009db8b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:24.246381 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa21553-bff3-407c-a474-5d6009db8b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:24.246647 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa21553-bff3-407c-a474-5d6009db8b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:24.249786 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa21553-bff3-407c-a474-5d6009db8b52 admin admin] PATH_INFO: `/v3/projects/6f0188575e2747459bdab4edb93b8756` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:24.251339 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa21553-bff3-407c-a474-5d6009db8b52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f0188575e2747459bdab4edb93b8756)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:24.251913 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77cd31-fcb5-4a90-8a13-49fe25225e9b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:24.253466 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa21553-bff3-407c-a474-5d6009db8b52 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:24.253810 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2f77cd31-fcb5-4a90-8a13-49fe25225e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:24.281765 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77cd31-fcb5-4a90-8a13-49fe25225e9b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:24.287289 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d03c00-a5cb-4fb7-bc85-422f528fb9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:24.288337 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d03c00-a5cb-4fb7-bc85-422f528fb9cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:24.288706 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d03c00-a5cb-4fb7-bc85-422f528fb9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:24.289085 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d03c00-a5cb-4fb7-bc85-422f528fb9cb admin admin] PATH_INFO: `/v3/projects/7170b914023c45a2b7ec39e85b8a681f` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:24.291046 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d03c00-a5cb-4fb7-bc85-422f528fb9cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7170b914023c45a2b7ec39e85b8a681f)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:24.293278 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d03c00-a5cb-4fb7-bc85-422f528fb9cb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:24.352932 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f5d03c00-a5cb-4fb7-bc85-422f528fb9cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7170b914023c45a2b7ec39e85b8a681f', 'request_id': 'req-f5d03c00-a5cb-4fb7-bc85-422f528fb9cb'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:24.354180 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-aaa21553-bff3-407c-a474-5d6009db8b52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f0188575e2747459bdab4edb93b8756', 'request_id': 'req-aaa21553-bff3-407c-a474-5d6009db8b52'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:24.359142 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f5d03c00-a5cb-4fb7-bc85-422f528fb9cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7170b914023c45a2b7ec39e85b8a681f', 'request_id': 'req-f5d03c00-a5cb-4fb7-bc85-422f528fb9cb'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:24.359543 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-aaa21553-bff3-407c-a474-5d6009db8b52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f0188575e2747459bdab4edb93b8756', 'request_id': 'req-aaa21553-bff3-407c-a474-5d6009db8b52'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:24.365482 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f5d03c00-a5cb-4fb7-bc85-422f528fb9cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7170b914023c45a2b7ec39e85b8a681f', 'request_id': 'req-f5d03c00-a5cb-4fb7-bc85-422f528fb9cb'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:24.365997 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-aaa21553-bff3-407c-a474-5d6009db8b52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f0188575e2747459bdab4edb93b8756', 'request_id': 'req-aaa21553-bff3-407c-a474-5d6009db8b52'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:24.379062 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f5d03c00-a5cb-4fb7-bc85-422f528fb9cb admin admin] The token cache is being invalidate because project 7170b914023c45a2b7ec39e85b8a681f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:59:24.379342 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f5d03c00-a5cb-4fb7-bc85-422f528fb9cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:24.380004 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f5d03c00-a5cb-4fb7-bc85-422f528fb9cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:24.381584 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1026/2062] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:59:24 2022] DELETE /identity/v3/projects/7170b914023c45a2b7ec39e85b8a681f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:59:24.382388 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d03c00-a5cb-4fb7-bc85-422f528fb9cb admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:24.382657 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-aaa21553-bff3-407c-a474-5d6009db8b52 admin admin] The token cache is being invalidate because project 6f0188575e2747459bdab4edb93b8756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:59:24.382950 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-aaa21553-bff3-407c-a474-5d6009db8b52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:24.383563 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-aaa21553-bff3-407c-a474-5d6009db8b52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:24.383918 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f5d03c00-a5cb-4fb7-bc85-422f528fb9cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:24.385383 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1037/2063] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:59:24 2022] DELETE /identity/v3/projects/6f0188575e2747459bdab4edb93b8756 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:24.389414 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa21553-bff3-407c-a474-5d6009db8b52 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:24.391072 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-aaa21553-bff3-407c-a474-5d6009db8b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:24.461297 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa21553-bff3-407c-a474-5d6009db8b52 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:24.461778 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d03c00-a5cb-4fb7-bc85-422f528fb9cb admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:24.466566 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0ba0c-f554-44ae-ba94-65c9d9a7a0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:24.467744 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0ba0c-f554-44ae-ba94-65c9d9a7a0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:24.468326 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0ba0c-f554-44ae-ba94-65c9d9a7a0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:24.468705 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0ba0c-f554-44ae-ba94-65c9d9a7a0ed admin admin] PATH_INFO: `/v3/users/65276b21615241dcb34e6c2897abadb2` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:24.470124 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0ba0c-f554-44ae-ba94-65c9d9a7a0ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=65276b21615241dcb34e6c2897abadb2)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:24.471329 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df34bb-e1a5-48e8-9d1c-16b79842c71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:24.472050 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0ba0c-f554-44ae-ba94-65c9d9a7a0ed admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:24.472194 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df34bb-e1a5-48e8-9d1c-16b79842c71d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:24.472463 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df34bb-e1a5-48e8-9d1c-16b79842c71d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:24.472723 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df34bb-e1a5-48e8-9d1c-16b79842c71d admin admin] PATH_INFO: `/v3/projects/1878c4d1eab14d0fa8661ca8892d214b` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:24.473947 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df34bb-e1a5-48e8-9d1c-16b79842c71d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1878c4d1eab14d0fa8661ca8892d214b)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:24.475810 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df34bb-e1a5-48e8-9d1c-16b79842c71d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:24.520609 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-94a0ba0c-f554-44ae-ba94-65c9d9a7a0ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65276b21615241dcb34e6c2897abadb2'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:24.521065 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-62df34bb-e1a5-48e8-9d1c-16b79842c71d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1878c4d1eab14d0fa8661ca8892d214b', 'request_id': 'req-62df34bb-e1a5-48e8-9d1c-16b79842c71d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:24.526575 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-62df34bb-e1a5-48e8-9d1c-16b79842c71d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1878c4d1eab14d0fa8661ca8892d214b', 'request_id': 'req-62df34bb-e1a5-48e8-9d1c-16b79842c71d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:24.528101 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-94a0ba0c-f554-44ae-ba94-65c9d9a7a0ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65276b21615241dcb34e6c2897abadb2'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:24.532810 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-62df34bb-e1a5-48e8-9d1c-16b79842c71d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1878c4d1eab14d0fa8661ca8892d214b', 'request_id': 'req-62df34bb-e1a5-48e8-9d1c-16b79842c71d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:24.541220 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-94a0ba0c-f554-44ae-ba94-65c9d9a7a0ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65276b21615241dcb34e6c2897abadb2'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:24.542182 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-94a0ba0c-f554-44ae-ba94-65c9d9a7a0ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65276b21615241dcb34e6c2897abadb2'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:24.543051 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-94a0ba0c-f554-44ae-ba94-65c9d9a7a0ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65276b21615241dcb34e6c2897abadb2'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:24.546600 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-62df34bb-e1a5-48e8-9d1c-16b79842c71d admin admin] The token cache is being invalidate because project 1878c4d1eab14d0fa8661ca8892d214b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:59:24.546932 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-62df34bb-e1a5-48e8-9d1c-16b79842c71d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:24.547583 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-62df34bb-e1a5-48e8-9d1c-16b79842c71d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:24.549699 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1027/2064] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:59:24 2022] DELETE /identity/v3/projects/1878c4d1eab14d0fa8661ca8892d214b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:24.550945 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94f11f-0646-4179-9643-657214a7e7eb None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:24.551220 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94f11f-0646-4179-9643-657214a7e7eb None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:24.551486 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94f11f-0646-4179-9643-657214a7e7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:24.562522 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1038/2065] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:59:24 2022] DELETE /identity/v3/users/65276b21615241dcb34e6c2897abadb2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:24.564038 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6df12d-bc04-4b7f-9d6c-5f34d992db77 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:24.565156 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6df12d-bc04-4b7f-9d6c-5f34d992db77 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:24.565621 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6df12d-bc04-4b7f-9d6c-5f34d992db77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:24.576069 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-6f94f11f-0646-4179-9643-657214a7e7eb None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:24.577346 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6f94f11f-0646-4179-9643-657214a7e7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:24.583063 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-1f6df12d-bc04-4b7f-9d6c-5f34d992db77 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:24.584232 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-1f6df12d-bc04-4b7f-9d6c-5f34d992db77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:24.638081 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1028/2066] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:24.644768 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1039/2067] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:24.650385 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2f9b4-8151-4bd0-a29a-c61dc390fb68 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:24.650660 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2f9b4-8151-4bd0-a29a-c61dc390fb68 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:24.650928 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2f9b4-8151-4bd0-a29a-c61dc390fb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:24.653472 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a6ab3-1e15-4e55-99e7-b57d054a3357 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:24.653801 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a6ab3-1e15-4e55-99e7-b57d054a3357 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:24.654101 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a6ab3-1e15-4e55-99e7-b57d054a3357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:24.669651 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-8dc2f9b4-8151-4bd0-a29a-c61dc390fb68 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:24.670894 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8dc2f9b4-8151-4bd0-a29a-c61dc390fb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:24.673282 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-c38a6ab3-1e15-4e55-99e7-b57d054a3357 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:24.674823 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-c38a6ab3-1e15-4e55-99e7-b57d054a3357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:24.685928 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1029/2069] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:59:24.686117 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1040/2069] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:59:24.686221 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2f9b4-8151-4bd0-a29a-c61dc390fb68 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:24.687813 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a6ab3-1e15-4e55-99e7-b57d054a3357 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:24.693332 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2f9b4-8151-4bd0-a29a-c61dc390fb68 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:24.696804 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a6ab3-1e15-4e55-99e7-b57d054a3357 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:24.698854 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db44723-061b-41f2-a8e6-a165f5a317e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:24.699802 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db44723-061b-41f2-a8e6-a165f5a317e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:24.700321 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db44723-061b-41f2-a8e6-a165f5a317e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:24.700829 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db44723-061b-41f2-a8e6-a165f5a317e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:24.701451 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5a756-37bc-4c08-ab56-8196e6740c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:24.702058 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db44723-061b-41f2-a8e6-a165f5a317e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:59:24.702165 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5a756-37bc-4c08-ab56-8196e6740c09 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:24.702366 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5a756-37bc-4c08-ab56-8196e6740c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:24.702632 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5a756-37bc-4c08-ab56-8196e6740c09 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:24.703031 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db44723-061b-41f2-a8e6-a165f5a317e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:24.703393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5a756-37bc-4c08-ab56-8196e6740c09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:59:24.703691 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5a756-37bc-4c08-ab56-8196e6740c09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:24.705234 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db44723-061b-41f2-a8e6-a165f5a317e0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:24.705393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5a756-37bc-4c08-ab56-8196e6740c09 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:24.719945 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1030/2070] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:59:24.725137 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1041/2071] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:59:24.729755 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5a756-37bc-4c08-ab56-8196e6740c09 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:24.730443 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db44723-061b-41f2-a8e6-a165f5a317e0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:24.743885 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5a756-37bc-4c08-ab56-8196e6740c09 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:24.747181 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db44723-061b-41f2-a8e6-a165f5a317e0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:24.749159 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f3006-2c49-42c5-ad04-17c432ea1bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:24.750008 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f3006-2c49-42c5-ad04-17c432ea1bfa admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:24.750366 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f3006-2c49-42c5-ad04-17c432ea1bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:24.750784 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f3006-2c49-42c5-ad04-17c432ea1bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:24.751656 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f3006-2c49-42c5-ad04-17c432ea1bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:24.752737 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfda4ad-2f64-4256-8a63-8276a23c8a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:24.753391 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfda4ad-2f64-4256-8a63-8276a23c8a33 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:24.753668 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfda4ad-2f64-4256-8a63-8276a23c8a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:24.753957 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfda4ad-2f64-4256-8a63-8276a23c8a33 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:24.754077 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f3006-2c49-42c5-ad04-17c432ea1bfa admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:24.754652 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfda4ad-2f64-4256-8a63-8276a23c8a33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:24.756912 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfda4ad-2f64-4256-8a63-8276a23c8a33 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:24.783004 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1042/2072] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:59:24 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:59:24.786675 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f3006-2c49-42c5-ad04-17c432ea1bfa admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:24.792578 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1031/2073] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:59:24 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:59:24.794107 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfda4ad-2f64-4256-8a63-8276a23c8a33 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:24.856846 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f3006-2c49-42c5-ad04-17c432ea1bfa admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:24.861941 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123da1c-6b82-4c5c-9ee6-020ada86b9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:24.862704 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123da1c-6b82-4c5c-9ee6-020ada86b9bd admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:24.862835 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfda4ad-2f64-4256-8a63-8276a23c8a33 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:24.862967 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123da1c-6b82-4c5c-9ee6-020ada86b9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:24.863163 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123da1c-6b82-4c5c-9ee6-020ada86b9bd admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:24.863864 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123da1c-6b82-4c5c-9ee6-020ada86b9bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:24.866373 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123da1c-6b82-4c5c-9ee6-020ada86b9bd admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:24.871961 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a4e76-49e0-4ac5-b188-014a3faa3c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:24.872849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a4e76-49e0-4ac5-b188-014a3faa3c97 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:24.873192 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a4e76-49e0-4ac5-b188-014a3faa3c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:24.873598 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a4e76-49e0-4ac5-b188-014a3faa3c97 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:24.874369 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a4e76-49e0-4ac5-b188-014a3faa3c97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:24.876460 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a4e76-49e0-4ac5-b188-014a3faa3c97 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:24.893080 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1043/2074] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:59:24 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:59:24.893080 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123da1c-6b82-4c5c-9ee6-020ada86b9bd admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:24.893080 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-9123da1c-6b82-4c5c-9ee6-020ada86b9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:24.899743 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1032/2075] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:59:24 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:59:24.903857 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a4e76-49e0-4ac5-b188-014a3faa3c97 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:24.905559 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123da1c-6b82-4c5c-9ee6-020ada86b9bd admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:24.910131 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552b3eb-5732-49fc-812c-e00c90886923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:24.910985 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552b3eb-5732-49fc-812c-e00c90886923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:24.911261 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552b3eb-5732-49fc-812c-e00c90886923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:24.911527 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552b3eb-5732-49fc-812c-e00c90886923 admin admin] PATH_INFO: `/v3/projects/b841618cda484b3ea88399a077336f91` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:24.912693 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552b3eb-5732-49fc-812c-e00c90886923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b841618cda484b3ea88399a077336f91)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:24.913721 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a4e76-49e0-4ac5-b188-014a3faa3c97 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:24.914623 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552b3eb-5732-49fc-812c-e00c90886923 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:24.918907 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8e75b-2c94-4289-8a17-9ec8dc02f1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:24.919631 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8e75b-2c94-4289-8a17-9ec8dc02f1bf admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:24.919981 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8e75b-2c94-4289-8a17-9ec8dc02f1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:24.920317 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8e75b-2c94-4289-8a17-9ec8dc02f1bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:24.921121 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8e75b-2c94-4289-8a17-9ec8dc02f1bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:24.923110 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8e75b-2c94-4289-8a17-9ec8dc02f1bf admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:24.933272 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1033/2076] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:24.934232 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8e75b-2c94-4289-8a17-9ec8dc02f1bf admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:24.943512 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8e75b-2c94-4289-8a17-9ec8dc02f1bf admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:24.948728 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e2489-3b86-46ce-ac78-f9c9ced91e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:24.949391 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e2489-3b86-46ce-ac78-f9c9ced91e94 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:24.949874 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e2489-3b86-46ce-ac78-f9c9ced91e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:24.949982 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e2489-3b86-46ce-ac78-f9c9ced91e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:24.950649 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e2489-3b86-46ce-ac78-f9c9ced91e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:24.952265 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e2489-3b86-46ce-ac78-f9c9ced91e94 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:24.962398 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1034/2077] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:24.963174 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e2489-3b86-46ce-ac78-f9c9ced91e94 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:24.970728 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0552b3eb-5732-49fc-812c-e00c90886923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b841618cda484b3ea88399a077336f91', 'request_id': 'req-0552b3eb-5732-49fc-812c-e00c90886923'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:24.972424 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e2489-3b86-46ce-ac78-f9c9ced91e94 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:24.978372 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0552b3eb-5732-49fc-812c-e00c90886923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b841618cda484b3ea88399a077336f91', 'request_id': 'req-0552b3eb-5732-49fc-812c-e00c90886923'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:24.986434 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0552b3eb-5732-49fc-812c-e00c90886923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b841618cda484b3ea88399a077336f91', 'request_id': 'req-0552b3eb-5732-49fc-812c-e00c90886923'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:25.000144 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0552b3eb-5732-49fc-812c-e00c90886923 admin admin] The token cache is being invalidate because project b841618cda484b3ea88399a077336f91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:59:25.000420 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0552b3eb-5732-49fc-812c-e00c90886923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:25.001042 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0552b3eb-5732-49fc-812c-e00c90886923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:25.002628 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1044/2078] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:59:24 2022] DELETE /identity/v3/projects/b841618cda484b3ea88399a077336f91 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:25.003368 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552b3eb-5732-49fc-812c-e00c90886923 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:25.004662 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-0552b3eb-5732-49fc-812c-e00c90886923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:25.028535 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38733714-fc4b-48a5-ad48-0bbd20a6b776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:25.029233 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38733714-fc4b-48a5-ad48-0bbd20a6b776 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:25.029575 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38733714-fc4b-48a5-ad48-0bbd20a6b776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:25.029844 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38733714-fc4b-48a5-ad48-0bbd20a6b776 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:25.030578 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38733714-fc4b-48a5-ad48-0bbd20a6b776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:25.032595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38733714-fc4b-48a5-ad48-0bbd20a6b776 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:25.042248 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1035/2079] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:25.043120 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38733714-fc4b-48a5-ad48-0bbd20a6b776 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:25.044755 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-38733714-fc4b-48a5-ad48-0bbd20a6b776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:25.057436 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38733714-fc4b-48a5-ad48-0bbd20a6b776 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:25.062552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e7630-04e3-4616-80ff-6c97de8288e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:25.063392 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e7630-04e3-4616-80ff-6c97de8288e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:25.063670 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e7630-04e3-4616-80ff-6c97de8288e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:25.063935 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e7630-04e3-4616-80ff-6c97de8288e2 admin admin] PATH_INFO: `/v3/users/7e0ba7b440854f578d9540e462faeb94` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:25.065119 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e7630-04e3-4616-80ff-6c97de8288e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e0ba7b440854f578d9540e462faeb94)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:25.066639 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552b3eb-5732-49fc-812c-e00c90886923 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:25.067044 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e7630-04e3-4616-80ff-6c97de8288e2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:25.071232 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978e350-73bb-4e44-982e-9d1bc3ef6873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:25.071907 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978e350-73bb-4e44-982e-9d1bc3ef6873 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:25.072204 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978e350-73bb-4e44-982e-9d1bc3ef6873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:25.072471 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978e350-73bb-4e44-982e-9d1bc3ef6873 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:25.073194 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978e350-73bb-4e44-982e-9d1bc3ef6873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:25.074815 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978e350-73bb-4e44-982e-9d1bc3ef6873 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:25.084495 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1045/2080] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:25.085255 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978e350-73bb-4e44-982e-9d1bc3ef6873 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:25.086874 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-7978e350-73bb-4e44-982e-9d1bc3ef6873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:25.099692 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978e350-73bb-4e44-982e-9d1bc3ef6873 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:25.104416 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa971ef-7bcc-4fc6-8956-25613540ac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:25.105272 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa971ef-7bcc-4fc6-8956-25613540ac03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:25.105635 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa971ef-7bcc-4fc6-8956-25613540ac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:25.105850 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa971ef-7bcc-4fc6-8956-25613540ac03 admin admin] PATH_INFO: `/v3/projects/027599574d6247a880c89d76edd9958a/users/1777d21da1ed4a3dbabb518172121e31/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:25.112969 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ec6e7630-04e3-4616-80ff-6c97de8288e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e0ba7b440854f578d9540e462faeb94'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:25.119491 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ec6e7630-04e3-4616-80ff-6c97de8288e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e0ba7b440854f578d9540e462faeb94'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:25.120747 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa971ef-7bcc-4fc6-8956-25613540ac03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=027599574d6247a880c89d76edd9958a, user_id=1777d21da1ed4a3dbabb518172121e31, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:25.123478 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa971ef-7bcc-4fc6-8956-25613540ac03 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:25.131071 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ec6e7630-04e3-4616-80ff-6c97de8288e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e0ba7b440854f578d9540e462faeb94'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:25.131811 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ec6e7630-04e3-4616-80ff-6c97de8288e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e0ba7b440854f578d9540e462faeb94'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:25.136821 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1046/2081] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:59:25 2022] PUT /identity/v3/projects/027599574d6247a880c89d76edd9958a/users/1777d21da1ed4a3dbabb518172121e31/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:25.137638 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa971ef-7bcc-4fc6-8956-25613540ac03 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:25.140823 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ec6e7630-04e3-4616-80ff-6c97de8288e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e0ba7b440854f578d9540e462faeb94'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:25.147178 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1036/2082] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:59:25 2022] DELETE /identity/v3/users/7e0ba7b440854f578d9540e462faeb94 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:25.148557 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac66c46-99ac-4c00-b9ec-8f28d7fa9366 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:25.148906 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac66c46-99ac-4c00-b9ec-8f28d7fa9366 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:25.149175 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac66c46-99ac-4c00-b9ec-8f28d7fa9366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:25.169542 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-4ac66c46-99ac-4c00-b9ec-8f28d7fa9366 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:25.170790 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4ac66c46-99ac-4c00-b9ec-8f28d7fa9366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:25.203783 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa971ef-7bcc-4fc6-8956-25613540ac03 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:25.234723 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1037/2083] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:25.251207 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac66c46-99ac-4c00-b9ec-8f28d7fa9366 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:25.252642 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4ac66c46-99ac-4c00-b9ec-8f28d7fa9366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:25.273423 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5abdd3-8c15-4d85-9b2f-9e201a4939e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:25.274319 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5abdd3-8c15-4d85-9b2f-9e201a4939e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:25.274598 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5abdd3-8c15-4d85-9b2f-9e201a4939e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:25.274865 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5abdd3-8c15-4d85-9b2f-9e201a4939e8 admin admin] PATH_INFO: `/v3/projects/451e16d242714e819ad21f87c3f8ffa1/users/be803bfe1b234cbe91ef67d3b998044f/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:25.290937 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5abdd3-8c15-4d85-9b2f-9e201a4939e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=451e16d242714e819ad21f87c3f8ffa1, user_id=be803bfe1b234cbe91ef67d3b998044f, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:25.293788 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5abdd3-8c15-4d85-9b2f-9e201a4939e8 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:25.309736 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1047/2084] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:59:25 2022] PUT /identity/v3/projects/451e16d242714e819ad21f87c3f8ffa1/users/be803bfe1b234cbe91ef67d3b998044f/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:25.310794 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5abdd3-8c15-4d85-9b2f-9e201a4939e8 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:25.312583 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-bb5abdd3-8c15-4d85-9b2f-9e201a4939e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:25.325774 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac66c46-99ac-4c00-b9ec-8f28d7fa9366 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:25.377361 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1893b9-5c6e-4528-8a29-d2acdb011408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:25.378050 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1893b9-5c6e-4528-8a29-d2acdb011408 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:25.378423 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1893b9-5c6e-4528-8a29-d2acdb011408 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:25.378607 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1893b9-5c6e-4528-8a29-d2acdb011408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:25.395949 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5abdd3-8c15-4d85-9b2f-9e201a4939e8 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:25.406654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f85dd2-c709-4e7f-b904-0d583800d54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:25.407543 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f85dd2-c709-4e7f-b904-0d583800d54d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:25.407818 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f85dd2-c709-4e7f-b904-0d583800d54d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:25.408442 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f85dd2-c709-4e7f-b904-0d583800d54d admin admin] PATH_INFO: `/v3/users/274bc82c1e1448eea969191f725b83a5` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:25.409817 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f85dd2-c709-4e7f-b904-0d583800d54d admin admin] RBAC: Authorizing `identity:delete_user(user_id=274bc82c1e1448eea969191f725b83a5)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:25.413383 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f85dd2-c709-4e7f-b904-0d583800d54d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:25.441372 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1893b9-5c6e-4528-8a29-d2acdb011408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:25.442892 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1893b9-5c6e-4528-8a29-d2acdb011408 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:25.453940 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1038/2085] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:59:25.455245 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c706c-038b-421f-9b56-91f55188a263 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:25.455536 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c706c-038b-421f-9b56-91f55188a263 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:25.455811 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c706c-038b-421f-9b56-91f55188a263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:25.469797 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-e1f85dd2-c709-4e7f-b904-0d583800d54d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '274bc82c1e1448eea969191f725b83a5'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:25.477273 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-e1f85dd2-c709-4e7f-b904-0d583800d54d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '274bc82c1e1448eea969191f725b83a5'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:25.485183 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-a79c706c-038b-421f-9b56-91f55188a263 None None] MFA Rules not processed for user `be803bfe1b234cbe91ef67d3b998044f`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:25.486448 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a79c706c-038b-421f-9b56-91f55188a263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:25.491238 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-e1f85dd2-c709-4e7f-b904-0d583800d54d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '274bc82c1e1448eea969191f725b83a5'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:25.491957 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-e1f85dd2-c709-4e7f-b904-0d583800d54d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '274bc82c1e1448eea969191f725b83a5'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:25.492577 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-e1f85dd2-c709-4e7f-b904-0d583800d54d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '274bc82c1e1448eea969191f725b83a5'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:25.511691 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1048/2086] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:59:25 2022] DELETE /identity/v3/users/274bc82c1e1448eea969191f725b83a5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:25.516502 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d426a75-d3f6-4dad-9242-69ecd0728a24 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:25.516793 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d426a75-d3f6-4dad-9242-69ecd0728a24 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:25.517071 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d426a75-d3f6-4dad-9242-69ecd0728a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:25.536243 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-2d426a75-d3f6-4dad-9242-69ecd0728a24 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:25.537133 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-2d426a75-d3f6-4dad-9242-69ecd0728a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:25.561529 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1039/2087] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:25.573208 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c706c-038b-421f-9b56-91f55188a263 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:25.575220 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a79c706c-038b-421f-9b56-91f55188a263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:25.611021 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1049/2088] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:25.621241 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d426a75-d3f6-4dad-9242-69ecd0728a24 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:25.622834 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-2d426a75-d3f6-4dad-9242-69ecd0728a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:25.638356 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d426a75-d3f6-4dad-9242-69ecd0728a24 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:25.641764 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c706c-038b-421f-9b56-91f55188a263 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:25.644061 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622a78b-acb4-4b04-96db-aee19a3c6e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:25.644925 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622a78b-acb4-4b04-96db-aee19a3c6e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:25.645369 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622a78b-acb4-4b04-96db-aee19a3c6e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:25.645729 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622a78b-acb4-4b04-96db-aee19a3c6e2d admin admin] PATH_INFO: `/v3/projects/3f18287f20384e6080dce0b930f347fa` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:25.646869 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622a78b-acb4-4b04-96db-aee19a3c6e2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f18287f20384e6080dce0b930f347fa)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:25.649324 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622a78b-acb4-4b04-96db-aee19a3c6e2d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:25.704494 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28fcd5-85cb-429b-9dae-3f004fc76d6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:25.705548 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28fcd5-85cb-429b-9dae-3f004fc76d6b service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:25.705548 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28fcd5-85cb-429b-9dae-3f004fc76d6b service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:25.705779 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28fcd5-85cb-429b-9dae-3f004fc76d6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:25.717224 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-4622a78b-acb4-4b04-96db-aee19a3c6e2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f18287f20384e6080dce0b930f347fa', 'request_id': 'req-4622a78b-acb4-4b04-96db-aee19a3c6e2d'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:25.723801 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-4622a78b-acb4-4b04-96db-aee19a3c6e2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f18287f20384e6080dce0b930f347fa', 'request_id': 'req-4622a78b-acb4-4b04-96db-aee19a3c6e2d'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:25.731327 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-4622a78b-acb4-4b04-96db-aee19a3c6e2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f18287f20384e6080dce0b930f347fa', 'request_id': 'req-4622a78b-acb4-4b04-96db-aee19a3c6e2d'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:25.746881 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-4622a78b-acb4-4b04-96db-aee19a3c6e2d admin admin] The token cache is being invalidate because project 3f18287f20384e6080dce0b930f347fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:59:25.747167 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-4622a78b-acb4-4b04-96db-aee19a3c6e2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:25.748332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-4622a78b-acb4-4b04-96db-aee19a3c6e2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:25.750418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1050/2089] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:59:25 2022] DELETE /identity/v3/projects/3f18287f20384e6080dce0b930f347fa => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:25.751417 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622a78b-acb4-4b04-96db-aee19a3c6e2d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:25.752827 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4622a78b-acb4-4b04-96db-aee19a3c6e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:25.768428 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28fcd5-85cb-429b-9dae-3f004fc76d6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:25.770191 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28fcd5-85cb-429b-9dae-3f004fc76d6b service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:25.782396 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1040/2090] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:59:25.784217 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd6543-b2e7-4388-9098-010644cc9848 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:25.784217 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd6543-b2e7-4388-9098-010644cc9848 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:25.784550 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd6543-b2e7-4388-9098-010644cc9848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:25.804357 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-aabd6543-b2e7-4388-9098-010644cc9848 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:25.805731 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-aabd6543-b2e7-4388-9098-010644cc9848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:25.852945 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622a78b-acb4-4b04-96db-aee19a3c6e2d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:25.862779 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e581e-d8ca-498e-8eeb-b01059eb7f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:25.863946 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e581e-d8ca-498e-8eeb-b01059eb7f11 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:25.864519 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e581e-d8ca-498e-8eeb-b01059eb7f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:25.864990 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e581e-d8ca-498e-8eeb-b01059eb7f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:25.868591 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-567e581e-d8ca-498e-8eeb-b01059eb7f11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:25.869180 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1041/2091] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:25.884911 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918d13e-0961-4c73-9d9b-ef3db0499e0d None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:25.885376 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918d13e-0961-4c73-9d9b-ef3db0499e0d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:25.886000 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918d13e-0961-4c73-9d9b-ef3db0499e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:25.888811 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e581e-d8ca-498e-8eeb-b01059eb7f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:25.891536 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e581e-d8ca-498e-8eeb-b01059eb7f11 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:25.908770 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1051/2092] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:59:25.926429 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7918d13e-0961-4c73-9d9b-ef3db0499e0d None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:25.929161 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7918d13e-0961-4c73-9d9b-ef3db0499e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:25.948376 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1042/2093] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:25.955119 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e581e-d8ca-498e-8eeb-b01059eb7f11 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:25.979617 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e581e-d8ca-498e-8eeb-b01059eb7f11 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:25.990615 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2718f9b-5117-43ad-8e16-e1aff03ea572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:25.992397 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2718f9b-5117-43ad-8e16-e1aff03ea572 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:25.993115 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2718f9b-5117-43ad-8e16-e1aff03ea572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:25.994104 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2718f9b-5117-43ad-8e16-e1aff03ea572 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:25.996008 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2718f9b-5117-43ad-8e16-e1aff03ea572 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:59:25.996815 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2718f9b-5117-43ad-8e16-e1aff03ea572 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:26.001911 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2718f9b-5117-43ad-8e16-e1aff03ea572 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:26.041471 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1052/2094] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 20:59:26.047544 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918d13e-0961-4c73-9d9b-ef3db0499e0d None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:26.073094 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918d13e-0961-4c73-9d9b-ef3db0499e0d None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:26.087976 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8785a-e681-49e4-9dc4-9993a81e08d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:26.090515 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8785a-e681-49e4-9dc4-9993a81e08d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:26.091504 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8785a-e681-49e4-9dc4-9993a81e08d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:26.092286 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8785a-e681-49e4-9dc4-9993a81e08d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:26.094531 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8785a-e681-49e4-9dc4-9993a81e08d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:26.101992 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8785a-e681-49e4-9dc4-9993a81e08d6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:26.152896 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1043/2095] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:59:26 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:59:26.157372 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2718f9b-5117-43ad-8e16-e1aff03ea572 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:26.172306 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2718f9b-5117-43ad-8e16-e1aff03ea572 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:26.237128 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8d718-be8e-4ba6-a71d-05af73ff3e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:26.237905 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8d718-be8e-4ba6-a71d-05af73ff3e3b admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:26.238222 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8d718-be8e-4ba6-a71d-05af73ff3e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:26.238449 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8d718-be8e-4ba6-a71d-05af73ff3e3b admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:26.239313 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8d718-be8e-4ba6-a71d-05af73ff3e3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:26.241490 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8d718-be8e-4ba6-a71d-05af73ff3e3b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:26.277105 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8785a-e681-49e4-9dc4-9993a81e08d6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:26.277327 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1053/2096] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:59:26 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:59:26.290460 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8785a-e681-49e4-9dc4-9993a81e08d6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:26.296462 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9823003-8fc1-4e45-b088-05f4e3944f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:26.299437 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9823003-8fc1-4e45-b088-05f4e3944f44 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:26.299845 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9823003-8fc1-4e45-b088-05f4e3944f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:26.300129 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9823003-8fc1-4e45-b088-05f4e3944f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:26.300898 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9823003-8fc1-4e45-b088-05f4e3944f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:26.303107 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9823003-8fc1-4e45-b088-05f4e3944f44 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:26.323184 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1044/2097] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:26.327073 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8d718-be8e-4ba6-a71d-05af73ff3e3b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:26.338126 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8d718-be8e-4ba6-a71d-05af73ff3e3b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:26.346264 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113be9e4-1899-4e35-8f91-72288fbdd00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:26.346948 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113be9e4-1899-4e35-8f91-72288fbdd00d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:26.347217 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113be9e4-1899-4e35-8f91-72288fbdd00d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:26.347548 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113be9e4-1899-4e35-8f91-72288fbdd00d admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:26.348890 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113be9e4-1899-4e35-8f91-72288fbdd00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:26.350553 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113be9e4-1899-4e35-8f91-72288fbdd00d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:26.361796 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1054/2098] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:26.366282 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9823003-8fc1-4e45-b088-05f4e3944f44 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:26.376965 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9823003-8fc1-4e45-b088-05f4e3944f44 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:26.381788 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381aaef-bef3-406b-915a-40357be873b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:26.382781 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381aaef-bef3-406b-915a-40357be873b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:26.383116 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381aaef-bef3-406b-915a-40357be873b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:26.383443 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381aaef-bef3-406b-915a-40357be873b5 admin admin] PATH_INFO: `/v3/projects/7a722ab7973b47ceb277cbaed4b9d0c4/users/a4bde47f0363442791f3bccb27d48e06/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:26.399413 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381aaef-bef3-406b-915a-40357be873b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a722ab7973b47ceb277cbaed4b9d0c4, user_id=a4bde47f0363442791f3bccb27d48e06, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:26.402103 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381aaef-bef3-406b-915a-40357be873b5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:26.423077 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1045/2099] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:59:26 2022] PUT /identity/v3/projects/7a722ab7973b47ceb277cbaed4b9d0c4/users/a4bde47f0363442791f3bccb27d48e06/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:59:26.434687 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba419e1-91a0-476a-a7af-d93550c2ad03 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:26.434972 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba419e1-91a0-476a-a7af-d93550c2ad03 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:26.435428 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba419e1-91a0-476a-a7af-d93550c2ad03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:26.466877 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-4ba419e1-91a0-476a-a7af-d93550c2ad03 None None] MFA Rules not processed for user `a4bde47f0363442791f3bccb27d48e06`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:26.468038 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4ba419e1-91a0-476a-a7af-d93550c2ad03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:26.536355 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1055/2100] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:26.542758 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381aaef-bef3-406b-915a-40357be873b5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:26.569869 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba419e1-91a0-476a-a7af-d93550c2ad03 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:26.571314 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4ba419e1-91a0-476a-a7af-d93550c2ad03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:26.633758 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381aaef-bef3-406b-915a-40357be873b5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:26.638783 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566188e-dfbd-43e9-a7df-ba4256e0fdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:26.639958 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566188e-dfbd-43e9-a7df-ba4256e0fdd3 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:26.640376 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566188e-dfbd-43e9-a7df-ba4256e0fdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:26.640907 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566188e-dfbd-43e9-a7df-ba4256e0fdd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:26.641760 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566188e-dfbd-43e9-a7df-ba4256e0fdd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:26.645264 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566188e-dfbd-43e9-a7df-ba4256e0fdd3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:26.646217 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba419e1-91a0-476a-a7af-d93550c2ad03 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:26.651108 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5784510-16cc-466c-82f6-a495e8f138f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:26.652129 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5784510-16cc-466c-82f6-a495e8f138f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:26.652417 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5784510-16cc-466c-82f6-a495e8f138f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:26.652675 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5784510-16cc-466c-82f6-a495e8f138f4 admin admin] PATH_INFO: `/v3/projects/e1be6b19d2b14a1e8ed3a589d1e794d3` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:26.653891 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5784510-16cc-466c-82f6-a495e8f138f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1be6b19d2b14a1e8ed3a589d1e794d3)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:26.655934 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5784510-16cc-466c-82f6-a495e8f138f4 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:26.681580 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1046/2101] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:59:26 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:59:26.682709 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566188e-dfbd-43e9-a7df-ba4256e0fdd3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:26.735206 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-e5784510-16cc-466c-82f6-a495e8f138f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1be6b19d2b14a1e8ed3a589d1e794d3', 'request_id': 'req-e5784510-16cc-466c-82f6-a495e8f138f4'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:26.744068 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-e5784510-16cc-466c-82f6-a495e8f138f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1be6b19d2b14a1e8ed3a589d1e794d3', 'request_id': 'req-e5784510-16cc-466c-82f6-a495e8f138f4'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:26.751951 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-e5784510-16cc-466c-82f6-a495e8f138f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1be6b19d2b14a1e8ed3a589d1e794d3', 'request_id': 'req-e5784510-16cc-466c-82f6-a495e8f138f4'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:26.772292 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566188e-dfbd-43e9-a7df-ba4256e0fdd3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:26.773545 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-e5784510-16cc-466c-82f6-a495e8f138f4 admin admin] The token cache is being invalidate because project e1be6b19d2b14a1e8ed3a589d1e794d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:59:26.773865 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-e5784510-16cc-466c-82f6-a495e8f138f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:26.774617 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-e5784510-16cc-466c-82f6-a495e8f138f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:26.776527 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1056/2102] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:59:26 2022] DELETE /identity/v3/projects/e1be6b19d2b14a1e8ed3a589d1e794d3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:59:26.778306 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcea52-9911-414b-97ca-edfee26ec8f7 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:26.778613 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcea52-9911-414b-97ca-edfee26ec8f7 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:26.778969 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcea52-9911-414b-97ca-edfee26ec8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:26.816519 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-f3dcea52-9911-414b-97ca-edfee26ec8f7 None None] MFA Rules not processed for user `1777d21da1ed4a3dbabb518172121e31`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:26.817934 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-f3dcea52-9911-414b-97ca-edfee26ec8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:26.841205 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f579f16-f821-4b3b-84b6-386350f8aef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:26.841917 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f579f16-f821-4b3b-84b6-386350f8aef3 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:26.842198 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f579f16-f821-4b3b-84b6-386350f8aef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:26.842469 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f579f16-f821-4b3b-84b6-386350f8aef3 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:26.843641 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f579f16-f821-4b3b-84b6-386350f8aef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:26.846420 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f579f16-f821-4b3b-84b6-386350f8aef3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:26.873973 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1047/2103] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:59:26 2022] POST /identity/v3/users => generated 298 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:59:26.875389 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b2099-b460-4a76-b91f-e7d0890fc9a2 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:26.875674 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b2099-b460-4a76-b91f-e7d0890fc9a2 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:26.875994 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b2099-b460-4a76-b91f-e7d0890fc9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:26.896751 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1057/2104] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:26.896751 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcea52-9911-414b-97ca-edfee26ec8f7 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:26.899047 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-f3dcea52-9911-414b-97ca-edfee26ec8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:26.899598 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ef5b2099-b460-4a76-b91f-e7d0890fc9a2 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:26.900759 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ef5b2099-b460-4a76-b91f-e7d0890fc9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:26.910856 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1048/2105] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:26.912361 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2311897-dc05-42df-a724-79e72f5c87f8 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:26.912638 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2311897-dc05-42df-a724-79e72f5c87f8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:26.913080 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2311897-dc05-42df-a724-79e72f5c87f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:26.914326 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcea52-9911-414b-97ca-edfee26ec8f7 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:26.919390 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a17f80-adf1-4aca-86e7-68705fdeda85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:26.920168 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a17f80-adf1-4aca-86e7-68705fdeda85 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:26.920537 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a17f80-adf1-4aca-86e7-68705fdeda85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:26.920939 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a17f80-adf1-4aca-86e7-68705fdeda85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:26.921849 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a17f80-adf1-4aca-86e7-68705fdeda85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:26.923914 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a17f80-adf1-4aca-86e7-68705fdeda85 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:26.930653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e2311897-dc05-42df-a724-79e72f5c87f8 None None] MFA Rules not processed for user `1777d21da1ed4a3dbabb518172121e31`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:26.931914 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e2311897-dc05-42df-a724-79e72f5c87f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:26.937677 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1058/2106] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:26.939124 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcf4e6-9c9d-4d0d-a1ca-49204b412d13 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:26.939411 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcf4e6-9c9d-4d0d-a1ca-49204b412d13 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:26.939508 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1049/2107] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:26.939685 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcf4e6-9c9d-4d0d-a1ca-49204b412d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:26.940228 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2311897-dc05-42df-a724-79e72f5c87f8 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:26.950595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2311897-dc05-42df-a724-79e72f5c87f8 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:26.955088 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd040acb-1774-435d-b5ba-2196dff0fe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:26.955958 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd040acb-1774-435d-b5ba-2196dff0fe5e admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:26.956229 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd040acb-1774-435d-b5ba-2196dff0fe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:26.956490 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd040acb-1774-435d-b5ba-2196dff0fe5e admin admin] PATH_INFO: `/v3/projects/d4a0171c7c0446a18ac8dc4c6d4b6d7a/users/18a8c449631e4eb79a6c2663144d1495/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:26.958099 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-bfbcf4e6-9c9d-4d0d-a1ca-49204b412d13 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:26.959286 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-bfbcf4e6-9c9d-4d0d-a1ca-49204b412d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:26.967472 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1059/2108] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:26.970900 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcf4e6-9c9d-4d0d-a1ca-49204b412d13 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:26.970900 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-bfbcf4e6-9c9d-4d0d-a1ca-49204b412d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:26.971100 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd040acb-1774-435d-b5ba-2196dff0fe5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a0171c7c0446a18ac8dc4c6d4b6d7a, user_id=18a8c449631e4eb79a6c2663144d1495, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:26.973560 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd040acb-1774-435d-b5ba-2196dff0fe5e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:26.986843 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1050/2109] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:59:26 2022] PUT /identity/v3/projects/d4a0171c7c0446a18ac8dc4c6d4b6d7a/users/18a8c449631e4eb79a6c2663144d1495/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:26.987804 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd040acb-1774-435d-b5ba-2196dff0fe5e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:27.039674 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcf4e6-9c9d-4d0d-a1ca-49204b412d13 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:27.045794 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd040acb-1774-435d-b5ba-2196dff0fe5e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:27.051231 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb7bad-2d93-43a4-bb4d-6c9915608814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:27.051891 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb7bad-2d93-43a4-bb4d-6c9915608814 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:27.052163 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb7bad-2d93-43a4-bb4d-6c9915608814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:27.052428 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb7bad-2d93-43a4-bb4d-6c9915608814 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:27.053181 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb7bad-2d93-43a4-bb4d-6c9915608814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:59:27.053506 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb7bad-2d93-43a4-bb4d-6c9915608814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:27.055145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb7bad-2d93-43a4-bb4d-6c9915608814 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:27.066146 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1051/2110] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:59:27.066927 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb7bad-2d93-43a4-bb4d-6c9915608814 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:27.075877 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb7bad-2d93-43a4-bb4d-6c9915608814 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:27.081609 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eada0be-d4d5-4e97-8e2c-f77a2a541cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:27.082352 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eada0be-d4d5-4e97-8e2c-f77a2a541cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:27.082613 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eada0be-d4d5-4e97-8e2c-f77a2a541cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:27.082866 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eada0be-d4d5-4e97-8e2c-f77a2a541cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:27.083593 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eada0be-d4d5-4e97-8e2c-f77a2a541cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:27.085156 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eada0be-d4d5-4e97-8e2c-f77a2a541cd4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:27.098252 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1052/2111] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:27.098252 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eada0be-d4d5-4e97-8e2c-f77a2a541cd4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:27.101726 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f228b07-c121-4d41-96ea-d59d28b7b36f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:27.102376 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f228b07-c121-4d41-96ea-d59d28b7b36f service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:27.102670 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f228b07-c121-4d41-96ea-d59d28b7b36f service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:27.102937 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f228b07-c121-4d41-96ea-d59d28b7b36f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:27.105230 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eada0be-d4d5-4e97-8e2c-f77a2a541cd4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:27.110011 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e7711-9c2f-49c9-afc9-48438004dc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:27.110728 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e7711-9c2f-49c9-afc9-48438004dc3b admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:27.111225 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e7711-9c2f-49c9-afc9-48438004dc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:27.111557 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e7711-9c2f-49c9-afc9-48438004dc3b admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:27.112312 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e7711-9c2f-49c9-afc9-48438004dc3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:27.114347 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e7711-9c2f-49c9-afc9-48438004dc3b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:27.143328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1053/2112] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:59:27 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:59:27.147394 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e7711-9c2f-49c9-afc9-48438004dc3b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:27.158031 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f228b07-c121-4d41-96ea-d59d28b7b36f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:27.159644 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f228b07-c121-4d41-96ea-d59d28b7b36f service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:27.168426 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1060/2113] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:59:27.169189 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f228b07-c121-4d41-96ea-d59d28b7b36f service nova] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:27.179404 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f228b07-c121-4d41-96ea-d59d28b7b36f service nova] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:27.209152 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e7711-9c2f-49c9-afc9-48438004dc3b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:27.215345 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a9c30-8568-4fd2-aa1c-cdd31fcafa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:27.216240 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a9c30-8568-4fd2-aa1c-cdd31fcafa98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:27.216887 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a9c30-8568-4fd2-aa1c-cdd31fcafa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:27.217164 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a9c30-8568-4fd2-aa1c-cdd31fcafa98 admin admin] PATH_INFO: `/v3/projects/d4a0171c7c0446a18ac8dc4c6d4b6d7a/users/18a8c449631e4eb79a6c2663144d1495/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:27.220233 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a9c30-8568-4fd2-aa1c-cdd31fcafa98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a0171c7c0446a18ac8dc4c6d4b6d7a, user_id=18a8c449631e4eb79a6c2663144d1495, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:27.223045 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a9c30-8568-4fd2-aa1c-cdd31fcafa98 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:27.234246 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1054/2114] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:59:27 2022] PUT /identity/v3/projects/d4a0171c7c0446a18ac8dc4c6d4b6d7a/users/18a8c449631e4eb79a6c2663144d1495/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:27.238219 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d499e4d-a2fd-4022-85d2-c653d88dcba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:27.238893 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d499e4d-a2fd-4022-85d2-c653d88dcba3 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:27.239176 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d499e4d-a2fd-4022-85d2-c653d88dcba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:27.239445 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d499e4d-a2fd-4022-85d2-c653d88dcba3 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:27.240136 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d499e4d-a2fd-4022-85d2-c653d88dcba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:27.242074 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d499e4d-a2fd-4022-85d2-c653d88dcba3 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:27.245579 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d057b-f78c-4e99-b0fa-52f1983774b3 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:27.245870 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d057b-f78c-4e99-b0fa-52f1983774b3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:27.246145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d057b-f78c-4e99-b0fa-52f1983774b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:27.265835 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1061/2115] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:59:27 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:59:27.269382 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d499e4d-a2fd-4022-85d2-c653d88dcba3 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:27.276818 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-9a1d057b-f78c-4e99-b0fa-52f1983774b3 None None] MFA Rules not processed for user `18a8c449631e4eb79a6c2663144d1495`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:27.278259 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9a1d057b-f78c-4e99-b0fa-52f1983774b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:27.279619 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d499e4d-a2fd-4022-85d2-c653d88dcba3 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:27.336884 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d191d-abcd-4be6-8ce3-725aa5038aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:27.337651 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d191d-abcd-4be6-8ce3-725aa5038aad admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:27.337932 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d191d-abcd-4be6-8ce3-725aa5038aad admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:27.338209 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d191d-abcd-4be6-8ce3-725aa5038aad admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:27.338997 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d191d-abcd-4be6-8ce3-725aa5038aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:27.340604 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d191d-abcd-4be6-8ce3-725aa5038aad admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:27.361379 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1062/2116] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:27.362602 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1055/2117] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:59:27.366815 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d191d-abcd-4be6-8ce3-725aa5038aad admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:27.376464 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d057b-f78c-4e99-b0fa-52f1983774b3 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:27.376464 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9a1d057b-f78c-4e99-b0fa-52f1983774b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:27.377309 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d191d-abcd-4be6-8ce3-725aa5038aad admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:27.382059 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0190241-0371-4a7d-89d6-b391551085f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:27.382883 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0190241-0371-4a7d-89d6-b391551085f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:27.383200 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0190241-0371-4a7d-89d6-b391551085f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:27.383475 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0190241-0371-4a7d-89d6-b391551085f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:27.384193 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0190241-0371-4a7d-89d6-b391551085f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:27.385841 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0190241-0371-4a7d-89d6-b391551085f6 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:27.399793 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1063/2118] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:27.400803 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0190241-0371-4a7d-89d6-b391551085f6 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:27.411610 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0190241-0371-4a7d-89d6-b391551085f6 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:27.416677 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e4428-0131-40c4-ac50-b4e1d5e7699a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:27.417618 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e4428-0131-40c4-ac50-b4e1d5e7699a admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:27.417900 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e4428-0131-40c4-ac50-b4e1d5e7699a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:27.418169 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e4428-0131-40c4-ac50-b4e1d5e7699a admin admin] PATH_INFO: `/v3/projects/b677a21a0a7f4095aba1e8271d85aa57/users/468e74b162cb4a3e9da8d584e9b6bc42/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:27.434598 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e4428-0131-40c4-ac50-b4e1d5e7699a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b677a21a0a7f4095aba1e8271d85aa57, user_id=468e74b162cb4a3e9da8d584e9b6bc42, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:27.437334 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e4428-0131-40c4-ac50-b4e1d5e7699a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:27.438435 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d057b-f78c-4e99-b0fa-52f1983774b3 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:27.442635 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa8129-246a-4e39-b8ab-74acc905981e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:27.443320 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa8129-246a-4e39-b8ab-74acc905981e service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:27.443603 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa8129-246a-4e39-b8ab-74acc905981e service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:27.443922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa8129-246a-4e39-b8ab-74acc905981e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:27.455821 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa8129-246a-4e39-b8ab-74acc905981e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:27.457684 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa8129-246a-4e39-b8ab-74acc905981e service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:27.468136 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1056/2119] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:59:27.469956 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1064/2120] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:59:27 2022] PUT /identity/v3/projects/b677a21a0a7f4095aba1e8271d85aa57/users/468e74b162cb4a3e9da8d584e9b6bc42/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:59:27.474784 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085609f6-051b-4b07-b5b6-f8dfbacc5c9c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:27.475077 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085609f6-051b-4b07-b5b6-f8dfbacc5c9c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:27.475353 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085609f6-051b-4b07-b5b6-f8dfbacc5c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:27.499974 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-085609f6-051b-4b07-b5b6-f8dfbacc5c9c None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:27.501762 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-085609f6-051b-4b07-b5b6-f8dfbacc5c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:27.577764 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1057/2121] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:59:27.585848 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e4428-0131-40c4-ac50-b4e1d5e7699a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:27.587811 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-5f0e4428-0131-40c4-ac50-b4e1d5e7699a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:27.591025 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085609f6-051b-4b07-b5b6-f8dfbacc5c9c None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:27.592601 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-085609f6-051b-4b07-b5b6-f8dfbacc5c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:27.646804 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e4428-0131-40c4-ac50-b4e1d5e7699a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:27.650462 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb17d4-1fca-41d7-ac44-1187e21ae2e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:27.651141 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb17d4-1fca-41d7-ac44-1187e21ae2e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:27.651444 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb17d4-1fca-41d7-ac44-1187e21ae2e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:27.651723 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb17d4-1fca-41d7-ac44-1187e21ae2e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:27.658966 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085609f6-051b-4b07-b5b6-f8dfbacc5c9c None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:27.661177 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb17d4-1fca-41d7-ac44-1187e21ae2e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:27.662635 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb17d4-1fca-41d7-ac44-1187e21ae2e4 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:27.663058 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941e581-e358-48df-a139-6a01791d2140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:27.663743 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941e581-e358-48df-a139-6a01791d2140 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:27.664137 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941e581-e358-48df-a139-6a01791d2140 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:27.664410 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941e581-e358-48df-a139-6a01791d2140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:27.666254 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5941e581-e358-48df-a139-6a01791d2140 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:27.672533 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1065/2122] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:59:27.732416 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941e581-e358-48df-a139-6a01791d2140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:27.734299 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941e581-e358-48df-a139-6a01791d2140 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:27.745313 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1058/2123] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:59:31.678080 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb17d4-1fca-41d7-ac44-1187e21ae2e4 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:31.693641 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb17d4-1fca-41d7-ac44-1187e21ae2e4 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:31.702667 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c03c56-895e-4321-ba61-08c5ee820712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:31.704343 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c03c56-895e-4321-ba61-08c5ee820712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:31.704799 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c03c56-895e-4321-ba61-08c5ee820712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:31.705078 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c03c56-895e-4321-ba61-08c5ee820712 admin admin] PATH_INFO: `/v3/users/a4bde47f0363442791f3bccb27d48e06` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:31.714171 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c03c56-895e-4321-ba61-08c5ee820712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4bde47f0363442791f3bccb27d48e06)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:31.716474 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c03c56-895e-4321-ba61-08c5ee820712 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:31.823325 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-90c03c56-895e-4321-ba61-08c5ee820712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4bde47f0363442791f3bccb27d48e06'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:31.836262 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-90c03c56-895e-4321-ba61-08c5ee820712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4bde47f0363442791f3bccb27d48e06'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:31.868840 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-90c03c56-895e-4321-ba61-08c5ee820712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4bde47f0363442791f3bccb27d48e06'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:31.869717 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-90c03c56-895e-4321-ba61-08c5ee820712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4bde47f0363442791f3bccb27d48e06'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:31.871986 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-90c03c56-895e-4321-ba61-08c5ee820712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4bde47f0363442791f3bccb27d48e06'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:31.895947 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1066/2124] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:59:31 2022] DELETE /identity/v3/users/a4bde47f0363442791f3bccb27d48e06 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:31.904864 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bba4a6-f084-4569-b47c-8e295e44c6e8 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:31.904864 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bba4a6-f084-4569-b47c-8e295e44c6e8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:31.904864 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bba4a6-f084-4569-b47c-8e295e44c6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:31.917544 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-95bba4a6-f084-4569-b47c-8e295e44c6e8 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:31.918847 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-95bba4a6-f084-4569-b47c-8e295e44c6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:31.999039 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1059/2125] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:32.020590 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c03c56-895e-4321-ba61-08c5ee820712 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:32.022259 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-90c03c56-895e-4321-ba61-08c5ee820712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:32.111546 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c03c56-895e-4321-ba61-08c5ee820712 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:32.117243 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a7bfe-a306-4d22-b5e2-c7656e3e6303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:32.118025 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a7bfe-a306-4d22-b5e2-c7656e3e6303 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:32.118301 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a7bfe-a306-4d22-b5e2-c7656e3e6303 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:32.118715 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a7bfe-a306-4d22-b5e2-c7656e3e6303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:32.134649 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a7bfe-a306-4d22-b5e2-c7656e3e6303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:32.136094 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a7bfe-a306-4d22-b5e2-c7656e3e6303 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:32.150044 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1067/2126] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:59:32.543675 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bba4a6-f084-4569-b47c-8e295e44c6e8 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:32.545089 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-95bba4a6-f084-4569-b47c-8e295e44c6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:32.575097 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bba4a6-f084-4569-b47c-8e295e44c6e8 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:32.588218 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fec19b-64f4-4298-a1f5-4e0cd4da82b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:32.589110 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fec19b-64f4-4298-a1f5-4e0cd4da82b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:32.589435 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fec19b-64f4-4298-a1f5-4e0cd4da82b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:32.591128 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fec19b-64f4-4298-a1f5-4e0cd4da82b3 admin admin] PATH_INFO: `/v3/projects/7a722ab7973b47ceb277cbaed4b9d0c4` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:32.593387 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fec19b-64f4-4298-a1f5-4e0cd4da82b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a722ab7973b47ceb277cbaed4b9d0c4)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:32.596570 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fec19b-64f4-4298-a1f5-4e0cd4da82b3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:32.670243 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-21fec19b-64f4-4298-a1f5-4e0cd4da82b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a722ab7973b47ceb277cbaed4b9d0c4', 'request_id': 'req-21fec19b-64f4-4298-a1f5-4e0cd4da82b3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:32.677234 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-21fec19b-64f4-4298-a1f5-4e0cd4da82b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a722ab7973b47ceb277cbaed4b9d0c4', 'request_id': 'req-21fec19b-64f4-4298-a1f5-4e0cd4da82b3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:32.718189 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-21fec19b-64f4-4298-a1f5-4e0cd4da82b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a722ab7973b47ceb277cbaed4b9d0c4', 'request_id': 'req-21fec19b-64f4-4298-a1f5-4e0cd4da82b3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:32.733744 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-21fec19b-64f4-4298-a1f5-4e0cd4da82b3 admin admin] The token cache is being invalidate because project 7a722ab7973b47ceb277cbaed4b9d0c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:59:32.734346 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-21fec19b-64f4-4298-a1f5-4e0cd4da82b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:32.736253 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-21fec19b-64f4-4298-a1f5-4e0cd4da82b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:32.737997 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1060/2127] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:59:32 2022] DELETE /identity/v3/projects/7a722ab7973b47ceb277cbaed4b9d0c4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:59:32.742286 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a7bfe-a306-4d22-b5e2-c7656e3e6303 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:32.755558 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a7bfe-a306-4d22-b5e2-c7656e3e6303 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:32.846359 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edbfee-2118-40c8-b74d-9b7265c8624b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:32.847530 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edbfee-2118-40c8-b74d-9b7265c8624b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:32.847961 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edbfee-2118-40c8-b74d-9b7265c8624b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:32.848395 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edbfee-2118-40c8-b74d-9b7265c8624b admin admin] PATH_INFO: `/v3/users/18a8c449631e4eb79a6c2663144d1495` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:32.849921 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edbfee-2118-40c8-b74d-9b7265c8624b admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a8c449631e4eb79a6c2663144d1495)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:32.852276 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edbfee-2118-40c8-b74d-9b7265c8624b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:32.975589 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-20edbfee-2118-40c8-b74d-9b7265c8624b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a8c449631e4eb79a6c2663144d1495'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:32.988783 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-20edbfee-2118-40c8-b74d-9b7265c8624b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a8c449631e4eb79a6c2663144d1495'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:33.010009 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-20edbfee-2118-40c8-b74d-9b7265c8624b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a8c449631e4eb79a6c2663144d1495'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:33.011011 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-20edbfee-2118-40c8-b74d-9b7265c8624b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a8c449631e4eb79a6c2663144d1495'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:33.014154 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-20edbfee-2118-40c8-b74d-9b7265c8624b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a8c449631e4eb79a6c2663144d1495'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:33.058604 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1068/2128] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:59:32 2022] DELETE /identity/v3/users/18a8c449631e4eb79a6c2663144d1495 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:33.369665 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42967490-a565-40d1-9159-ba60ac9a8174 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:33.370994 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42967490-a565-40d1-9159-ba60ac9a8174 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:33.371381 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42967490-a565-40d1-9159-ba60ac9a8174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:33.434257 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-42967490-a565-40d1-9159-ba60ac9a8174 None None] MFA Rules not processed for user `468e74b162cb4a3e9da8d584e9b6bc42`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:33.435549 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-42967490-a565-40d1-9159-ba60ac9a8174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:33.594764 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1061/2129] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:33.595913 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edbfee-2118-40c8-b74d-9b7265c8624b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:33.597452 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-20edbfee-2118-40c8-b74d-9b7265c8624b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:33.704123 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42967490-a565-40d1-9159-ba60ac9a8174 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:33.706389 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edbfee-2118-40c8-b74d-9b7265c8624b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:33.706527 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-42967490-a565-40d1-9159-ba60ac9a8174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:33.711632 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19a196-15e7-4a1c-a779-f7dcd60115b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:33.712368 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19a196-15e7-4a1c-a779-f7dcd60115b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:33.712797 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19a196-15e7-4a1c-a779-f7dcd60115b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:33.713074 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19a196-15e7-4a1c-a779-f7dcd60115b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:33.713866 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19a196-15e7-4a1c-a779-f7dcd60115b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:33.717560 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19a196-15e7-4a1c-a779-f7dcd60115b7 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:33.731720 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42967490-a565-40d1-9159-ba60ac9a8174 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:33.732287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06270196-3cc8-454e-85d2-c4396cde3985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:33.733654 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06270196-3cc8-454e-85d2-c4396cde3985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:33.734036 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06270196-3cc8-454e-85d2-c4396cde3985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:33.738848 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06270196-3cc8-454e-85d2-c4396cde3985 admin admin] PATH_INFO: `/v3/projects/d4a0171c7c0446a18ac8dc4c6d4b6d7a` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:33.740349 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06270196-3cc8-454e-85d2-c4396cde3985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4a0171c7c0446a18ac8dc4c6d4b6d7a)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:33.743200 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06270196-3cc8-454e-85d2-c4396cde3985 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:33.768348 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1069/2130] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:59:33 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:59:33.772385 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19a196-15e7-4a1c-a779-f7dcd60115b7 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:33.815849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-06270196-3cc8-454e-85d2-c4396cde3985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4a0171c7c0446a18ac8dc4c6d4b6d7a', 'request_id': 'req-06270196-3cc8-454e-85d2-c4396cde3985'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:33.821693 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-06270196-3cc8-454e-85d2-c4396cde3985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4a0171c7c0446a18ac8dc4c6d4b6d7a', 'request_id': 'req-06270196-3cc8-454e-85d2-c4396cde3985'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:33.831291 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-06270196-3cc8-454e-85d2-c4396cde3985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4a0171c7c0446a18ac8dc4c6d4b6d7a', 'request_id': 'req-06270196-3cc8-454e-85d2-c4396cde3985'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:33.846069 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-06270196-3cc8-454e-85d2-c4396cde3985 admin admin] The token cache is being invalidate because project d4a0171c7c0446a18ac8dc4c6d4b6d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:59:33.846330 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-06270196-3cc8-454e-85d2-c4396cde3985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:33.846990 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-06270196-3cc8-454e-85d2-c4396cde3985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:33.847496 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19a196-15e7-4a1c-a779-f7dcd60115b7 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:33.848749 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1062/2131] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:59:33 2022] DELETE /identity/v3/projects/d4a0171c7c0446a18ac8dc4c6d4b6d7a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:59:33.853320 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06a435-6cce-421e-9471-161e30b801e5 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:33.855465 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06a435-6cce-421e-9471-161e30b801e5 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:33.855767 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06a435-6cce-421e-9471-161e30b801e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:33.876752 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ed06a435-6cce-421e-9471-161e30b801e5 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:33.878143 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ed06a435-6cce-421e-9471-161e30b801e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:33.927012 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b16d17-672e-4510-893e-dc2d0440a766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:33.927815 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b16d17-672e-4510-893e-dc2d0440a766 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:33.928166 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b16d17-672e-4510-893e-dc2d0440a766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:33.928496 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b16d17-672e-4510-893e-dc2d0440a766 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:33.929209 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b16d17-672e-4510-893e-dc2d0440a766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:33.931187 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b16d17-672e-4510-893e-dc2d0440a766 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:33.954728 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1063/2132] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:59:33.957069 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1070/2133] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:59:33 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:59:33.961281 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06a435-6cce-421e-9471-161e30b801e5 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:33.963448 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d992fe-99bf-479e-a83e-1a039b55c11a None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:33.963738 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d992fe-99bf-479e-a83e-1a039b55c11a None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:33.964013 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d992fe-99bf-479e-a83e-1a039b55c11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:33.966058 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ed06a435-6cce-421e-9471-161e30b801e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:33.982087 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06a435-6cce-421e-9471-161e30b801e5 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:33.987581 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77e8d3-743d-4a1f-a9fb-58315639a47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:33.988262 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77e8d3-743d-4a1f-a9fb-58315639a47e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:33.988700 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77e8d3-743d-4a1f-a9fb-58315639a47e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:33.988985 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77e8d3-743d-4a1f-a9fb-58315639a47e admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:33.990042 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77e8d3-743d-4a1f-a9fb-58315639a47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:33.990866 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-46d992fe-99bf-479e-a83e-1a039b55c11a None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:33.991796 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77e8d3-743d-4a1f-a9fb-58315639a47e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:33.992078 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-46d992fe-99bf-479e-a83e-1a039b55c11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:34.006344 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1071/2134] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:59:34.007408 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d992fe-99bf-479e-a83e-1a039b55c11a None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:34.011947 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1064/2135] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:34.015725 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77e8d3-743d-4a1f-a9fb-58315639a47e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:34.021496 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d992fe-99bf-479e-a83e-1a039b55c11a None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:34.028980 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa8e61-ad54-4380-a02a-3dd0ed5a29a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:34.029746 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa8e61-ad54-4380-a02a-3dd0ed5a29a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:34.030019 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa8e61-ad54-4380-a02a-3dd0ed5a29a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:34.030118 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77e8d3-743d-4a1f-a9fb-58315639a47e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:34.030283 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa8e61-ad54-4380-a02a-3dd0ed5a29a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:34.031022 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa8e61-ad54-4380-a02a-3dd0ed5a29a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:59:34.031323 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa8e61-ad54-4380-a02a-3dd0ed5a29a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:34.032904 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa8e61-ad54-4380-a02a-3dd0ed5a29a3 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:34.035157 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec9dea-23a9-434e-8e58-9b126374b20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:34.036046 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec9dea-23a9-434e-8e58-9b126374b20f admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:34.036328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec9dea-23a9-434e-8e58-9b126374b20f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:34.036614 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec9dea-23a9-434e-8e58-9b126374b20f admin admin] PATH_INFO: `/v3/projects/ff702952346a4efeaaef4923efac3ca7/users/d5ffdb5701ac4b5284c9f9889b00b307/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:34.051020 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1072/2136] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:59:34.051897 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa8e61-ad54-4380-a02a-3dd0ed5a29a3 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:34.053494 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec9dea-23a9-434e-8e58-9b126374b20f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff702952346a4efeaaef4923efac3ca7, user_id=d5ffdb5701ac4b5284c9f9889b00b307, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:34.056327 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec9dea-23a9-434e-8e58-9b126374b20f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:34.062827 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa8e61-ad54-4380-a02a-3dd0ed5a29a3 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:34.070231 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac2221-b441-4788-9468-37c75ecb4fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:34.070940 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac2221-b441-4788-9468-37c75ecb4fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:34.071224 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac2221-b441-4788-9468-37c75ecb4fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:34.071498 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac2221-b441-4788-9468-37c75ecb4fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:34.072232 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac2221-b441-4788-9468-37c75ecb4fa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:34.072859 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1065/2137] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:59:34 2022] PUT /identity/v3/projects/ff702952346a4efeaaef4923efac3ca7/users/d5ffdb5701ac4b5284c9f9889b00b307/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:34.074170 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac2221-b441-4788-9468-37c75ecb4fa7 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:34.076660 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec9dea-23a9-434e-8e58-9b126374b20f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:34.104660 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1073/2138] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:59:34 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:59:34.108819 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac2221-b441-4788-9468-37c75ecb4fa7 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:34.157396 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec9dea-23a9-434e-8e58-9b126374b20f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:34.197316 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac2221-b441-4788-9468-37c75ecb4fa7 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:34.202633 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8f44b-2458-4f95-bd9a-652b3819cfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:34.203319 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8f44b-2458-4f95-bd9a-652b3819cfdb admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:34.203605 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8f44b-2458-4f95-bd9a-652b3819cfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:34.203877 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8f44b-2458-4f95-bd9a-652b3819cfdb admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:34.204675 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8f44b-2458-4f95-bd9a-652b3819cfdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:34.206635 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8f44b-2458-4f95-bd9a-652b3819cfdb admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:34.228403 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1aa040-fb05-4286-a12e-e638163a16c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:34.229121 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1aa040-fb05-4286-a12e-e638163a16c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:34.229495 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1aa040-fb05-4286-a12e-e638163a16c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:34.229768 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1aa040-fb05-4286-a12e-e638163a16c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:34.230796 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1074/2139] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:59:34 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:59:34.234467 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1aa040-fb05-4286-a12e-e638163a16c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:34.235708 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8f44b-2458-4f95-bd9a-652b3819cfdb admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:34.236429 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1aa040-fb05-4286-a12e-e638163a16c9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:34.249855 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8f44b-2458-4f95-bd9a-652b3819cfdb admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:34.256621 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80f87b-eda3-4a78-b714-6ca1362aaf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:34.257246 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80f87b-eda3-4a78-b714-6ca1362aaf2b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:34.257577 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80f87b-eda3-4a78-b714-6ca1362aaf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:34.257996 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80f87b-eda3-4a78-b714-6ca1362aaf2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:34.258750 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80f87b-eda3-4a78-b714-6ca1362aaf2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:34.260420 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80f87b-eda3-4a78-b714-6ca1362aaf2b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:34.272435 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1066/2140] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 20:59:34.273414 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1075/2141] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:34.273552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1aa040-fb05-4286-a12e-e638163a16c9 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:34.276706 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80f87b-eda3-4a78-b714-6ca1362aaf2b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:34.294028 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1aa040-fb05-4286-a12e-e638163a16c9 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:34.296603 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80f87b-eda3-4a78-b714-6ca1362aaf2b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:34.304196 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fff1ec-daf9-4fe6-ae59-a0ef92ccdcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:34.304870 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fff1ec-daf9-4fe6-ae59-a0ef92ccdcd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:34.305146 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fff1ec-daf9-4fe6-ae59-a0ef92ccdcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:34.305455 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fff1ec-daf9-4fe6-ae59-a0ef92ccdcd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:34.306853 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fff1ec-daf9-4fe6-ae59-a0ef92ccdcd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:34.310782 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c34337-4085-4d8a-bc00-1c855ad6b93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:34.311679 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c34337-4085-4d8a-bc00-1c855ad6b93b admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:34.311952 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c34337-4085-4d8a-bc00-1c855ad6b93b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:34.312217 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c34337-4085-4d8a-bc00-1c855ad6b93b admin admin] PATH_INFO: `/v3/projects/ff702952346a4efeaaef4923efac3ca7/users/d5ffdb5701ac4b5284c9f9889b00b307/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:34.313148 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fff1ec-daf9-4fe6-ae59-a0ef92ccdcd6 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:34.314611 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c34337-4085-4d8a-bc00-1c855ad6b93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff702952346a4efeaaef4923efac3ca7, user_id=d5ffdb5701ac4b5284c9f9889b00b307, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:34.317498 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c34337-4085-4d8a-bc00-1c855ad6b93b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:34.328661 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1067/2142] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:59:34 2022] PUT /identity/v3/projects/ff702952346a4efeaaef4923efac3ca7/users/d5ffdb5701ac4b5284c9f9889b00b307/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:59:34.345778 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1076/2143] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:34.350860 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c34337-4085-4d8a-bc00-1c855ad6b93b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:34.456537 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c34337-4085-4d8a-bc00-1c855ad6b93b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:34.463135 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322697f-6c1a-48f1-8512-6ec0c556057f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:34.464053 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322697f-6c1a-48f1-8512-6ec0c556057f admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:34.464668 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322697f-6c1a-48f1-8512-6ec0c556057f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:34.464788 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322697f-6c1a-48f1-8512-6ec0c556057f admin admin] PATH_INFO: `/v3/projects/40e8f997d04b4594969df2485fe38c68/users/16051286c33e4870aec5fb7218bec04f/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:34.483189 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322697f-6c1a-48f1-8512-6ec0c556057f admin admin] RBAC: Authorizing `identity:create_grant(project_id=40e8f997d04b4594969df2485fe38c68, user_id=16051286c33e4870aec5fb7218bec04f, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:34.486307 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322697f-6c1a-48f1-8512-6ec0c556057f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:34.544317 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1068/2144] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:59:34 2022] PUT /identity/v3/projects/40e8f997d04b4594969df2485fe38c68/users/16051286c33e4870aec5fb7218bec04f/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:34.546191 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a52e9d-2a4e-479f-900a-988ebcf5af23 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:34.546431 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a52e9d-2a4e-479f-900a-988ebcf5af23 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:34.546705 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a52e9d-2a4e-479f-900a-988ebcf5af23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:34.584372 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322697f-6c1a-48f1-8512-6ec0c556057f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:34.586737 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7322697f-6c1a-48f1-8512-6ec0c556057f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:34.597233 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-70a52e9d-2a4e-479f-900a-988ebcf5af23 None None] MFA Rules not processed for user `16051286c33e4870aec5fb7218bec04f`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:34.598725 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-70a52e9d-2a4e-479f-900a-988ebcf5af23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:34.709430 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322697f-6c1a-48f1-8512-6ec0c556057f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:34.717064 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d912b5-f2b7-4021-87bb-b0871997b1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:34.718149 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d912b5-f2b7-4021-87bb-b0871997b1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:34.718462 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d912b5-f2b7-4021-87bb-b0871997b1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:34.718764 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d912b5-f2b7-4021-87bb-b0871997b1ad admin admin] PATH_INFO: `/v3/users/e204e83dc0804748a974a92949581e5e` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:34.720417 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d912b5-f2b7-4021-87bb-b0871997b1ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=e204e83dc0804748a974a92949581e5e)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:34.723452 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d912b5-f2b7-4021-87bb-b0871997b1ad admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:34.728639 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1077/2145] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:34.738271 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a52e9d-2a4e-479f-900a-988ebcf5af23 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:34.762780 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a52e9d-2a4e-479f-900a-988ebcf5af23 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:34.768274 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bc7b2-6c30-4fa7-8ac8-5511d6f85a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:34.769195 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bc7b2-6c30-4fa7-8ac8-5511d6f85a01 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:34.769838 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bc7b2-6c30-4fa7-8ac8-5511d6f85a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:34.769838 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bc7b2-6c30-4fa7-8ac8-5511d6f85a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:34.770728 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bc7b2-6c30-4fa7-8ac8-5511d6f85a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:34.772723 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bc7b2-6c30-4fa7-8ac8-5511d6f85a01 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:34.802855 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d8d912b5-f2b7-4021-87bb-b0871997b1ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e204e83dc0804748a974a92949581e5e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:34.816366 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d8d912b5-f2b7-4021-87bb-b0871997b1ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e204e83dc0804748a974a92949581e5e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:34.821726 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1078/2146] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:59:34 2022] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:59:34.826900 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bc7b2-6c30-4fa7-8ac8-5511d6f85a01 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:34.844573 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d8d912b5-f2b7-4021-87bb-b0871997b1ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e204e83dc0804748a974a92949581e5e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:34.847701 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d8d912b5-f2b7-4021-87bb-b0871997b1ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e204e83dc0804748a974a92949581e5e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:34.864150 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d8d912b5-f2b7-4021-87bb-b0871997b1ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e204e83dc0804748a974a92949581e5e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:34.873632 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1069/2147] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:59:34 2022] DELETE /identity/v3/users/e204e83dc0804748a974a92949581e5e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:34.879222 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0f34d-706c-424e-b340-508cf42863c7 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:34.879572 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0f34d-706c-424e-b340-508cf42863c7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:34.879936 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0f34d-706c-424e-b340-508cf42863c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:34.921584 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-80a0f34d-706c-424e-b340-508cf42863c7 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:34.926336 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-80a0f34d-706c-424e-b340-508cf42863c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:35.002338 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bc7b2-6c30-4fa7-8ac8-5511d6f85a01 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:35.082328 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d7961-58c0-4d94-b774-5bf2bcbe6976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:35.083116 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d7961-58c0-4d94-b774-5bf2bcbe6976 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:35.083329 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d7961-58c0-4d94-b774-5bf2bcbe6976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:35.083554 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d7961-58c0-4d94-b774-5bf2bcbe6976 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:35.084262 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d7961-58c0-4d94-b774-5bf2bcbe6976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:35.086316 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d7961-58c0-4d94-b774-5bf2bcbe6976 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:35.131899 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1079/2148] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:59:34 2022] POST /identity/v3/users => generated 297 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:59:35.135674 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d7961-58c0-4d94-b774-5bf2bcbe6976 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:35.135674 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-354d7961-58c0-4d94-b774-5bf2bcbe6976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:35.144944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1070/2149] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:35.146040 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0f34d-706c-424e-b340-508cf42863c7 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:35.150397 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-80a0f34d-706c-424e-b340-508cf42863c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:35.157259 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d7961-58c0-4d94-b774-5bf2bcbe6976 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:35.180189 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bbd89-545d-49fc-8297-17b7be7951f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:35.180878 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bbd89-545d-49fc-8297-17b7be7951f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:35.181165 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bbd89-545d-49fc-8297-17b7be7951f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:35.183346 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bbd89-545d-49fc-8297-17b7be7951f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:35.186317 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bbd89-545d-49fc-8297-17b7be7951f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:35.192564 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bbd89-545d-49fc-8297-17b7be7951f2 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:35.215043 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1080/2150] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:35.219434 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bbd89-545d-49fc-8297-17b7be7951f2 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:35.232837 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bbd89-545d-49fc-8297-17b7be7951f2 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:35.249542 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cf4f6-77d8-42a4-a5f4-9e7e4aae658e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:35.251034 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cf4f6-77d8-42a4-a5f4-9e7e4aae658e admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:35.251643 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cf4f6-77d8-42a4-a5f4-9e7e4aae658e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:35.252607 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cf4f6-77d8-42a4-a5f4-9e7e4aae658e admin admin] PATH_INFO: `/v3/projects/7e829be61db44221a68146a53c603ffb/users/5225cebd75054f84935555d30569a8d2/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:35.276207 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cf4f6-77d8-42a4-a5f4-9e7e4aae658e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e829be61db44221a68146a53c603ffb, user_id=5225cebd75054f84935555d30569a8d2, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:35.279425 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cf4f6-77d8-42a4-a5f4-9e7e4aae658e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:35.286740 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0f34d-706c-424e-b340-508cf42863c7 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:35.292364 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdcca7-a8e6-4f61-9571-10d97bfb1229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:35.294339 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdcca7-a8e6-4f61-9571-10d97bfb1229 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:35.294883 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdcca7-a8e6-4f61-9571-10d97bfb1229 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:35.295368 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdcca7-a8e6-4f61-9571-10d97bfb1229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:35.309837 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bdcca7-a8e6-4f61-9571-10d97bfb1229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:35.313674 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1081/2151] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:59:35 2022] PUT /identity/v3/projects/7e829be61db44221a68146a53c603ffb/users/5225cebd75054f84935555d30569a8d2/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:35.315923 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cf4f6-77d8-42a4-a5f4-9e7e4aae658e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:35.316802 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bdcca7-a8e6-4f61-9571-10d97bfb1229 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:35.330696 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1071/2152] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:59:35.436438 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cf4f6-77d8-42a4-a5f4-9e7e4aae658e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:35.441761 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c5cf8-268e-481c-9820-3924c8809db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:35.442741 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c5cf8-268e-481c-9820-3924c8809db2 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:35.442839 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c5cf8-268e-481c-9820-3924c8809db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:35.443107 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c5cf8-268e-481c-9820-3924c8809db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:35.443888 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c5cf8-268e-481c-9820-3924c8809db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:35.446307 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c5cf8-268e-481c-9820-3924c8809db2 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:35.458795 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1082/2153] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:35.463745 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdcca7-a8e6-4f61-9571-10d97bfb1229 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:35.475096 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdcca7-a8e6-4f61-9571-10d97bfb1229 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:35.487507 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb9c68-f228-46cf-b6cb-f91e66831ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:35.488474 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb9c68-f228-46cf-b6cb-f91e66831ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:35.488755 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb9c68-f228-46cf-b6cb-f91e66831ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:35.489026 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb9c68-f228-46cf-b6cb-f91e66831ea7 admin admin] PATH_INFO: `/v3/projects/7e829be61db44221a68146a53c603ffb/users/5225cebd75054f84935555d30569a8d2/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:35.495881 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb9c68-f228-46cf-b6cb-f91e66831ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e829be61db44221a68146a53c603ffb, user_id=5225cebd75054f84935555d30569a8d2, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:35.509516 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb9c68-f228-46cf-b6cb-f91e66831ea7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:35.532543 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1072/2154] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:59:35 2022] PUT /identity/v3/projects/7e829be61db44221a68146a53c603ffb/users/5225cebd75054f84935555d30569a8d2/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:59:35.544226 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54d747-6c02-4b65-906b-4539971ec1b7 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:35.544787 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54d747-6c02-4b65-906b-4539971ec1b7 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:35.545263 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54d747-6c02-4b65-906b-4539971ec1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:35.599012 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-7d54d747-6c02-4b65-906b-4539971ec1b7 None None] MFA Rules not processed for user `5225cebd75054f84935555d30569a8d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:35.600285 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-7d54d747-6c02-4b65-906b-4539971ec1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:35.745530 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1083/2155] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:35.874599 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb9c68-f228-46cf-b6cb-f91e66831ea7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:35.878202 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0cfb9c68-f228-46cf-b6cb-f91e66831ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:35.914316 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54d747-6c02-4b65-906b-4539971ec1b7 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:35.915944 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-7d54d747-6c02-4b65-906b-4539971ec1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:36.022901 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb9c68-f228-46cf-b6cb-f91e66831ea7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:36.029208 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616ce93-7269-41a5-ba8b-e1f95212157d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:36.034062 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616ce93-7269-41a5-ba8b-e1f95212157d service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:36.034719 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616ce93-7269-41a5-ba8b-e1f95212157d service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:36.035177 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616ce93-7269-41a5-ba8b-e1f95212157d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:36.050768 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54d747-6c02-4b65-906b-4539971ec1b7 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:36.060529 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616ce93-7269-41a5-ba8b-e1f95212157d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:36.062472 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92b583-f7a5-47b3-b04f-cefb784b30d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:36.063291 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616ce93-7269-41a5-ba8b-e1f95212157d service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:36.063417 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92b583-f7a5-47b3-b04f-cefb784b30d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:36.063785 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92b583-f7a5-47b3-b04f-cefb784b30d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:36.064070 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92b583-f7a5-47b3-b04f-cefb784b30d3 admin admin] PATH_INFO: `/v3/projects/fe3dbbd3934344ceba1d9f4399630733` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:36.066776 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92b583-f7a5-47b3-b04f-cefb784b30d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe3dbbd3934344ceba1d9f4399630733)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:36.068967 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92b583-f7a5-47b3-b04f-cefb784b30d3 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:36.090741 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1073/2156] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:59:36.188185 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ba92b583-f7a5-47b3-b04f-cefb784b30d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe3dbbd3934344ceba1d9f4399630733', 'request_id': 'req-ba92b583-f7a5-47b3-b04f-cefb784b30d3'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:36.204044 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ba92b583-f7a5-47b3-b04f-cefb784b30d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe3dbbd3934344ceba1d9f4399630733', 'request_id': 'req-ba92b583-f7a5-47b3-b04f-cefb784b30d3'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:36.215910 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ba92b583-f7a5-47b3-b04f-cefb784b30d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe3dbbd3934344ceba1d9f4399630733', 'request_id': 'req-ba92b583-f7a5-47b3-b04f-cefb784b30d3'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:36.244449 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ba92b583-f7a5-47b3-b04f-cefb784b30d3 admin admin] The token cache is being invalidate because project fe3dbbd3934344ceba1d9f4399630733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:59:36.244783 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ba92b583-f7a5-47b3-b04f-cefb784b30d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:36.245794 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ba92b583-f7a5-47b3-b04f-cefb784b30d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:36.247926 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1084/2157] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:59:35 2022] DELETE /identity/v3/projects/fe3dbbd3934344ceba1d9f4399630733 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:59:36.253220 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e683e6-90e9-4e9a-b162-f2a2257e0b1f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:36.253611 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e683e6-90e9-4e9a-b162-f2a2257e0b1f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:36.254167 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e683e6-90e9-4e9a-b162-f2a2257e0b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:36.287725 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-58e683e6-90e9-4e9a-b162-f2a2257e0b1f None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:36.292936 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-58e683e6-90e9-4e9a-b162-f2a2257e0b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:36.441392 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1074/2158] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:36.446899 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8c1f3-6cb1-44a0-a670-a154d8f6b788 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:36.447776 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8c1f3-6cb1-44a0-a670-a154d8f6b788 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:36.448429 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8c1f3-6cb1-44a0-a670-a154d8f6b788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:36.490307 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-f9d8c1f3-6cb1-44a0-a670-a154d8f6b788 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:36.491955 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-f9d8c1f3-6cb1-44a0-a670-a154d8f6b788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:36.505216 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1085/2159] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:36.507168 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e683e6-90e9-4e9a-b162-f2a2257e0b1f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:36.518324 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e683e6-90e9-4e9a-b162-f2a2257e0b1f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:36.527419 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423f45a-f5d8-415a-9a95-90164bd95429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:36.527419 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423f45a-f5d8-415a-9a95-90164bd95429 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:36.527419 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423f45a-f5d8-415a-9a95-90164bd95429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:36.527419 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423f45a-f5d8-415a-9a95-90164bd95429 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:36.527908 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423f45a-f5d8-415a-9a95-90164bd95429 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:59:36.527908 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423f45a-f5d8-415a-9a95-90164bd95429 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:36.530544 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423f45a-f5d8-415a-9a95-90164bd95429 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:36.547694 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1075/2160] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:59:36.552124 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8c1f3-6cb1-44a0-a670-a154d8f6b788 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:36.563495 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8c1f3-6cb1-44a0-a670-a154d8f6b788 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:36.572505 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fc8d3-ccd3-433c-ad2b-6835b1bac3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:36.572505 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fc8d3-ccd3-433c-ad2b-6835b1bac3de admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:36.572505 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fc8d3-ccd3-433c-ad2b-6835b1bac3de admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:36.572505 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fc8d3-ccd3-433c-ad2b-6835b1bac3de admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:36.578646 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fc8d3-ccd3-433c-ad2b-6835b1bac3de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:36.581554 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fc8d3-ccd3-433c-ad2b-6835b1bac3de admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:36.621393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1086/2161] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:59:36 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:59:36.622263 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423f45a-f5d8-415a-9a95-90164bd95429 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:36.636171 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423f45a-f5d8-415a-9a95-90164bd95429 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:36.709944 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fc8d3-ccd3-433c-ad2b-6835b1bac3de admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:36.711774 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-f73fc8d3-ccd3-433c-ad2b-6835b1bac3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:36.737397 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d591ec-8a09-48d0-b512-dafcb15c7885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:36.738657 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d591ec-8a09-48d0-b512-dafcb15c7885 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:36.738944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d591ec-8a09-48d0-b512-dafcb15c7885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:36.739221 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d591ec-8a09-48d0-b512-dafcb15c7885 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:36.739981 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d591ec-8a09-48d0-b512-dafcb15c7885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:36.742289 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d591ec-8a09-48d0-b512-dafcb15c7885 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:36.770383 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1076/2162] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:59:36 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:59:36.775298 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d591ec-8a09-48d0-b512-dafcb15c7885 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:36.788493 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d591ec-8a09-48d0-b512-dafcb15c7885 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:36.794385 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590d8ef-b771-412c-bf8a-243bcb47b9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:36.795240 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590d8ef-b771-412c-bf8a-243bcb47b9ad admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:36.795617 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590d8ef-b771-412c-bf8a-243bcb47b9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:36.795987 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590d8ef-b771-412c-bf8a-243bcb47b9ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:36.797237 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590d8ef-b771-412c-bf8a-243bcb47b9ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:36.799166 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590d8ef-b771-412c-bf8a-243bcb47b9ad admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:36.806314 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fc8d3-ccd3-433c-ad2b-6835b1bac3de admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:36.811547 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1077/2163] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:36.816520 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590d8ef-b771-412c-bf8a-243bcb47b9ad admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:36.817996 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d53196-6b93-47a7-a740-e63b7857abfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:36.818941 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d53196-6b93-47a7-a740-e63b7857abfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:36.819859 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d53196-6b93-47a7-a740-e63b7857abfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:36.820149 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d53196-6b93-47a7-a740-e63b7857abfe admin admin] PATH_INFO: `/v3/users/16051286c33e4870aec5fb7218bec04f` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:36.821448 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d53196-6b93-47a7-a740-e63b7857abfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=16051286c33e4870aec5fb7218bec04f)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:36.823998 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d53196-6b93-47a7-a740-e63b7857abfe admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:36.828220 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590d8ef-b771-412c-bf8a-243bcb47b9ad admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:36.834227 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6862420-1f70-4453-8388-7596b59d2d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:36.834962 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6862420-1f70-4453-8388-7596b59d2d9b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:36.835582 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6862420-1f70-4453-8388-7596b59d2d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:36.835794 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6862420-1f70-4453-8388-7596b59d2d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:36.836846 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6862420-1f70-4453-8388-7596b59d2d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:36.838902 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6862420-1f70-4453-8388-7596b59d2d9b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:36.859454 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1078/2164] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:36.861072 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6862420-1f70-4453-8388-7596b59d2d9b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:36.874831 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6862420-1f70-4453-8388-7596b59d2d9b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:36.880949 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839886c5-fb24-45d8-ba1d-9e48ad85cd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:36.882622 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839886c5-fb24-45d8-ba1d-9e48ad85cd22 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:36.882963 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839886c5-fb24-45d8-ba1d-9e48ad85cd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:36.883852 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839886c5-fb24-45d8-ba1d-9e48ad85cd22 admin admin] PATH_INFO: `/v3/projects/f34b29ad12514b58b0338dffa52a6a01/users/7bf03790cb474ba3a4e0ea10567d8c80/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:36.896405 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-33d53196-6b93-47a7-a740-e63b7857abfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16051286c33e4870aec5fb7218bec04f'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:36.903751 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839886c5-fb24-45d8-ba1d-9e48ad85cd22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f34b29ad12514b58b0338dffa52a6a01, user_id=7bf03790cb474ba3a4e0ea10567d8c80, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:36.907002 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-33d53196-6b93-47a7-a740-e63b7857abfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16051286c33e4870aec5fb7218bec04f'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:36.907619 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839886c5-fb24-45d8-ba1d-9e48ad85cd22 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:36.929791 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-33d53196-6b93-47a7-a740-e63b7857abfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16051286c33e4870aec5fb7218bec04f'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:36.931545 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-33d53196-6b93-47a7-a740-e63b7857abfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16051286c33e4870aec5fb7218bec04f'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:36.932518 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-33d53196-6b93-47a7-a740-e63b7857abfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16051286c33e4870aec5fb7218bec04f'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:36.936007 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1079/2165] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:59:36 2022] PUT /identity/v3/projects/f34b29ad12514b58b0338dffa52a6a01/users/7bf03790cb474ba3a4e0ea10567d8c80/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:36.938224 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74c77c-aab9-4cb0-b4a6-3c6a246532bc None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:36.938474 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74c77c-aab9-4cb0-b4a6-3c6a246532bc None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:36.938896 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74c77c-aab9-4cb0-b4a6-3c6a246532bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:36.952281 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1087/2166] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:59:36 2022] DELETE /identity/v3/users/16051286c33e4870aec5fb7218bec04f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:36.957297 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bb768-fc13-4041-9e05-0f2486fb59aa None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:36.958069 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bb768-fc13-4041-9e05-0f2486fb59aa None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:36.958948 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bb768-fc13-4041-9e05-0f2486fb59aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:36.993887 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-2d74c77c-aab9-4cb0-b4a6-3c6a246532bc None None] MFA Rules not processed for user `7bf03790cb474ba3a4e0ea10567d8c80`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:36.994549 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-ed0bb768-fc13-4041-9e05-0f2486fb59aa None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:36.996253 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ed0bb768-fc13-4041-9e05-0f2486fb59aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:36.996390 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2d74c77c-aab9-4cb0-b4a6-3c6a246532bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:37.085039 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1088/2167] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:59:37.098917 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bb768-fc13-4041-9e05-0f2486fb59aa None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:37.101255 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ed0bb768-fc13-4041-9e05-0f2486fb59aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:37.116762 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1080/2168] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:37.131175 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74c77c-aab9-4cb0-b4a6-3c6a246532bc None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:37.133288 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2d74c77c-aab9-4cb0-b4a6-3c6a246532bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:37.184600 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bb768-fc13-4041-9e05-0f2486fb59aa None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:37.189334 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4dbb6-b952-4065-be5a-187781b2d581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:37.190690 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4dbb6-b952-4065-be5a-187781b2d581 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:37.190984 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4dbb6-b952-4065-be5a-187781b2d581 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:37.191527 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4dbb6-b952-4065-be5a-187781b2d581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:37.205137 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4dbb6-b952-4065-be5a-187781b2d581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:37.206294 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4dbb6-b952-4065-be5a-187781b2d581 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:37.209023 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74c77c-aab9-4cb0-b4a6-3c6a246532bc None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:37.213873 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc66f3-1b65-47ca-b097-f89c0c093ed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:37.215391 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc66f3-1b65-47ca-b097-f89c0c093ed7 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:37.216943 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc66f3-1b65-47ca-b097-f89c0c093ed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:37.217454 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc66f3-1b65-47ca-b097-f89c0c093ed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:37.217640 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1089/2169] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:59:37.229215 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc66f3-1b65-47ca-b097-f89c0c093ed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:37.231322 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc66f3-1b65-47ca-b097-f89c0c093ed7 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:37.246362 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1081/2170] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:59:38.341763 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4dbb6-b952-4065-be5a-187781b2d581 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:38.343430 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-72c4dbb6-b952-4065-be5a-187781b2d581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:38.357821 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4dbb6-b952-4065-be5a-187781b2d581 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:38.363646 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa8c3d-a880-49da-ab8a-84c61a1d4bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:38.366225 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa8c3d-a880-49da-ab8a-84c61a1d4bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:38.366552 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa8c3d-a880-49da-ab8a-84c61a1d4bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:38.366882 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa8c3d-a880-49da-ab8a-84c61a1d4bc9 admin admin] PATH_INFO: `/v3/projects/40e8f997d04b4594969df2485fe38c68` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:38.368301 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa8c3d-a880-49da-ab8a-84c61a1d4bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40e8f997d04b4594969df2485fe38c68)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:38.370360 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa8c3d-a880-49da-ab8a-84c61a1d4bc9 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:38.449782 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-dffa8c3d-a880-49da-ab8a-84c61a1d4bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40e8f997d04b4594969df2485fe38c68', 'request_id': 'req-dffa8c3d-a880-49da-ab8a-84c61a1d4bc9'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:38.456022 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-dffa8c3d-a880-49da-ab8a-84c61a1d4bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40e8f997d04b4594969df2485fe38c68', 'request_id': 'req-dffa8c3d-a880-49da-ab8a-84c61a1d4bc9'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:38.462710 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-dffa8c3d-a880-49da-ab8a-84c61a1d4bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40e8f997d04b4594969df2485fe38c68', 'request_id': 'req-dffa8c3d-a880-49da-ab8a-84c61a1d4bc9'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:38.479923 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-dffa8c3d-a880-49da-ab8a-84c61a1d4bc9 admin admin] The token cache is being invalidate because project 40e8f997d04b4594969df2485fe38c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:59:38.480954 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-dffa8c3d-a880-49da-ab8a-84c61a1d4bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:38.481510 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-dffa8c3d-a880-49da-ab8a-84c61a1d4bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:38.483614 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1090/2171] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:59:38 2022] DELETE /identity/v3/projects/40e8f997d04b4594969df2485fe38c68 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:38.487534 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc66f3-1b65-47ca-b097-f89c0c093ed7 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:38.498940 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc66f3-1b65-47ca-b097-f89c0c093ed7 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:38.563945 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb56690-dc8a-4844-a88f-38bc90b2cff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:38.564988 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb56690-dc8a-4844-a88f-38bc90b2cff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:38.565418 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb56690-dc8a-4844-a88f-38bc90b2cff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:38.566069 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb56690-dc8a-4844-a88f-38bc90b2cff3 admin admin] PATH_INFO: `/v3/users/5225cebd75054f84935555d30569a8d2` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:38.568847 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb56690-dc8a-4844-a88f-38bc90b2cff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5225cebd75054f84935555d30569a8d2)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:38.570008 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb56690-dc8a-4844-a88f-38bc90b2cff3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:38.665105 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6fb56690-dc8a-4844-a88f-38bc90b2cff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5225cebd75054f84935555d30569a8d2'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:38.676144 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6fb56690-dc8a-4844-a88f-38bc90b2cff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5225cebd75054f84935555d30569a8d2'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:38.699711 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6fb56690-dc8a-4844-a88f-38bc90b2cff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5225cebd75054f84935555d30569a8d2'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:38.701467 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6fb56690-dc8a-4844-a88f-38bc90b2cff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5225cebd75054f84935555d30569a8d2'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:38.718845 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6fb56690-dc8a-4844-a88f-38bc90b2cff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5225cebd75054f84935555d30569a8d2'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:38.730583 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1082/2172] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:59:38 2022] DELETE /identity/v3/users/5225cebd75054f84935555d30569a8d2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:40.046683 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa8c3d-a880-49da-ab8a-84c61a1d4bc9 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:40.053775 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-dffa8c3d-a880-49da-ab8a-84c61a1d4bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:40.128285 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa8c3d-a880-49da-ab8a-84c61a1d4bc9 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:40.156498 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb56690-dc8a-4844-a88f-38bc90b2cff3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:40.158231 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6fb56690-dc8a-4844-a88f-38bc90b2cff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:40.249807 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca5869-3eb3-4ad6-8551-328abec07adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:40.250762 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca5869-3eb3-4ad6-8551-328abec07adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:40.251212 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca5869-3eb3-4ad6-8551-328abec07adb admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:40.251637 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca5869-3eb3-4ad6-8551-328abec07adb admin admin] PATH_INFO: `/v3/projects/7e829be61db44221a68146a53c603ffb` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:40.253107 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca5869-3eb3-4ad6-8551-328abec07adb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e829be61db44221a68146a53c603ffb)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:40.256011 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca5869-3eb3-4ad6-8551-328abec07adb admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:40.323737 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb56690-dc8a-4844-a88f-38bc90b2cff3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:40.352908 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-e6ca5869-3eb3-4ad6-8551-328abec07adb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e829be61db44221a68146a53c603ffb', 'request_id': 'req-e6ca5869-3eb3-4ad6-8551-328abec07adb'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:40.365516 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-e6ca5869-3eb3-4ad6-8551-328abec07adb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e829be61db44221a68146a53c603ffb', 'request_id': 'req-e6ca5869-3eb3-4ad6-8551-328abec07adb'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:40.382294 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-e6ca5869-3eb3-4ad6-8551-328abec07adb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e829be61db44221a68146a53c603ffb', 'request_id': 'req-e6ca5869-3eb3-4ad6-8551-328abec07adb'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:40.414224 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-e6ca5869-3eb3-4ad6-8551-328abec07adb admin admin] The token cache is being invalidate because project 7e829be61db44221a68146a53c603ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:59:40.414543 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-e6ca5869-3eb3-4ad6-8551-328abec07adb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:40.417917 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-e6ca5869-3eb3-4ad6-8551-328abec07adb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:40.420029 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1091/2173] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:59:40 2022] DELETE /identity/v3/projects/7e829be61db44221a68146a53c603ffb => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:40.435063 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7573598-a644-4929-afd0-8c6e11193a43 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:40.435870 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7573598-a644-4929-afd0-8c6e11193a43 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:40.436334 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7573598-a644-4929-afd0-8c6e11193a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:40.472848 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f61cd-9281-45e9-a3e6-dd770d1a630d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:40.473788 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f61cd-9281-45e9-a3e6-dd770d1a630d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:40.474072 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f61cd-9281-45e9-a3e6-dd770d1a630d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:40.474344 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f61cd-9281-45e9-a3e6-dd770d1a630d admin admin] PATH_INFO: `/v3/users/be803bfe1b234cbe91ef67d3b998044f` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:40.475898 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f61cd-9281-45e9-a3e6-dd770d1a630d admin admin] RBAC: Authorizing `identity:delete_user(user_id=be803bfe1b234cbe91ef67d3b998044f)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:40.478666 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f61cd-9281-45e9-a3e6-dd770d1a630d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:40.479167 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-d7573598-a644-4929-afd0-8c6e11193a43 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:40.480406 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d7573598-a644-4929-afd0-8c6e11193a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:40.503741 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1092/2174] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:40.511321 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41be3bc-bdf3-4382-8b27-9d47a0d1cc20 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:40.511607 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41be3bc-bdf3-4382-8b27-9d47a0d1cc20 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:40.511885 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41be3bc-bdf3-4382-8b27-9d47a0d1cc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:40.565513 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-f41be3bc-bdf3-4382-8b27-9d47a0d1cc20 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:40.566888 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-f41be3bc-bdf3-4382-8b27-9d47a0d1cc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:40.579329 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1093/2175] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:59:40.582884 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41be3bc-bdf3-4382-8b27-9d47a0d1cc20 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:40.587192 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-925f61cd-9281-45e9-a3e6-dd770d1a630d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be803bfe1b234cbe91ef67d3b998044f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:40.594936 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-925f61cd-9281-45e9-a3e6-dd770d1a630d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be803bfe1b234cbe91ef67d3b998044f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:40.604151 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41be3bc-bdf3-4382-8b27-9d47a0d1cc20 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:40.609795 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-925f61cd-9281-45e9-a3e6-dd770d1a630d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be803bfe1b234cbe91ef67d3b998044f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:40.611523 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-925f61cd-9281-45e9-a3e6-dd770d1a630d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be803bfe1b234cbe91ef67d3b998044f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:40.616191 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840984e-c730-409d-a158-5a88696955ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:40.617797 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840984e-c730-409d-a158-5a88696955ac admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:40.618385 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840984e-c730-409d-a158-5a88696955ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:40.618946 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840984e-c730-409d-a158-5a88696955ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:40.619926 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840984e-c730-409d-a158-5a88696955ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:59:40.621624 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840984e-c730-409d-a158-5a88696955ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:40.624358 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840984e-c730-409d-a158-5a88696955ac admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:40.626198 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-925f61cd-9281-45e9-a3e6-dd770d1a630d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be803bfe1b234cbe91ef67d3b998044f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:40.633150 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1083/2176] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:59:40 2022] DELETE /identity/v3/users/be803bfe1b234cbe91ef67d3b998044f => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:40.637788 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77cb1d-4d01-4aee-b708-843fabaf6508 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:40.638146 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77cb1d-4d01-4aee-b708-843fabaf6508 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:40.638486 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77cb1d-4d01-4aee-b708-843fabaf6508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:40.646242 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1094/2177] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:59:40.648890 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840984e-c730-409d-a158-5a88696955ac admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:40.654371 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-c840984e-c730-409d-a158-5a88696955ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:40.667821 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-bd77cb1d-4d01-4aee-b708-843fabaf6508 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:40.669224 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-bd77cb1d-4d01-4aee-b708-843fabaf6508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:40.673026 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840984e-c730-409d-a158-5a88696955ac admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:40.758307 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1084/2178] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:59:40.765879 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77cb1d-4d01-4aee-b708-843fabaf6508 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:40.771106 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-bd77cb1d-4d01-4aee-b708-843fabaf6508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:40.775592 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceab079-eabc-4079-9085-11fa93560a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:40.776310 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceab079-eabc-4079-9085-11fa93560a1e admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:40.776661 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceab079-eabc-4079-9085-11fa93560a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:40.776852 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceab079-eabc-4079-9085-11fa93560a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:40.778425 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceab079-eabc-4079-9085-11fa93560a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:40.783539 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceab079-eabc-4079-9085-11fa93560a1e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:40.821393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1095/2179] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:59:40 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:59:40.825523 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceab079-eabc-4079-9085-11fa93560a1e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:40.848557 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77cb1d-4d01-4aee-b708-843fabaf6508 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:40.909734 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceab079-eabc-4079-9085-11fa93560a1e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:40.912605 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb6081-bfa8-4393-89d9-6db0f1c9c29d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:40.913415 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb6081-bfa8-4393-89d9-6db0f1c9c29d service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:40.913768 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb6081-bfa8-4393-89d9-6db0f1c9c29d service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:40.913872 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb6081-bfa8-4393-89d9-6db0f1c9c29d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:40.925288 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630eebd6-9a8c-4455-9b0e-650892f1e1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:40.926006 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630eebd6-9a8c-4455-9b0e-650892f1e1bd admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:40.926285 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630eebd6-9a8c-4455-9b0e-650892f1e1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:40.926550 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630eebd6-9a8c-4455-9b0e-650892f1e1bd admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:40.927262 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630eebd6-9a8c-4455-9b0e-650892f1e1bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:40.934019 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630eebd6-9a8c-4455-9b0e-650892f1e1bd admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:40.942312 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb6081-bfa8-4393-89d9-6db0f1c9c29d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:40.943751 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb6081-bfa8-4393-89d9-6db0f1c9c29d service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:40.954338 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1085/2180] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:59:40.993409 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1096/2181] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:59:40 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:59:41.002516 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb6081-bfa8-4393-89d9-6db0f1c9c29d service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:41.013583 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb6081-bfa8-4393-89d9-6db0f1c9c29d service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:41.019009 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19286e9-275d-48b1-961e-a29464d87f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:41.020145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19286e9-275d-48b1-961e-a29464d87f67 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:41.020145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19286e9-275d-48b1-961e-a29464d87f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:41.020343 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19286e9-275d-48b1-961e-a29464d87f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:41.021103 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19286e9-275d-48b1-961e-a29464d87f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:41.022867 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19286e9-275d-48b1-961e-a29464d87f67 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:41.047724 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1086/2182] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:41.048438 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630eebd6-9a8c-4455-9b0e-650892f1e1bd admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:41.063293 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630eebd6-9a8c-4455-9b0e-650892f1e1bd admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:41.074045 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd56b4-d5ea-4b0a-85c6-c01ba9d720a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:41.074826 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd56b4-d5ea-4b0a-85c6-c01ba9d720a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:41.075461 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd56b4-d5ea-4b0a-85c6-c01ba9d720a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:41.075911 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd56b4-d5ea-4b0a-85c6-c01ba9d720a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:41.077236 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd56b4-d5ea-4b0a-85c6-c01ba9d720a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:41.079275 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd56b4-d5ea-4b0a-85c6-c01ba9d720a8 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:41.096714 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1097/2183] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:41.101569 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19286e9-275d-48b1-961e-a29464d87f67 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:41.115204 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19286e9-275d-48b1-961e-a29464d87f67 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:41.128599 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e613e68-13c0-4c60-946d-412d3c87408e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:41.129722 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e613e68-13c0-4c60-946d-412d3c87408e admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:41.129997 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e613e68-13c0-4c60-946d-412d3c87408e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:41.130264 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e613e68-13c0-4c60-946d-412d3c87408e admin admin] PATH_INFO: `/v3/projects/6914f186c94e4c7e9ffeca23658b0930/users/153f04e58f8e41b0a5627be0d537acaf/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:41.171881 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e613e68-13c0-4c60-946d-412d3c87408e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6914f186c94e4c7e9ffeca23658b0930, user_id=153f04e58f8e41b0a5627be0d537acaf, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:41.177153 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e613e68-13c0-4c60-946d-412d3c87408e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:41.206244 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1087/2184] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:59:41 2022] PUT /identity/v3/projects/6914f186c94e4c7e9ffeca23658b0930/users/153f04e58f8e41b0a5627be0d537acaf/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:59:41.219916 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abacc95-139d-447e-b6e2-6a7b20406e5d None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:41.220297 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abacc95-139d-447e-b6e2-6a7b20406e5d None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:41.220701 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abacc95-139d-447e-b6e2-6a7b20406e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:41.288121 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-3abacc95-139d-447e-b6e2-6a7b20406e5d None None] MFA Rules not processed for user `153f04e58f8e41b0a5627be0d537acaf`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:41.289540 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-3abacc95-139d-447e-b6e2-6a7b20406e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:41.399448 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1098/2185] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:41.405304 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e613e68-13c0-4c60-946d-412d3c87408e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:41.479503 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abacc95-139d-447e-b6e2-6a7b20406e5d None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:41.480942 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-3abacc95-139d-447e-b6e2-6a7b20406e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:41.538381 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e613e68-13c0-4c60-946d-412d3c87408e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:41.553048 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdaf83-e979-46d7-a5e5-3690fbe892ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:41.554074 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdaf83-e979-46d7-a5e5-3690fbe892ef admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:41.555112 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdaf83-e979-46d7-a5e5-3690fbe892ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:41.555703 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdaf83-e979-46d7-a5e5-3690fbe892ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:41.556540 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdaf83-e979-46d7-a5e5-3690fbe892ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:41.560507 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdaf83-e979-46d7-a5e5-3690fbe892ef admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:41.581765 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abacc95-139d-447e-b6e2-6a7b20406e5d None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:41.594270 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02614781-6da5-4d4c-a257-ec72ede70801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:41.595383 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02614781-6da5-4d4c-a257-ec72ede70801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:41.595733 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02614781-6da5-4d4c-a257-ec72ede70801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:41.596070 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02614781-6da5-4d4c-a257-ec72ede70801 admin admin] PATH_INFO: `/v3/projects/451e16d242714e819ad21f87c3f8ffa1` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:41.597065 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1088/2186] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:59:41 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:59:41.597466 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02614781-6da5-4d4c-a257-ec72ede70801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=451e16d242714e819ad21f87c3f8ffa1)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:41.599588 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02614781-6da5-4d4c-a257-ec72ede70801 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:41.600817 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdaf83-e979-46d7-a5e5-3690fbe892ef admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:41.675336 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-02614781-6da5-4d4c-a257-ec72ede70801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451e16d242714e819ad21f87c3f8ffa1', 'request_id': 'req-02614781-6da5-4d4c-a257-ec72ede70801'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:41.684724 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-02614781-6da5-4d4c-a257-ec72ede70801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451e16d242714e819ad21f87c3f8ffa1', 'request_id': 'req-02614781-6da5-4d4c-a257-ec72ede70801'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:41.686412 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdaf83-e979-46d7-a5e5-3690fbe892ef admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:41.696037 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-02614781-6da5-4d4c-a257-ec72ede70801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451e16d242714e819ad21f87c3f8ffa1', 'request_id': 'req-02614781-6da5-4d4c-a257-ec72ede70801'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:41.734328 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-02614781-6da5-4d4c-a257-ec72ede70801 admin admin] The token cache is being invalidate because project 451e16d242714e819ad21f87c3f8ffa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:59:41.734612 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-02614781-6da5-4d4c-a257-ec72ede70801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:41.736629 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-02614781-6da5-4d4c-a257-ec72ede70801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:41.742234 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1099/2187] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:59:41 2022] DELETE /identity/v3/projects/451e16d242714e819ad21f87c3f8ffa1 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:41.789489 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e522ba-c1d3-46b4-b55e-73e9eb666a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:41.790508 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e522ba-c1d3-46b4-b55e-73e9eb666a86 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:41.791266 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e522ba-c1d3-46b4-b55e-73e9eb666a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:41.792303 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e522ba-c1d3-46b4-b55e-73e9eb666a86 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:41.794541 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e522ba-c1d3-46b4-b55e-73e9eb666a86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:41.797724 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e522ba-c1d3-46b4-b55e-73e9eb666a86 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:41.832597 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1089/2188] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:59:41 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:59:41.836884 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02614781-6da5-4d4c-a257-ec72ede70801 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:41.838842 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-02614781-6da5-4d4c-a257-ec72ede70801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:41.855433 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02614781-6da5-4d4c-a257-ec72ede70801 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:41.862808 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a6b21-7ff3-4e14-91c1-0fbc165ed6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:41.863493 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a6b21-7ff3-4e14-91c1-0fbc165ed6aa admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:41.863817 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a6b21-7ff3-4e14-91c1-0fbc165ed6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:41.864085 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a6b21-7ff3-4e14-91c1-0fbc165ed6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:41.864859 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a6b21-7ff3-4e14-91c1-0fbc165ed6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:41.866800 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a6b21-7ff3-4e14-91c1-0fbc165ed6aa admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:41.909590 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1100/2189] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:41.913826 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e522ba-c1d3-46b4-b55e-73e9eb666a86 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:41.930549 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e522ba-c1d3-46b4-b55e-73e9eb666a86 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:41.944699 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b1eac-b39a-45a7-b821-65ebdb46ff35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:41.946043 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b1eac-b39a-45a7-b821-65ebdb46ff35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:41.946566 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b1eac-b39a-45a7-b821-65ebdb46ff35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:41.947038 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b1eac-b39a-45a7-b821-65ebdb46ff35 admin admin] PATH_INFO: `/v3/projects/f67500e3cc2842319a09b9f76a88817d/users/ff2207d3887240dc99ab96e7b69ee329/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:41.975317 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b1eac-b39a-45a7-b821-65ebdb46ff35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f67500e3cc2842319a09b9f76a88817d, user_id=ff2207d3887240dc99ab96e7b69ee329, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:41.978529 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b1eac-b39a-45a7-b821-65ebdb46ff35 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:41.998619 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1090/2190] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:59:41 2022] PUT /identity/v3/projects/f67500e3cc2842319a09b9f76a88817d/users/ff2207d3887240dc99ab96e7b69ee329/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:42.002552 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a6b21-7ff3-4e14-91c1-0fbc165ed6aa admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:42.013332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a6b21-7ff3-4e14-91c1-0fbc165ed6aa admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:42.071708 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246f607-bc88-453c-97e8-01f1f26247a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:42.072479 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246f607-bc88-453c-97e8-01f1f26247a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:42.072657 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246f607-bc88-453c-97e8-01f1f26247a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:42.072939 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246f607-bc88-453c-97e8-01f1f26247a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:42.073733 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246f607-bc88-453c-97e8-01f1f26247a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:42.075363 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246f607-bc88-453c-97e8-01f1f26247a0 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:42.092663 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3519922-d12a-42d6-b6eb-1573b931f108 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:42.093008 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3519922-d12a-42d6-b6eb-1573b931f108 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:42.094257 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3519922-d12a-42d6-b6eb-1573b931f108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:42.097694 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1101/2191] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:42.098607 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246f607-bc88-453c-97e8-01f1f26247a0 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:42.108496 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246f607-bc88-453c-97e8-01f1f26247a0 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:42.113293 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025d575-051c-4807-af76-aad8fe3f48f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:42.114275 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025d575-051c-4807-af76-aad8fe3f48f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:42.114552 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025d575-051c-4807-af76-aad8fe3f48f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:42.114827 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025d575-051c-4807-af76-aad8fe3f48f6 admin admin] PATH_INFO: `/v3/projects/f67500e3cc2842319a09b9f76a88817d/users/ff2207d3887240dc99ab96e7b69ee329/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:42.117330 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025d575-051c-4807-af76-aad8fe3f48f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f67500e3cc2842319a09b9f76a88817d, user_id=ff2207d3887240dc99ab96e7b69ee329, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:42.122117 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025d575-051c-4807-af76-aad8fe3f48f6 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:42.129931 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-d3519922-d12a-42d6-b6eb-1573b931f108 None None] MFA Rules not processed for user `d5ffdb5701ac4b5284c9f9889b00b307`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:42.131153 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d3519922-d12a-42d6-b6eb-1573b931f108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:42.139531 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1102/2192] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:59:42 2022] PUT /identity/v3/projects/f67500e3cc2842319a09b9f76a88817d/users/ff2207d3887240dc99ab96e7b69ee329/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:59:42.152248 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaecf0-8400-40eb-a889-91927904af07 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:42.152533 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaecf0-8400-40eb-a889-91927904af07 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:42.152802 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaecf0-8400-40eb-a889-91927904af07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:42.188663 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-8ebaecf0-8400-40eb-a889-91927904af07 None None] MFA Rules not processed for user `ff2207d3887240dc99ab96e7b69ee329`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:42.190255 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-8ebaecf0-8400-40eb-a889-91927904af07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:42.210752 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1091/2193] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:59:42.223354 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3519922-d12a-42d6-b6eb-1573b931f108 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:42.224701 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d3519922-d12a-42d6-b6eb-1573b931f108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:42.274095 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1103/2194] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:59:42.284805 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebaecf0-8400-40eb-a889-91927904af07 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:42.286317 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-8ebaecf0-8400-40eb-a889-91927904af07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:42.287312 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3519922-d12a-42d6-b6eb-1573b931f108 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:42.291368 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed5296-4c56-4b7f-a4f1-d6925af1be41 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '256860d94eb142c6b2175ae89f977e4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:42.292017 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed5296-4c56-4b7f-a4f1-d6925af1be41 service glance] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:42.292366 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed5296-4c56-4b7f-a4f1-d6925af1be41 service glance] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:42.292637 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed5296-4c56-4b7f-a4f1-d6925af1be41 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:42.294733 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-77ed5296-4c56-4b7f-a4f1-d6925af1be41 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:42.347153 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebaecf0-8400-40eb-a889-91927904af07 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:42.351941 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7dcb5-a432-4ceb-8778-a00bcb48ed80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:42.352742 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7dcb5-a432-4ceb-8778-a00bcb48ed80 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:42.352886 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7dcb5-a432-4ceb-8778-a00bcb48ed80 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:42.353090 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7dcb5-a432-4ceb-8778-a00bcb48ed80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:42.354996 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-c8f7dcb5-a432-4ceb-8778-a00bcb48ed80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:42.365914 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed5296-4c56-4b7f-a4f1-d6925af1be41 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:42.367599 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed5296-4c56-4b7f-a4f1-d6925af1be41 service glance] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:42.378171 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1092/2195] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:59:42.459862 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7dcb5-a432-4ceb-8778-a00bcb48ed80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:42.461478 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7dcb5-a432-4ceb-8778-a00bcb48ed80 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:42.475101 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1104/2196] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:59:42.514598 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762f99a-dab0-4aa0-9260-6244c24668cf None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:42.515126 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762f99a-dab0-4aa0-9260-6244c24668cf None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:42.515853 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762f99a-dab0-4aa0-9260-6244c24668cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:42.537214 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-9762f99a-dab0-4aa0-9260-6244c24668cf None None] MFA Rules not processed for user `de790a1a69994f7498834ded10480e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:42.538724 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9762f99a-dab0-4aa0-9260-6244c24668cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:42.596065 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1093/2197] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 10 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:42.640032 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7dcb5-a432-4ceb-8778-a00bcb48ed80 service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:42.641680 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-c8f7dcb5-a432-4ceb-8778-a00bcb48ed80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:42.713821 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7dcb5-a432-4ceb-8778-a00bcb48ed80 service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:42.719045 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e1d15-135e-44f8-8d90-a3a912fbbec8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f09689635e54a4e85c0ef0e3539d911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:42.719711 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e1d15-135e-44f8-8d90-a3a912fbbec8 service swift] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:42.719983 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e1d15-135e-44f8-8d90-a3a912fbbec8 service swift] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:42.720248 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e1d15-135e-44f8-8d90-a3a912fbbec8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:42.740911 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e1d15-135e-44f8-8d90-a3a912fbbec8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:42.742930 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e1d15-135e-44f8-8d90-a3a912fbbec8 service swift] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:42.755744 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1105/2198] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 10 20:59:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:59:46.320269 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762f99a-dab0-4aa0-9260-6244c24668cf None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:46.423817 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762f99a-dab0-4aa0-9260-6244c24668cf None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:46.429916 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea8afc-1a49-45ae-9cec-9b38d6b07494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:46.430924 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea8afc-1a49-45ae-9cec-9b38d6b07494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:46.431438 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea8afc-1a49-45ae-9cec-9b38d6b07494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:46.431775 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea8afc-1a49-45ae-9cec-9b38d6b07494 admin admin] PATH_INFO: `/v3/users/153f04e58f8e41b0a5627be0d537acaf` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:46.433898 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea8afc-1a49-45ae-9cec-9b38d6b07494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=153f04e58f8e41b0a5627be0d537acaf)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:46.436651 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea8afc-1a49-45ae-9cec-9b38d6b07494 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:46.502174 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-bfea8afc-1a49-45ae-9cec-9b38d6b07494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '153f04e58f8e41b0a5627be0d537acaf'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:46.509311 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-bfea8afc-1a49-45ae-9cec-9b38d6b07494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '153f04e58f8e41b0a5627be0d537acaf'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:46.522653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-bfea8afc-1a49-45ae-9cec-9b38d6b07494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '153f04e58f8e41b0a5627be0d537acaf'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:46.523433 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-bfea8afc-1a49-45ae-9cec-9b38d6b07494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '153f04e58f8e41b0a5627be0d537acaf'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:46.544899 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-bfea8afc-1a49-45ae-9cec-9b38d6b07494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '153f04e58f8e41b0a5627be0d537acaf'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:46.552826 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1094/2199] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:59:46 2022] DELETE /identity/v3/users/153f04e58f8e41b0a5627be0d537acaf => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:46.557267 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f6554-62f8-42a5-a46b-f08dcb4def66 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:46.560429 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f6554-62f8-42a5-a46b-f08dcb4def66 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:46.560719 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f6554-62f8-42a5-a46b-f08dcb4def66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:46.589378 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-014f6554-62f8-42a5-a46b-f08dcb4def66 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:46.592505 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-014f6554-62f8-42a5-a46b-f08dcb4def66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:46.670637 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1106/2200] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:46.681867 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea8afc-1a49-45ae-9cec-9b38d6b07494 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:46.683971 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-bfea8afc-1a49-45ae-9cec-9b38d6b07494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:46.772701 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea8afc-1a49-45ae-9cec-9b38d6b07494 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:46.777554 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f5c20-5592-4a8d-a350-13d1b976b5fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:46.778321 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f5c20-5592-4a8d-a350-13d1b976b5fa service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:46.778693 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f5c20-5592-4a8d-a350-13d1b976b5fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:46.779050 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f5c20-5592-4a8d-a350-13d1b976b5fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:46.805265 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f5c20-5592-4a8d-a350-13d1b976b5fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:46.807071 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f5c20-5592-4a8d-a350-13d1b976b5fa service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:46.819031 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1095/2201] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:59:47.344204 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f6554-62f8-42a5-a46b-f08dcb4def66 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:47.345855 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-014f6554-62f8-42a5-a46b-f08dcb4def66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:47.378776 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f6554-62f8-42a5-a46b-f08dcb4def66 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:47.387184 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1de2af-df64-4f65-9f62-4d358b057ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:47.388065 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1de2af-df64-4f65-9f62-4d358b057ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:47.388347 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1de2af-df64-4f65-9f62-4d358b057ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:47.388618 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1de2af-df64-4f65-9f62-4d358b057ecc admin admin] PATH_INFO: `/v3/projects/6914f186c94e4c7e9ffeca23658b0930` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:47.390570 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1de2af-df64-4f65-9f62-4d358b057ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6914f186c94e4c7e9ffeca23658b0930)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:47.392347 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1de2af-df64-4f65-9f62-4d358b057ecc admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:47.451201 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-6e1de2af-df64-4f65-9f62-4d358b057ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6914f186c94e4c7e9ffeca23658b0930', 'request_id': 'req-6e1de2af-df64-4f65-9f62-4d358b057ecc'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:47.462196 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-6e1de2af-df64-4f65-9f62-4d358b057ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6914f186c94e4c7e9ffeca23658b0930', 'request_id': 'req-6e1de2af-df64-4f65-9f62-4d358b057ecc'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:47.480482 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-6e1de2af-df64-4f65-9f62-4d358b057ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6914f186c94e4c7e9ffeca23658b0930', 'request_id': 'req-6e1de2af-df64-4f65-9f62-4d358b057ecc'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:47.504000 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-6e1de2af-df64-4f65-9f62-4d358b057ecc admin admin] The token cache is being invalidate because project 6914f186c94e4c7e9ffeca23658b0930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:59:47.504352 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-6e1de2af-df64-4f65-9f62-4d358b057ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:47.505172 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-6e1de2af-df64-4f65-9f62-4d358b057ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:47.507008 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1107/2202] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:59:47 2022] DELETE /identity/v3/projects/6914f186c94e4c7e9ffeca23658b0930 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:47.511227 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f5c20-5592-4a8d-a350-13d1b976b5fa service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:47.524623 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f5c20-5592-4a8d-a350-13d1b976b5fa service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:47.588530 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f642ad-73ef-4a5e-8e9d-e7a2fb192b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:47.589489 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f642ad-73ef-4a5e-8e9d-e7a2fb192b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:47.589774 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f642ad-73ef-4a5e-8e9d-e7a2fb192b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:47.590080 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f642ad-73ef-4a5e-8e9d-e7a2fb192b85 admin admin] PATH_INFO: `/v3/users/ff2207d3887240dc99ab96e7b69ee329` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:47.591820 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f642ad-73ef-4a5e-8e9d-e7a2fb192b85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff2207d3887240dc99ab96e7b69ee329)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:47.594217 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f642ad-73ef-4a5e-8e9d-e7a2fb192b85 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:47.675089 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-10f642ad-73ef-4a5e-8e9d-e7a2fb192b85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff2207d3887240dc99ab96e7b69ee329'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:47.687836 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-10f642ad-73ef-4a5e-8e9d-e7a2fb192b85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff2207d3887240dc99ab96e7b69ee329'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:47.715926 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-10f642ad-73ef-4a5e-8e9d-e7a2fb192b85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff2207d3887240dc99ab96e7b69ee329'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:47.716788 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-10f642ad-73ef-4a5e-8e9d-e7a2fb192b85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff2207d3887240dc99ab96e7b69ee329'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:47.729030 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-10f642ad-73ef-4a5e-8e9d-e7a2fb192b85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff2207d3887240dc99ab96e7b69ee329'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:47.740873 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1096/2203] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:59:47 2022] DELETE /identity/v3/users/ff2207d3887240dc99ab96e7b69ee329 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:59:47.777632 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1de2af-df64-4f65-9f62-4d358b057ecc admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:47.779239 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-6e1de2af-df64-4f65-9f62-4d358b057ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:47.799545 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1de2af-df64-4f65-9f62-4d358b057ecc admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:47.884206 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcbfc6-78e4-4a0d-b06a-1c596b85a0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:47.885126 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcbfc6-78e4-4a0d-b06a-1c596b85a0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:47.885942 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcbfc6-78e4-4a0d-b06a-1c596b85a0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:47.886256 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcbfc6-78e4-4a0d-b06a-1c596b85a0f3 admin admin] PATH_INFO: `/v3/users/7bf03790cb474ba3a4e0ea10567d8c80` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:47.888093 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdcbfc6-78e4-4a0d-b06a-1c596b85a0f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bf03790cb474ba3a4e0ea10567d8c80)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:47.890754 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdcbfc6-78e4-4a0d-b06a-1c596b85a0f3 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:47.963035 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2fdcbfc6-78e4-4a0d-b06a-1c596b85a0f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bf03790cb474ba3a4e0ea10567d8c80'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:47.972515 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2fdcbfc6-78e4-4a0d-b06a-1c596b85a0f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bf03790cb474ba3a4e0ea10567d8c80'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:47.987262 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2fdcbfc6-78e4-4a0d-b06a-1c596b85a0f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bf03790cb474ba3a4e0ea10567d8c80'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:47.988245 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2fdcbfc6-78e4-4a0d-b06a-1c596b85a0f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bf03790cb474ba3a4e0ea10567d8c80'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:47.988968 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2fdcbfc6-78e4-4a0d-b06a-1c596b85a0f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bf03790cb474ba3a4e0ea10567d8c80'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:48.008396 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1108/2204] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:59:47 2022] DELETE /identity/v3/users/7bf03790cb474ba3a4e0ea10567d8c80 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:48.012893 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe994a58-cd78-4ed1-8b3b-f0ca8d79a5e6 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:48.013441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe994a58-cd78-4ed1-8b3b-f0ca8d79a5e6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:48.013858 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe994a58-cd78-4ed1-8b3b-f0ca8d79a5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:48.033021 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-fe994a58-cd78-4ed1-8b3b-f0ca8d79a5e6 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:48.034634 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-fe994a58-cd78-4ed1-8b3b-f0ca8d79a5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:48.085618 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcbfc6-78e4-4a0d-b06a-1c596b85a0f3 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:48.088440 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-2fdcbfc6-78e4-4a0d-b06a-1c596b85a0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:48.117513 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1097/2205] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:48.136344 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe994a58-cd78-4ed1-8b3b-f0ca8d79a5e6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:48.141219 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-fe994a58-cd78-4ed1-8b3b-f0ca8d79a5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:48.176790 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcbfc6-78e4-4a0d-b06a-1c596b85a0f3 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:48.182064 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732df921-e1a1-452a-adc1-1e85ca633b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:48.183161 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732df921-e1a1-452a-adc1-1e85ca633b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:48.183447 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732df921-e1a1-452a-adc1-1e85ca633b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:48.183717 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732df921-e1a1-452a-adc1-1e85ca633b16 admin admin] PATH_INFO: `/v3/projects/f67500e3cc2842319a09b9f76a88817d` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:48.185077 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732df921-e1a1-452a-adc1-1e85ca633b16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f67500e3cc2842319a09b9f76a88817d)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:48.187216 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732df921-e1a1-452a-adc1-1e85ca633b16 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:48.237588 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe994a58-cd78-4ed1-8b3b-f0ca8d79a5e6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:48.242544 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75314912-bf76-4a88-8314-2b6110b818f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:48.243391 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75314912-bf76-4a88-8314-2b6110b818f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:48.243682 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75314912-bf76-4a88-8314-2b6110b818f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:48.244094 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75314912-bf76-4a88-8314-2b6110b818f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:48.258979 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75314912-bf76-4a88-8314-2b6110b818f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:48.260431 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75314912-bf76-4a88-8314-2b6110b818f9 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:48.278468 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1098/2206] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:59:48.278765 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-732df921-e1a1-452a-adc1-1e85ca633b16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f67500e3cc2842319a09b9f76a88817d', 'request_id': 'req-732df921-e1a1-452a-adc1-1e85ca633b16'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:48.285690 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-732df921-e1a1-452a-adc1-1e85ca633b16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f67500e3cc2842319a09b9f76a88817d', 'request_id': 'req-732df921-e1a1-452a-adc1-1e85ca633b16'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:48.292570 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-732df921-e1a1-452a-adc1-1e85ca633b16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f67500e3cc2842319a09b9f76a88817d', 'request_id': 'req-732df921-e1a1-452a-adc1-1e85ca633b16'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:48.320125 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-732df921-e1a1-452a-adc1-1e85ca633b16 admin admin] The token cache is being invalidate because project f67500e3cc2842319a09b9f76a88817d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:59:48.320545 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-732df921-e1a1-452a-adc1-1e85ca633b16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:48.321749 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-732df921-e1a1-452a-adc1-1e85ca633b16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:48.330651 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e17b3-1824-4ea5-a44b-7ef594846fea None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:48.331431 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e17b3-1824-4ea5-a44b-7ef594846fea None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:48.331845 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e17b3-1824-4ea5-a44b-7ef594846fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:48.334328 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1109/2207] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:59:48 2022] DELETE /identity/v3/projects/f67500e3cc2842319a09b9f76a88817d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:59:48.361029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-580e17b3-1824-4ea5-a44b-7ef594846fea None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:48.363191 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-580e17b3-1824-4ea5-a44b-7ef594846fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:48.499663 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1099/2208] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:48.508049 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1b0c1-ab24-4c04-aba8-4f62ee829c16 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:48.508640 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1b0c1-ab24-4c04-aba8-4f62ee829c16 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:48.508912 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1b0c1-ab24-4c04-aba8-4f62ee829c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:48.563024 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-e9c1b0c1-ab24-4c04-aba8-4f62ee829c16 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:48.568640 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-e9c1b0c1-ab24-4c04-aba8-4f62ee829c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:48.593368 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1110/2209] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:48.598032 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e17b3-1824-4ea5-a44b-7ef594846fea None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:48.612478 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e17b3-1824-4ea5-a44b-7ef594846fea None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:48.617975 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4fb98-5adc-457e-8526-04d907185b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:48.618839 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4fb98-5adc-457e-8526-04d907185b51 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:48.619480 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4fb98-5adc-457e-8526-04d907185b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:48.619480 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4fb98-5adc-457e-8526-04d907185b51 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:48.620598 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4fb98-5adc-457e-8526-04d907185b51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:59:48.621312 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4fb98-5adc-457e-8526-04d907185b51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:48.622723 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4fb98-5adc-457e-8526-04d907185b51 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:48.646885 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1100/2210] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:59:48.651752 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1b0c1-ab24-4c04-aba8-4f62ee829c16 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:48.662254 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1b0c1-ab24-4c04-aba8-4f62ee829c16 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:48.670339 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6ad0d-80d9-4218-832a-c00a68fd09d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:48.671223 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4fb98-5adc-457e-8526-04d907185b51 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:48.671919 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6ad0d-80d9-4218-832a-c00a68fd09d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:48.672366 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6ad0d-80d9-4218-832a-c00a68fd09d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:48.672824 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6ad0d-80d9-4218-832a-c00a68fd09d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:48.672994 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-57e4fb98-5adc-457e-8526-04d907185b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:48.673918 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6ad0d-80d9-4218-832a-c00a68fd09d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:48.676007 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6ad0d-80d9-4218-832a-c00a68fd09d2 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:48.702543 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4fb98-5adc-457e-8526-04d907185b51 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:48.709093 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d9f8a-164c-4bcd-8c78-94f794d9af9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:48.710315 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d9f8a-164c-4bcd-8c78-94f794d9af9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:48.710896 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d9f8a-164c-4bcd-8c78-94f794d9af9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:48.711374 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d9f8a-164c-4bcd-8c78-94f794d9af9a admin admin] PATH_INFO: `/v3/projects/f34b29ad12514b58b0338dffa52a6a01` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:48.712854 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d9f8a-164c-4bcd-8c78-94f794d9af9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f34b29ad12514b58b0338dffa52a6a01)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:48.716382 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d9f8a-164c-4bcd-8c78-94f794d9af9a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:48.738719 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1111/2211] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:59:48 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:59:48.742812 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6ad0d-80d9-4218-832a-c00a68fd09d2 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:48.827220 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-123d9f8a-164c-4bcd-8c78-94f794d9af9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f34b29ad12514b58b0338dffa52a6a01', 'request_id': 'req-123d9f8a-164c-4bcd-8c78-94f794d9af9a'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:48.829436 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6ad0d-80d9-4218-832a-c00a68fd09d2 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:48.838638 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-123d9f8a-164c-4bcd-8c78-94f794d9af9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f34b29ad12514b58b0338dffa52a6a01', 'request_id': 'req-123d9f8a-164c-4bcd-8c78-94f794d9af9a'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:48.848528 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-123d9f8a-164c-4bcd-8c78-94f794d9af9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f34b29ad12514b58b0338dffa52a6a01', 'request_id': 'req-123d9f8a-164c-4bcd-8c78-94f794d9af9a'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:48.869780 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-123d9f8a-164c-4bcd-8c78-94f794d9af9a admin admin] The token cache is being invalidate because project f34b29ad12514b58b0338dffa52a6a01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:59:48.870355 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-123d9f8a-164c-4bcd-8c78-94f794d9af9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:48.871226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-123d9f8a-164c-4bcd-8c78-94f794d9af9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:48.874018 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1101/2212] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:59:48 2022] DELETE /identity/v3/projects/f34b29ad12514b58b0338dffa52a6a01 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:59:48.879539 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9af786-ac29-4f2e-8572-eda3ce209f0c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:48.879729 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9af786-ac29-4f2e-8572-eda3ce209f0c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:48.880388 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9af786-ac29-4f2e-8572-eda3ce209f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:48.903479 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-6d9af786-ac29-4f2e-8572-eda3ce209f0c None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:48.905199 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6d9af786-ac29-4f2e-8572-eda3ce209f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:48.927013 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ed5cd-a29f-496a-8c6d-a56a44d610cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:48.928065 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ed5cd-a29f-496a-8c6d-a56a44d610cc admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:48.928410 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ed5cd-a29f-496a-8c6d-a56a44d610cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:48.928746 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ed5cd-a29f-496a-8c6d-a56a44d610cc admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:48.929710 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ed5cd-a29f-496a-8c6d-a56a44d610cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:48.933023 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ed5cd-a29f-496a-8c6d-a56a44d610cc admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:48.979157 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1112/2213] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:59:48 2022] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:59:48.987926 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ed5cd-a29f-496a-8c6d-a56a44d610cc admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:48.989786 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-6d8ed5cd-a29f-496a-8c6d-a56a44d610cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:49.002529 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ed5cd-a29f-496a-8c6d-a56a44d610cc admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:49.010613 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815653c-1ad1-467c-95cd-912bcc9e2696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:49.011468 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815653c-1ad1-467c-95cd-912bcc9e2696 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:49.011893 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815653c-1ad1-467c-95cd-912bcc9e2696 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:49.012171 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815653c-1ad1-467c-95cd-912bcc9e2696 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:49.013053 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815653c-1ad1-467c-95cd-912bcc9e2696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:49.014746 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815653c-1ad1-467c-95cd-912bcc9e2696 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:49.019713 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1102/2214] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:49.026210 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1113/2215] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:49.029978 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815653c-1ad1-467c-95cd-912bcc9e2696 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:49.030609 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbce2d4-3f13-41aa-932d-de262ef232df None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:49.031184 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbce2d4-3f13-41aa-932d-de262ef232df None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:49.031446 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbce2d4-3f13-41aa-932d-de262ef232df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:49.041629 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815653c-1ad1-467c-95cd-912bcc9e2696 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:49.047374 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb10f30-08f0-489c-a903-c0fc9554d0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:49.048061 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb10f30-08f0-489c-a903-c0fc9554d0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:49.048345 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb10f30-08f0-489c-a903-c0fc9554d0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:49.048680 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb10f30-08f0-489c-a903-c0fc9554d0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:49.049454 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb10f30-08f0-489c-a903-c0fc9554d0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:49.051760 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb10f30-08f0-489c-a903-c0fc9554d0f8 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:49.058310 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-9fbce2d4-3f13-41aa-932d-de262ef232df None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:49.060434 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9fbce2d4-3f13-41aa-932d-de262ef232df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:49.068289 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1114/2216] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 20:59:49.078448 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb10f30-08f0-489c-a903-c0fc9554d0f8 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:49.079321 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1103/2217] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:59:49.084513 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbce2d4-3f13-41aa-932d-de262ef232df None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:49.100706 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb10f30-08f0-489c-a903-c0fc9554d0f8 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:49.105776 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbce2d4-3f13-41aa-932d-de262ef232df None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:49.119514 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f165e7f-b209-4ab1-99b2-1bb348f91b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:49.121034 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f165e7f-b209-4ab1-99b2-1bb348f91b8a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:49.121273 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f165e7f-b209-4ab1-99b2-1bb348f91b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:49.121385 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f165e7f-b209-4ab1-99b2-1bb348f91b8a admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:49.122915 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f165e7f-b209-4ab1-99b2-1bb348f91b8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 20:59:49.123334 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f165e7f-b209-4ab1-99b2-1bb348f91b8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:49.125336 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39f935-14ae-4c81-8389-f02a9b83f500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:49.125501 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f165e7f-b209-4ab1-99b2-1bb348f91b8a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:49.129096 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39f935-14ae-4c81-8389-f02a9b83f500 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:49.130809 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39f935-14ae-4c81-8389-f02a9b83f500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:49.132137 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39f935-14ae-4c81-8389-f02a9b83f500 admin admin] PATH_INFO: `/v3/projects/b81d541d3a214ee8977dcccaa53c7bc5/users/3bc070dd79d14eb19fea95bf26675339/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:49.139365 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1104/2218] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 20:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 20:59:49.143703 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f165e7f-b209-4ab1-99b2-1bb348f91b8a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:49.156517 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39f935-14ae-4c81-8389-f02a9b83f500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81d541d3a214ee8977dcccaa53c7bc5, user_id=3bc070dd79d14eb19fea95bf26675339, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:49.157604 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f165e7f-b209-4ab1-99b2-1bb348f91b8a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:49.161002 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39f935-14ae-4c81-8389-f02a9b83f500 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:49.169963 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eeed9d-9350-48d4-a670-6f84e0d82194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:49.170655 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eeed9d-9350-48d4-a670-6f84e0d82194 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:49.170935 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eeed9d-9350-48d4-a670-6f84e0d82194 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:49.171209 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eeed9d-9350-48d4-a670-6f84e0d82194 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:49.172063 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eeed9d-9350-48d4-a670-6f84e0d82194 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:49.174040 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eeed9d-9350-48d4-a670-6f84e0d82194 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:49.207047 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1115/2219] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:59:49 2022] PUT /identity/v3/projects/b81d541d3a214ee8977dcccaa53c7bc5/users/3bc070dd79d14eb19fea95bf26675339/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:49.210111 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1105/2220] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 20:59:49 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 20:59:49.210294 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f4a28-4b43-49e3-b4f4-1f2cd0b2eeb3 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:49.210510 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f4a28-4b43-49e3-b4f4-1f2cd0b2eeb3 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:49.210813 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f4a28-4b43-49e3-b4f4-1f2cd0b2eeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:49.214099 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eeed9d-9350-48d4-a670-6f84e0d82194 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:49.246811 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-931f4a28-4b43-49e3-b4f4-1f2cd0b2eeb3 None None] MFA Rules not processed for user `3bc070dd79d14eb19fea95bf26675339`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:49.248287 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-931f4a28-4b43-49e3-b4f4-1f2cd0b2eeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:49.299192 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eeed9d-9350-48d4-a670-6f84e0d82194 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:49.305810 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ee90e-973c-49d2-a4ec-2f210cb22e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:49.306861 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ee90e-973c-49d2-a4ec-2f210cb22e12 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:49.307647 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ee90e-973c-49d2-a4ec-2f210cb22e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:49.308036 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ee90e-973c-49d2-a4ec-2f210cb22e12 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:49.308810 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ee90e-973c-49d2-a4ec-2f210cb22e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:49.310922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ee90e-973c-49d2-a4ec-2f210cb22e12 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:49.335705 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1116/2221] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:49.341399 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1106/2222] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 20:59:49 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 20:59:49.345726 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f4a28-4b43-49e3-b4f4-1f2cd0b2eeb3 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:49.352961 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ee90e-973c-49d2-a4ec-2f210cb22e12 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:49.355276 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c04ee90e-973c-49d2-a4ec-2f210cb22e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:49.371725 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f4a28-4b43-49e3-b4f4-1f2cd0b2eeb3 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:49.384394 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9849c9-e656-4a7b-a420-095c55fbf41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:49.388733 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9849c9-e656-4a7b-a420-095c55fbf41f admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:49.389113 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9849c9-e656-4a7b-a420-095c55fbf41f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:49.390255 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9849c9-e656-4a7b-a420-095c55fbf41f admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:49.391074 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9849c9-e656-4a7b-a420-095c55fbf41f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:49.393599 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9849c9-e656-4a7b-a420-095c55fbf41f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:49.409029 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1117/2223] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 20:59:49.412905 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9849c9-e656-4a7b-a420-095c55fbf41f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:49.425559 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9849c9-e656-4a7b-a420-095c55fbf41f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:49.430461 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e100f9-ee9f-4892-82a1-551892f06a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:49.431128 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e100f9-ee9f-4892-82a1-551892f06a5b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:49.431410 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e100f9-ee9f-4892-82a1-551892f06a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:49.431685 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e100f9-ee9f-4892-82a1-551892f06a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:49.432374 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ee90e-973c-49d2-a4ec-2f210cb22e12 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:49.432540 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e100f9-ee9f-4892-82a1-551892f06a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:49.434302 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e100f9-ee9f-4892-82a1-551892f06a5b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:49.436771 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219db82-4691-4d63-b0e0-22bcd9ecd91b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:49.437575 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219db82-4691-4d63-b0e0-22bcd9ecd91b service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:49.437849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219db82-4691-4d63-b0e0-22bcd9ecd91b service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:49.438117 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219db82-4691-4d63-b0e0-22bcd9ecd91b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:49.447120 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1118/2224] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 20:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 20:59:49.451222 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e100f9-ee9f-4892-82a1-551892f06a5b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:49.451370 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219db82-4691-4d63-b0e0-22bcd9ecd91b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:49.452743 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219db82-4691-4d63-b0e0-22bcd9ecd91b service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:49.464770 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e100f9-ee9f-4892-82a1-551892f06a5b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:49.469254 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1107/2225] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:59:49.477792 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91cf59-60aa-45c9-bbbf-2fa743ab27ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:49.479285 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91cf59-60aa-45c9-bbbf-2fa743ab27ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:49.483279 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91cf59-60aa-45c9-bbbf-2fa743ab27ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:49.484357 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91cf59-60aa-45c9-bbbf-2fa743ab27ac admin admin] PATH_INFO: `/v3/projects/f0b302b477c74f3083d24e81cab1e6b0/users/cfb0a410005d472794586c1731f758b0/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:49.499208 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219db82-4691-4d63-b0e0-22bcd9ecd91b service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:49.508200 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91cf59-60aa-45c9-bbbf-2fa743ab27ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b302b477c74f3083d24e81cab1e6b0, user_id=cfb0a410005d472794586c1731f758b0, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:49.511783 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91cf59-60aa-45c9-bbbf-2fa743ab27ac admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:49.519112 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219db82-4691-4d63-b0e0-22bcd9ecd91b service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:49.536501 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1119/2226] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 20:59:49 2022] PUT /identity/v3/projects/f0b302b477c74f3083d24e81cab1e6b0/users/cfb0a410005d472794586c1731f758b0/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:49.547547 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61247bd-a10d-4fdb-914e-842e5962830c None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:49.547900 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61247bd-a10d-4fdb-914e-842e5962830c None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:49.549664 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61247bd-a10d-4fdb-914e-842e5962830c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:49.589446 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-f61247bd-a10d-4fdb-914e-842e5962830c None None] MFA Rules not processed for user `cfb0a410005d472794586c1731f758b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:49.591802 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-f61247bd-a10d-4fdb-914e-842e5962830c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:49.643935 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b935dc-4e8a-48aa-a4b6-403c08b414db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:49.645754 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b935dc-4e8a-48aa-a4b6-403c08b414db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:49.646052 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b935dc-4e8a-48aa-a4b6-403c08b414db admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:49.646587 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b935dc-4e8a-48aa-a4b6-403c08b414db admin admin] PATH_INFO: `/v3/users/3bc070dd79d14eb19fea95bf26675339` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:49.648820 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b935dc-4e8a-48aa-a4b6-403c08b414db admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bc070dd79d14eb19fea95bf26675339)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:49.651674 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b935dc-4e8a-48aa-a4b6-403c08b414db admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:49.768085 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1120/2227] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:49.768085 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61247bd-a10d-4fdb-914e-842e5962830c None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:49.768310 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a0b935dc-4e8a-48aa-a4b6-403c08b414db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bc070dd79d14eb19fea95bf26675339'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:49.791619 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a0b935dc-4e8a-48aa-a4b6-403c08b414db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bc070dd79d14eb19fea95bf26675339'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:49.832478 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a0b935dc-4e8a-48aa-a4b6-403c08b414db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bc070dd79d14eb19fea95bf26675339'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:49.833595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a0b935dc-4e8a-48aa-a4b6-403c08b414db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bc070dd79d14eb19fea95bf26675339'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:49.855408 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a0b935dc-4e8a-48aa-a4b6-403c08b414db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bc070dd79d14eb19fea95bf26675339'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:49.863900 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1108/2228] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 20:59:49 2022] DELETE /identity/v3/users/3bc070dd79d14eb19fea95bf26675339 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 20:59:49.869344 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d238c2f-b3fc-4cd4-8bb2-5f5d6cb4f158 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:49.869876 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d238c2f-b3fc-4cd4-8bb2-5f5d6cb4f158 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:49.870346 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d238c2f-b3fc-4cd4-8bb2-5f5d6cb4f158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:49.888618 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-1d238c2f-b3fc-4cd4-8bb2-5f5d6cb4f158 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:49.889872 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1d238c2f-b3fc-4cd4-8bb2-5f5d6cb4f158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:49.890089 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61247bd-a10d-4fdb-914e-842e5962830c None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:49.951825 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d55083-b33a-489a-804a-d0ebd8275be4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:49.952725 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d55083-b33a-489a-804a-d0ebd8275be4 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:49.953344 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d55083-b33a-489a-804a-d0ebd8275be4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:49.953850 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d55083-b33a-489a-804a-d0ebd8275be4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:49.956251 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-85d55083-b33a-489a-804a-d0ebd8275be4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:49.964484 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1109/2229] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:49.974500 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d238c2f-b3fc-4cd4-8bb2-5f5d6cb4f158 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:49.976274 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1d238c2f-b3fc-4cd4-8bb2-5f5d6cb4f158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:50.025789 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d55083-b33a-489a-804a-d0ebd8275be4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:50.027413 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d55083-b33a-489a-804a-d0ebd8275be4 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:50.039510 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1121/2230] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 20:59:50.047305 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d238c2f-b3fc-4cd4-8bb2-5f5d6cb4f158 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:50.051251 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f6949-fd1e-4ec2-8e5e-bf9c9472afae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:50.052572 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f6949-fd1e-4ec2-8e5e-bf9c9472afae service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:50.052854 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f6949-fd1e-4ec2-8e5e-bf9c9472afae service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:50.053127 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f6949-fd1e-4ec2-8e5e-bf9c9472afae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:50.065941 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f6949-fd1e-4ec2-8e5e-bf9c9472afae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:50.067378 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f6949-fd1e-4ec2-8e5e-bf9c9472afae service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:50.079243 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1110/2231] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 20:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 20:59:50.441261 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d55083-b33a-489a-804a-d0ebd8275be4 service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:50.443053 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-85d55083-b33a-489a-804a-d0ebd8275be4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:50.471818 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d55083-b33a-489a-804a-d0ebd8275be4 service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:50.483452 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a37f1-b31c-4cab-b619-071952319705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:50.484521 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a37f1-b31c-4cab-b619-071952319705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:50.485718 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a37f1-b31c-4cab-b619-071952319705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:50.486145 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a37f1-b31c-4cab-b619-071952319705 admin admin] PATH_INFO: `/v3/projects/b81d541d3a214ee8977dcccaa53c7bc5` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:50.489865 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a37f1-b31c-4cab-b619-071952319705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b81d541d3a214ee8977dcccaa53c7bc5)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:50.491804 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a37f1-b31c-4cab-b619-071952319705 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:50.554724 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-633a37f1-b31c-4cab-b619-071952319705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b81d541d3a214ee8977dcccaa53c7bc5', 'request_id': 'req-633a37f1-b31c-4cab-b619-071952319705'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:50.567198 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-633a37f1-b31c-4cab-b619-071952319705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b81d541d3a214ee8977dcccaa53c7bc5', 'request_id': 'req-633a37f1-b31c-4cab-b619-071952319705'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:50.574751 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-633a37f1-b31c-4cab-b619-071952319705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b81d541d3a214ee8977dcccaa53c7bc5', 'request_id': 'req-633a37f1-b31c-4cab-b619-071952319705'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:50.593182 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-633a37f1-b31c-4cab-b619-071952319705 admin admin] The token cache is being invalidate because project b81d541d3a214ee8977dcccaa53c7bc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 20:59:50.594028 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-633a37f1-b31c-4cab-b619-071952319705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:50.594912 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-633a37f1-b31c-4cab-b619-071952319705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 20:59:50.601603 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1122/2232] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 20:59:50 2022] DELETE /identity/v3/projects/b81d541d3a214ee8977dcccaa53c7bc5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 20:59:51.572122 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b61cc-5bd4-4a37-9cf7-c8dda862ab09 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:51.573196 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b61cc-5bd4-4a37-9cf7-c8dda862ab09 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:51.573545 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b61cc-5bd4-4a37-9cf7-c8dda862ab09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:51.593278 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-0f5b61cc-5bd4-4a37-9cf7-c8dda862ab09 None None] MFA Rules not processed for user `cfb0a410005d472794586c1731f758b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:51.594522 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0f5b61cc-5bd4-4a37-9cf7-c8dda862ab09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:51.654451 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1111/2233] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:53.610008 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210b66f-c679-4264-b39f-a6b620446247 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:53.610558 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210b66f-c679-4264-b39f-a6b620446247 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:53.610660 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210b66f-c679-4264-b39f-a6b620446247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:53.629554 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-8210b66f-c679-4264-b39f-a6b620446247 None None] MFA Rules not processed for user `468e74b162cb4a3e9da8d584e9b6bc42`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:53.630804 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-8210b66f-c679-4264-b39f-a6b620446247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:53.694675 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1123/2234] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 20:59:56.574399 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a67756-1292-4a82-bb17-4ab24427629e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:56.574928 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a67756-1292-4a82-bb17-4ab24427629e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:56.577842 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a67756-1292-4a82-bb17-4ab24427629e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:56.596018 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-01a67756-1292-4a82-bb17-4ab24427629e None None] MFA Rules not processed for user `de790a1a69994f7498834ded10480e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:56.597314 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-01a67756-1292-4a82-bb17-4ab24427629e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:56.652348 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1112/2235] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 10 20:59:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 20:59:56.664737 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210b66f-c679-4264-b39f-a6b620446247 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 20:59:56.666279 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-8210b66f-c679-4264-b39f-a6b620446247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:56.737219 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210b66f-c679-4264-b39f-a6b620446247 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 20:59:56.743414 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7016d0-71a4-4322-aa77-54be0878c317 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f09689635e54a4e85c0ef0e3539d911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 20:59:56.744083 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7016d0-71a4-4322-aa77-54be0878c317 service swift] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:56.744317 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7016d0-71a4-4322-aa77-54be0878c317 service swift] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:56.744664 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7016d0-71a4-4322-aa77-54be0878c317 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:56.761082 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7016d0-71a4-4322-aa77-54be0878c317 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 20:59:56.762754 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7016d0-71a4-4322-aa77-54be0878c317 service swift] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 20:59:56.771209 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1124/2236] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 10 20:59:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 20:59:56.818531 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b8cde-b724-43c4-b86c-207f68c332a5 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 20:59:56.818812 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b8cde-b724-43c4-b86c-207f68c332a5 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 20:59:56.819205 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b8cde-b724-43c4-b86c-207f68c332a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 20:59:56.843069 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-d59b8cde-b724-43c4-b86c-207f68c332a5 None None] MFA Rules not processed for user `1777d21da1ed4a3dbabb518172121e31`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 20:59:56.844501 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d59b8cde-b724-43c4-b86c-207f68c332a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 20:59:56.927867 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1113/2237] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 20:59:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:00:26.233484 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76239a6-d5d3-4289-8841-8334be26a4d3 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:26.234056 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76239a6-d5d3-4289-8841-8334be26a4d3 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:26.234056 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76239a6-d5d3-4289-8841-8334be26a4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:26.251619 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-b76239a6-d5d3-4289-8841-8334be26a4d3 None None] MFA Rules not processed for user `de790a1a69994f7498834ded10480e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:00:26.252810 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b76239a6-d5d3-4289-8841-8334be26a4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:00:26.260201 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1125/2238] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 10 21:00:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:00:26.272017 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b8cde-b724-43c4-b86c-207f68c332a5 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:00:26.283954 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b8cde-b724-43c4-b86c-207f68c332a5 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:00:26.289488 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2f602-d5e2-4210-94d4-82d2bbe012ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f09689635e54a4e85c0ef0e3539d911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:00:26.290225 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2f602-d5e2-4210-94d4-82d2bbe012ff service swift] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:26.290565 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2f602-d5e2-4210-94d4-82d2bbe012ff service swift] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:26.290898 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2f602-d5e2-4210-94d4-82d2bbe012ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:26.299221 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2f602-d5e2-4210-94d4-82d2bbe012ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:00:26.301095 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2f602-d5e2-4210-94d4-82d2bbe012ff service swift] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:00:26.312125 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1114/2239] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 10 21:00:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 21:00:26.758545 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e04792-3282-4be7-bdbf-c957b851acbd None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:26.759044 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e04792-3282-4be7-bdbf-c957b851acbd None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:26.759551 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e04792-3282-4be7-bdbf-c957b851acbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:26.780603 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-87e04792-3282-4be7-bdbf-c957b851acbd None None] MFA Rules not processed for user `1777d21da1ed4a3dbabb518172121e31`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:00:26.781834 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-87e04792-3282-4be7-bdbf-c957b851acbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:00:26.790886 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1126/2240] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:00:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:00:26.872800 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9705e-d7f2-4b47-b3ac-201bc728061e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:26.873089 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9705e-d7f2-4b47-b3ac-201bc728061e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:26.873377 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9705e-d7f2-4b47-b3ac-201bc728061e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:26.891623 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e6a9705e-d7f2-4b47-b3ac-201bc728061e None None] MFA Rules not processed for user `de790a1a69994f7498834ded10480e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:00:26.892986 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e6a9705e-d7f2-4b47-b3ac-201bc728061e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:00:26.900335 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1115/2241] 10.222.0.31 () {58 vars in 967 bytes} [Thu Feb 10 21:00:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:00:26.913949 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e04792-3282-4be7-bdbf-c957b851acbd None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:00:26.925403 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e04792-3282-4be7-bdbf-c957b851acbd None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:00:26.930652 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e218f28-563a-4f27-82ff-d36d9e70e747 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f09689635e54a4e85c0ef0e3539d911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:00:26.931440 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e218f28-563a-4f27-82ff-d36d9e70e747 service swift] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:26.931713 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e218f28-563a-4f27-82ff-d36d9e70e747 service swift] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:26.931989 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e218f28-563a-4f27-82ff-d36d9e70e747 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:26.940362 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e218f28-563a-4f27-82ff-d36d9e70e747 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:00:26.942020 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e218f28-563a-4f27-82ff-d36d9e70e747 service swift] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:00:26.949962 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1127/2242] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 10 21:00:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 21:00:27.184035 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a91a6f-eea2-4b14-865c-c962f9a51e32 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:27.184394 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a91a6f-eea2-4b14-865c-c962f9a51e32 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:27.184731 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a91a6f-eea2-4b14-865c-c962f9a51e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:27.203057 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-65a91a6f-eea2-4b14-865c-c962f9a51e32 None None] MFA Rules not processed for user `de790a1a69994f7498834ded10480e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:00:27.204341 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-65a91a6f-eea2-4b14-865c-c962f9a51e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:00:27.212428 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1116/2243] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 10 21:00:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:00:27.224970 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e218f28-563a-4f27-82ff-d36d9e70e747 service swift] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:00:27.235275 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e218f28-563a-4f27-82ff-d36d9e70e747 service swift] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:00:27.240598 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be87434-44d9-4259-af21-2a1f2775c021 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f09689635e54a4e85c0ef0e3539d911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:00:27.241231 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be87434-44d9-4259-af21-2a1f2775c021 service swift] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:27.241552 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be87434-44d9-4259-af21-2a1f2775c021 service swift] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:27.241810 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be87434-44d9-4259-af21-2a1f2775c021 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:27.249974 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be87434-44d9-4259-af21-2a1f2775c021 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:00:27.251553 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be87434-44d9-4259-af21-2a1f2775c021 service swift] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:00:27.259468 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1128/2244] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 10 21:00:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 21:00:27.618904 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c26198-4ca1-4218-9649-ccb643a515f9 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:27.619362 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c26198-4ca1-4218-9649-ccb643a515f9 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:27.619516 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c26198-4ca1-4218-9649-ccb643a515f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:27.638615 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-57c26198-4ca1-4218-9649-ccb643a515f9 None None] MFA Rules not processed for user `de790a1a69994f7498834ded10480e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:00:27.639821 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-57c26198-4ca1-4218-9649-ccb643a515f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:00:27.647255 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1117/2245] 10.222.0.31 () {58 vars in 967 bytes} [Thu Feb 10 21:00:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 21:00:27.660245 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be87434-44d9-4259-af21-2a1f2775c021 service swift] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:00:27.673929 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be87434-44d9-4259-af21-2a1f2775c021 service swift] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:00:27.679435 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa94ea-865c-4e5a-bc8c-0cb569a36e90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f09689635e54a4e85c0ef0e3539d911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:00:27.680081 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa94ea-865c-4e5a-bc8c-0cb569a36e90 service swift] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:27.680357 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa94ea-865c-4e5a-bc8c-0cb569a36e90 service swift] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:27.680646 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa94ea-865c-4e5a-bc8c-0cb569a36e90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:27.688850 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa94ea-865c-4e5a-bc8c-0cb569a36e90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:00:27.690442 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa94ea-865c-4e5a-bc8c-0cb569a36e90 service swift] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:00:27.700318 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1129/2246] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 10 21:00:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 21:00:29.957203 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c26198-4ca1-4218-9649-ccb643a515f9 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:00:29.958941 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-57c26198-4ca1-4218-9649-ccb643a515f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:00:30.029228 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c26198-4ca1-4218-9649-ccb643a515f9 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:00:30.034592 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c693f6f-c052-4ef8-b75c-e8bdc8eb2ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:00:30.035454 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c693f6f-c052-4ef8-b75c-e8bdc8eb2ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:30.035727 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c693f6f-c052-4ef8-b75c-e8bdc8eb2ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:30.036340 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c693f6f-c052-4ef8-b75c-e8bdc8eb2ea9 admin admin] PATH_INFO: `/v3/users/cfb0a410005d472794586c1731f758b0` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:30.037596 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c693f6f-c052-4ef8-b75c-e8bdc8eb2ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb0a410005d472794586c1731f758b0)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:00:30.039494 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c693f6f-c052-4ef8-b75c-e8bdc8eb2ea9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:00:30.087551 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3c693f6f-c052-4ef8-b75c-e8bdc8eb2ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb0a410005d472794586c1731f758b0'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:00:30.094854 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3c693f6f-c052-4ef8-b75c-e8bdc8eb2ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb0a410005d472794586c1731f758b0'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:00:30.111733 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3c693f6f-c052-4ef8-b75c-e8bdc8eb2ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb0a410005d472794586c1731f758b0'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:00:30.112659 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3c693f6f-c052-4ef8-b75c-e8bdc8eb2ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb0a410005d472794586c1731f758b0'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:00:30.121431 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3c693f6f-c052-4ef8-b75c-e8bdc8eb2ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb0a410005d472794586c1731f758b0'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:00:30.128134 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1118/2247] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:00:29 2022] DELETE /identity/v3/users/cfb0a410005d472794586c1731f758b0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:00:30.132739 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6845ed-39c9-4384-aed9-e00effbc2f9f None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:30.133282 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6845ed-39c9-4384-aed9-e00effbc2f9f None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:30.133463 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6845ed-39c9-4384-aed9-e00effbc2f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:30.164090 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-1c6845ed-39c9-4384-aed9-e00effbc2f9f None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:00:30.165517 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-1c6845ed-39c9-4384-aed9-e00effbc2f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:00:30.229984 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1130/2248] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:00:30.239300 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c693f6f-c052-4ef8-b75c-e8bdc8eb2ea9 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:00:30.240702 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3c693f6f-c052-4ef8-b75c-e8bdc8eb2ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:00:30.295299 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c693f6f-c052-4ef8-b75c-e8bdc8eb2ea9 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:00:30.298840 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd91242-4026-4606-9133-9f6f755813eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:00:30.299478 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd91242-4026-4606-9133-9f6f755813eb service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:30.299752 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd91242-4026-4606-9133-9f6f755813eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:30.300019 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd91242-4026-4606-9133-9f6f755813eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:30.309472 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd91242-4026-4606-9133-9f6f755813eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:00:30.310877 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd91242-4026-4606-9133-9f6f755813eb service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:00:30.320655 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1119/2249] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:00:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:00:30.655052 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6845ed-39c9-4384-aed9-e00effbc2f9f None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:00:30.656705 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-1c6845ed-39c9-4384-aed9-e00effbc2f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:00:30.672861 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6845ed-39c9-4384-aed9-e00effbc2f9f None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:00:30.678975 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15dd52-081a-450b-91d1-fbd1eccb082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:00:30.679949 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15dd52-081a-450b-91d1-fbd1eccb082a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:30.680287 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15dd52-081a-450b-91d1-fbd1eccb082a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:30.680585 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15dd52-081a-450b-91d1-fbd1eccb082a admin admin] PATH_INFO: `/v3/projects/f0b302b477c74f3083d24e81cab1e6b0` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:30.682086 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15dd52-081a-450b-91d1-fbd1eccb082a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b302b477c74f3083d24e81cab1e6b0)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:00:30.684175 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15dd52-081a-450b-91d1-fbd1eccb082a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:00:30.732991 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-be15dd52-081a-450b-91d1-fbd1eccb082a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b302b477c74f3083d24e81cab1e6b0', 'request_id': 'req-be15dd52-081a-450b-91d1-fbd1eccb082a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:00:30.740708 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-be15dd52-081a-450b-91d1-fbd1eccb082a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b302b477c74f3083d24e81cab1e6b0', 'request_id': 'req-be15dd52-081a-450b-91d1-fbd1eccb082a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:00:30.747601 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-be15dd52-081a-450b-91d1-fbd1eccb082a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b302b477c74f3083d24e81cab1e6b0', 'request_id': 'req-be15dd52-081a-450b-91d1-fbd1eccb082a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:00:30.763339 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-be15dd52-081a-450b-91d1-fbd1eccb082a admin admin] The token cache is being invalidate because project f0b302b477c74f3083d24e81cab1e6b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:00:30.763618 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-be15dd52-081a-450b-91d1-fbd1eccb082a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:00:30.764227 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-be15dd52-081a-450b-91d1-fbd1eccb082a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:00:30.765801 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1131/2250] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:00:30 2022] DELETE /identity/v3/projects/f0b302b477c74f3083d24e81cab1e6b0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:00:30.770922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba344ec-573b-4900-9e2c-ba27770b6a30 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:30.771216 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba344ec-573b-4900-9e2c-ba27770b6a30 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:30.771489 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba344ec-573b-4900-9e2c-ba27770b6a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:30.789296 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-aba344ec-573b-4900-9e2c-ba27770b6a30 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:00:30.790552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-aba344ec-573b-4900-9e2c-ba27770b6a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:00:30.857042 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1120/2251] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:00:30.862869 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30577e-321e-42cb-8ff4-89204223d365 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:30.863155 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30577e-321e-42cb-8ff4-89204223d365 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:30.863428 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30577e-321e-42cb-8ff4-89204223d365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:30.881491 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-5d30577e-321e-42cb-8ff4-89204223d365 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:00:30.882685 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-5d30577e-321e-42cb-8ff4-89204223d365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:00:30.891081 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1132/2252] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:00:30.895393 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba344ec-573b-4900-9e2c-ba27770b6a30 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:00:30.905212 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba344ec-573b-4900-9e2c-ba27770b6a30 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:00:30.909911 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010e32e-dd0e-4f52-a458-6401c9e7514e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:00:30.910591 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010e32e-dd0e-4f52-a458-6401c9e7514e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:30.911332 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010e32e-dd0e-4f52-a458-6401c9e7514e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:30.911749 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010e32e-dd0e-4f52-a458-6401c9e7514e admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:30.912474 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010e32e-dd0e-4f52-a458-6401c9e7514e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:00:30.912803 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010e32e-dd0e-4f52-a458-6401c9e7514e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:00:30.914404 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010e32e-dd0e-4f52-a458-6401c9e7514e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:00:30.926418 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1121/2253] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:00:30.930789 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30577e-321e-42cb-8ff4-89204223d365 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:00:30.941633 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30577e-321e-42cb-8ff4-89204223d365 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:00:30.947080 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e5525-e7cb-499c-ae8a-1da0412d7521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:00:30.947782 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e5525-e7cb-499c-ae8a-1da0412d7521 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:30.948062 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e5525-e7cb-499c-ae8a-1da0412d7521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:30.948334 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e5525-e7cb-499c-ae8a-1da0412d7521 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:30.949042 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e5525-e7cb-499c-ae8a-1da0412d7521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:00:30.951086 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e5525-e7cb-499c-ae8a-1da0412d7521 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:00:30.980671 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1133/2254] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:00:30 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:00:30.982014 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010e32e-dd0e-4f52-a458-6401c9e7514e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:00:30.992499 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010e32e-dd0e-4f52-a458-6401c9e7514e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:00:31.052049 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe38ba9-f3b0-47cd-8f5b-1a00c6c42dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:00:31.052718 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe38ba9-f3b0-47cd-8f5b-1a00c6c42dfc admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:31.052997 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe38ba9-f3b0-47cd-8f5b-1a00c6c42dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:31.053402 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe38ba9-f3b0-47cd-8f5b-1a00c6c42dfc admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:31.054147 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe38ba9-f3b0-47cd-8f5b-1a00c6c42dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:00:31.056018 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe38ba9-f3b0-47cd-8f5b-1a00c6c42dfc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:00:31.075933 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1122/2255] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:00:30 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:00:31.080002 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e5525-e7cb-499c-ae8a-1da0412d7521 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:00:31.091561 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e5525-e7cb-499c-ae8a-1da0412d7521 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:00:31.096242 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f1b54-42b8-4231-9414-93fcc79b4330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:00:31.097002 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f1b54-42b8-4231-9414-93fcc79b4330 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:31.097322 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f1b54-42b8-4231-9414-93fcc79b4330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:31.097750 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f1b54-42b8-4231-9414-93fcc79b4330 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:31.098555 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f1b54-42b8-4231-9414-93fcc79b4330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:00:31.100232 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f1b54-42b8-4231-9414-93fcc79b4330 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:00:31.110603 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1134/2256] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:00:31.114603 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe38ba9-f3b0-47cd-8f5b-1a00c6c42dfc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:00:31.125181 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe38ba9-f3b0-47cd-8f5b-1a00c6c42dfc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:00:31.130649 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2f3c3-6cc9-461f-baa7-9421d6e78e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:00:31.131594 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2f3c3-6cc9-461f-baa7-9421d6e78e99 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:31.132055 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2f3c3-6cc9-461f-baa7-9421d6e78e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:31.132544 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2f3c3-6cc9-461f-baa7-9421d6e78e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:31.133621 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2f3c3-6cc9-461f-baa7-9421d6e78e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:00:31.135212 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2f3c3-6cc9-461f-baa7-9421d6e78e99 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:00:31.145915 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1123/2257] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:00:31.150287 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f1b54-42b8-4231-9414-93fcc79b4330 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:00:31.166106 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f1b54-42b8-4231-9414-93fcc79b4330 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:00:31.171711 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ac270-c903-4341-abb7-e7ad13c30dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:00:31.173094 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ac270-c903-4341-abb7-e7ad13c30dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:31.173674 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ac270-c903-4341-abb7-e7ad13c30dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:31.174264 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ac270-c903-4341-abb7-e7ad13c30dd4 admin admin] PATH_INFO: `/v3/projects/37a3444e46804fe1ae16e69d4af79680/users/13621ec744b5471893e19189f67e77eb/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:31.189763 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ac270-c903-4341-abb7-e7ad13c30dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a3444e46804fe1ae16e69d4af79680, user_id=13621ec744b5471893e19189f67e77eb, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:00:31.192402 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ac270-c903-4341-abb7-e7ad13c30dd4 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:00:31.208811 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1135/2258] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:00:31 2022] PUT /identity/v3/projects/37a3444e46804fe1ae16e69d4af79680/users/13621ec744b5471893e19189f67e77eb/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:00:31.214018 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69572cfa-ae98-4c4a-bb64-d789a7bf36cf None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:31.214366 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69572cfa-ae98-4c4a-bb64-d789a7bf36cf None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:31.214645 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69572cfa-ae98-4c4a-bb64-d789a7bf36cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:31.232799 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-69572cfa-ae98-4c4a-bb64-d789a7bf36cf None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:00:31.234045 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-69572cfa-ae98-4c4a-bb64-d789a7bf36cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:00:31.292481 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1124/2259] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:00:31.302455 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ac270-c903-4341-abb7-e7ad13c30dd4 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:00:31.308672 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b55ac270-c903-4341-abb7-e7ad13c30dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:00:31.367629 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ac270-c903-4341-abb7-e7ad13c30dd4 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:00:31.371304 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2dfb8f-df02-4693-9311-4f71cd090339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:00:31.371995 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2dfb8f-df02-4693-9311-4f71cd090339 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:31.372268 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2dfb8f-df02-4693-9311-4f71cd090339 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:31.372534 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2dfb8f-df02-4693-9311-4f71cd090339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:31.381486 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2dfb8f-df02-4693-9311-4f71cd090339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:00:31.382915 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2dfb8f-df02-4693-9311-4f71cd090339 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:00:31.392253 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1136/2260] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:00:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:00:31.985650 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db41f27-849d-40e1-8b4f-e0d4bbc76ca5 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:31.986171 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db41f27-849d-40e1-8b4f-e0d4bbc76ca5 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:31.986280 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db41f27-849d-40e1-8b4f-e0d4bbc76ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:32.013415 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-3db41f27-849d-40e1-8b4f-e0d4bbc76ca5 None None] MFA Rules not processed for user `13621ec744b5471893e19189f67e77eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:00:32.014721 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3db41f27-849d-40e1-8b4f-e0d4bbc76ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:00:32.085527 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1125/2261] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:00:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:00:32.092541 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2dfb8f-df02-4693-9311-4f71cd090339 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:00:32.096691 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ba2dfb8f-df02-4693-9311-4f71cd090339 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:00:32.151714 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2dfb8f-df02-4693-9311-4f71cd090339 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:00:32.155739 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b282d3e-56f4-4103-b16a-d9fc8743ca5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:00:32.156525 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b282d3e-56f4-4103-b16a-d9fc8743ca5f service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:32.156871 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b282d3e-56f4-4103-b16a-d9fc8743ca5f service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:32.157213 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b282d3e-56f4-4103-b16a-d9fc8743ca5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:32.166535 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b282d3e-56f4-4103-b16a-d9fc8743ca5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:00:32.168036 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b282d3e-56f4-4103-b16a-d9fc8743ca5f service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:00:32.177055 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1137/2262] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:00:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:00:33.534474 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd3c7f-60c8-4fa8-91e8-11978c519941 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:33.535048 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd3c7f-60c8-4fa8-91e8-11978c519941 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:33.535048 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd3c7f-60c8-4fa8-91e8-11978c519941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:33.555875 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-9ecd3c7f-60c8-4fa8-91e8-11978c519941 None None] MFA Rules not processed for user `13621ec744b5471893e19189f67e77eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:00:33.557070 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9ecd3c7f-60c8-4fa8-91e8-11978c519941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:00:33.564037 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1126/2263] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:00:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:00:36.097099 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b282d3e-56f4-4103-b16a-d9fc8743ca5f service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:00:36.107583 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b282d3e-56f4-4103-b16a-d9fc8743ca5f service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:00:36.111394 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ed7da-6389-448a-830d-d206e50da0a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:00:36.112027 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ed7da-6389-448a-830d-d206e50da0a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:36.112296 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ed7da-6389-448a-830d-d206e50da0a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:36.112561 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ed7da-6389-448a-830d-d206e50da0a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:36.114450 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-494ed7da-6389-448a-830d-d206e50da0a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:00:36.217017 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ed7da-6389-448a-830d-d206e50da0a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:00:36.219067 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ed7da-6389-448a-830d-d206e50da0a9 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:00:36.232101 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1138/2264] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:00:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:00:59.478093 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd0445-e48f-47e2-bc64-02bf70eff850 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:00:59.478713 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd0445-e48f-47e2-bc64-02bf70eff850 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:00:59.478713 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd0445-e48f-47e2-bc64-02bf70eff850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:00:59.505493 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-cfbd0445-e48f-47e2-bc64-02bf70eff850 None None] MFA Rules not processed for user `1777d21da1ed4a3dbabb518172121e31`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:00:59.506662 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-cfbd0445-e48f-47e2-bc64-02bf70eff850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:00:59.583063 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1127/2265] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:00:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:06.394411 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0317e7-8482-4615-bd72-3e6c0e0defb4 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:06.394910 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0317e7-8482-4615-bd72-3e6c0e0defb4 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:06.395003 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0317e7-8482-4615-bd72-3e6c0e0defb4 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:06.396756 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1139/2266] 10.222.0.31 () {54 vars in 960 bytes} [Thu Feb 10 21:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 21:01:06.402210 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfec827-3fbd-421a-95ac-b87667a2f4c4 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:06.403035 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfec827-3fbd-421a-95ac-b87667a2f4c4 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:06.403134 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfec827-3fbd-421a-95ac-b87667a2f4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:06.474080 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-9cfec827-3fbd-421a-95ac-b87667a2f4c4 None None] MFA Rules not processed for user `9f05eb88abe24af4825259712b497d48`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:06.475309 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9cfec827-3fbd-421a-95ac-b87667a2f4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:06.583838 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1128/2267] 10.222.0.31 () {58 vars in 1057 bytes} [Thu Feb 10 21:01:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:06.591912 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0317e7-8482-4615-bd72-3e6c0e0defb4 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:06.611984 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0317e7-8482-4615-bd72-3e6c0e0defb4 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:06.618471 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2eb9b-5c77-49a8-8af4-57c1c554dc6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f05eb88abe24af4825259712b497d48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:06.619127 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2eb9b-5c77-49a8-8af4-57c1c554dc6d service placement] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:06.619434 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2eb9b-5c77-49a8-8af4-57c1c554dc6d service placement] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:06.619703 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2eb9b-5c77-49a8-8af4-57c1c554dc6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:06.622929 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-90e2eb9b-5c77-49a8-8af4-57c1c554dc6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:06.641991 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2eb9b-5c77-49a8-8af4-57c1c554dc6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:06.643971 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2eb9b-5c77-49a8-8af4-57c1c554dc6d service placement] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:06.672319 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1140/2268] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:01:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 21:01:09.923704 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f88b94-22e2-401c-919c-c2bcb89c10fe None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:09.924240 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f88b94-22e2-401c-919c-c2bcb89c10fe None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:09.924240 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f88b94-22e2-401c-919c-c2bcb89c10fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:09.942932 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-20f88b94-22e2-401c-919c-c2bcb89c10fe None None] MFA Rules not processed for user `de790a1a69994f7498834ded10480e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:09.944302 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-20f88b94-22e2-401c-919c-c2bcb89c10fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:09.997141 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1129/2269] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 10 21:01:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:10.021150 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2eb9b-5c77-49a8-8af4-57c1c554dc6d service placement] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:10.022721 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-90e2eb9b-5c77-49a8-8af4-57c1c554dc6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:10.100345 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2eb9b-5c77-49a8-8af4-57c1c554dc6d service placement] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:10.106657 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dace2-731e-4956-a0b2-13d0797d9250 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f09689635e54a4e85c0ef0e3539d911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:10.107567 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dace2-731e-4956-a0b2-13d0797d9250 service swift] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:10.107965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dace2-731e-4956-a0b2-13d0797d9250 service swift] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:10.108356 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dace2-731e-4956-a0b2-13d0797d9250 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:10.117739 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dace2-731e-4956-a0b2-13d0797d9250 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:10.119318 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dace2-731e-4956-a0b2-13d0797d9250 service swift] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:10.135039 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1141/2270] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 10 21:01:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 21:01:23.376605 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f88b94-22e2-401c-919c-c2bcb89c10fe None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:23.378457 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-20f88b94-22e2-401c-919c-c2bcb89c10fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:23.436202 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f88b94-22e2-401c-919c-c2bcb89c10fe None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:23.441086 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f970b5-07ad-4576-86ab-27edb779cc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:23.442344 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f970b5-07ad-4576-86ab-27edb779cc0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:23.442858 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f970b5-07ad-4576-86ab-27edb779cc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:23.443325 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f970b5-07ad-4576-86ab-27edb779cc0d admin admin] PATH_INFO: `/v3/users/edce3021d9e841b3b13c24b5a3c3c425` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:23.445022 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f970b5-07ad-4576-86ab-27edb779cc0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=edce3021d9e841b3b13c24b5a3c3c425)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:23.446852 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f970b5-07ad-4576-86ab-27edb779cc0d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:23.497692 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c9f970b5-07ad-4576-86ab-27edb779cc0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edce3021d9e841b3b13c24b5a3c3c425'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:23.504348 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c9f970b5-07ad-4576-86ab-27edb779cc0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edce3021d9e841b3b13c24b5a3c3c425'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:23.517203 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c9f970b5-07ad-4576-86ab-27edb779cc0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edce3021d9e841b3b13c24b5a3c3c425'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:23.517989 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c9f970b5-07ad-4576-86ab-27edb779cc0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edce3021d9e841b3b13c24b5a3c3c425'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:23.532494 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c9f970b5-07ad-4576-86ab-27edb779cc0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edce3021d9e841b3b13c24b5a3c3c425'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:23.542932 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1130/2271] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:01:23 2022] DELETE /identity/v3/users/edce3021d9e841b3b13c24b5a3c3c425 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:23.736943 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dace2-731e-4956-a0b2-13d0797d9250 service swift] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:23.749780 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dace2-731e-4956-a0b2-13d0797d9250 service swift] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:23.830787 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac54afe-1aeb-49af-9cb6-f893f1b5966c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:23.831737 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac54afe-1aeb-49af-9cb6-f893f1b5966c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:23.832013 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac54afe-1aeb-49af-9cb6-f893f1b5966c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:23.832282 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac54afe-1aeb-49af-9cb6-f893f1b5966c admin admin] PATH_INFO: `/v3/projects/75c08e9ba79542bba3caac45c257d1da` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:23.834164 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac54afe-1aeb-49af-9cb6-f893f1b5966c admin admin] RBAC: Authorizing `identity:delete_project(project_id=75c08e9ba79542bba3caac45c257d1da)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:23.836143 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac54afe-1aeb-49af-9cb6-f893f1b5966c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:23.881894 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2ac54afe-1aeb-49af-9cb6-f893f1b5966c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75c08e9ba79542bba3caac45c257d1da', 'request_id': 'req-2ac54afe-1aeb-49af-9cb6-f893f1b5966c'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:23.887483 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2ac54afe-1aeb-49af-9cb6-f893f1b5966c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75c08e9ba79542bba3caac45c257d1da', 'request_id': 'req-2ac54afe-1aeb-49af-9cb6-f893f1b5966c'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:23.893540 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2ac54afe-1aeb-49af-9cb6-f893f1b5966c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75c08e9ba79542bba3caac45c257d1da', 'request_id': 'req-2ac54afe-1aeb-49af-9cb6-f893f1b5966c'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:23.907035 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2ac54afe-1aeb-49af-9cb6-f893f1b5966c admin admin] The token cache is being invalidate because project 75c08e9ba79542bba3caac45c257d1da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:01:23.907303 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2ac54afe-1aeb-49af-9cb6-f893f1b5966c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:23.907911 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2ac54afe-1aeb-49af-9cb6-f893f1b5966c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:23.909761 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1142/2272] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:01:23 2022] DELETE /identity/v3/projects/75c08e9ba79542bba3caac45c257d1da => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:23.914506 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76aa42-4f64-4780-bdde-d697e1f98852 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:23.914894 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76aa42-4f64-4780-bdde-d697e1f98852 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:23.915064 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76aa42-4f64-4780-bdde-d697e1f98852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:23.963122 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-da76aa42-4f64-4780-bdde-d697e1f98852 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:23.964312 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-da76aa42-4f64-4780-bdde-d697e1f98852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:24.029821 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1131/2273] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 21:01:24.037554 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41334a-2eae-403a-8ea2-ea1f7439d505 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:24.037840 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41334a-2eae-403a-8ea2-ea1f7439d505 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:24.038111 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41334a-2eae-403a-8ea2-ea1f7439d505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:24.057837 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-2c41334a-2eae-403a-8ea2-ea1f7439d505 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:24.066320 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-2c41334a-2eae-403a-8ea2-ea1f7439d505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:24.067225 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1143/2274] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:24.071412 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76aa42-4f64-4780-bdde-d697e1f98852 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:24.080956 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76aa42-4f64-4780-bdde-d697e1f98852 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:24.085519 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8fe30-898c-40c0-8b7d-11c80877917b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:24.086193 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8fe30-898c-40c0-8b7d-11c80877917b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:24.086468 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8fe30-898c-40c0-8b7d-11c80877917b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:24.086738 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8fe30-898c-40c0-8b7d-11c80877917b admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:24.087493 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8fe30-898c-40c0-8b7d-11c80877917b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:01:24.087799 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8fe30-898c-40c0-8b7d-11c80877917b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:24.089412 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8fe30-898c-40c0-8b7d-11c80877917b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:24.101163 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1132/2275] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:01:24.105581 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41334a-2eae-403a-8ea2-ea1f7439d505 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:24.114792 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41334a-2eae-403a-8ea2-ea1f7439d505 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:24.119450 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db925d7-8aa9-4bab-be24-25011da25faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:24.120180 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db925d7-8aa9-4bab-be24-25011da25faf admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:24.120384 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db925d7-8aa9-4bab-be24-25011da25faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:24.120652 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db925d7-8aa9-4bab-be24-25011da25faf admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:24.121600 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db925d7-8aa9-4bab-be24-25011da25faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:24.123539 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db925d7-8aa9-4bab-be24-25011da25faf admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:24.153229 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1144/2276] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:01:24 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:01:24.157705 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8fe30-898c-40c0-8b7d-11c80877917b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:24.167745 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8fe30-898c-40c0-8b7d-11c80877917b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:24.227234 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661c8cc-21a0-403d-a7aa-68728c2cb7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:24.227922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661c8cc-21a0-403d-a7aa-68728c2cb7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:24.228197 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661c8cc-21a0-403d-a7aa-68728c2cb7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:24.228465 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661c8cc-21a0-403d-a7aa-68728c2cb7f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:24.229163 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661c8cc-21a0-403d-a7aa-68728c2cb7f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:24.231236 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661c8cc-21a0-403d-a7aa-68728c2cb7f8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:24.252917 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1133/2277] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:01:24 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:01:24.256900 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db925d7-8aa9-4bab-be24-25011da25faf admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:24.267256 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db925d7-8aa9-4bab-be24-25011da25faf admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:24.271999 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e42ab7-6624-4858-8685-f88d4df1430d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:24.272442 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e42ab7-6624-4858-8685-f88d4df1430d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:24.272729 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e42ab7-6624-4858-8685-f88d4df1430d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:24.273385 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e42ab7-6624-4858-8685-f88d4df1430d admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:24.274173 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e42ab7-6624-4858-8685-f88d4df1430d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:24.275806 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e42ab7-6624-4858-8685-f88d4df1430d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:24.287305 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1145/2278] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:01:24.291541 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661c8cc-21a0-403d-a7aa-68728c2cb7f8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:24.301966 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661c8cc-21a0-403d-a7aa-68728c2cb7f8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:24.306610 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6431d-a652-4334-a5fa-2bf1720ff656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:24.307267 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6431d-a652-4334-a5fa-2bf1720ff656 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:24.307543 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6431d-a652-4334-a5fa-2bf1720ff656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:24.307810 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6431d-a652-4334-a5fa-2bf1720ff656 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:24.308540 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6431d-a652-4334-a5fa-2bf1720ff656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:24.310232 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6431d-a652-4334-a5fa-2bf1720ff656 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:24.320210 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1134/2279] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:01:24.326871 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e42ab7-6624-4858-8685-f88d4df1430d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:24.337115 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e42ab7-6624-4858-8685-f88d4df1430d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:24.341833 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aabb59-743c-4403-b4d7-f2ffec5a2e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:24.342709 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aabb59-743c-4403-b4d7-f2ffec5a2e9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:24.342980 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aabb59-743c-4403-b4d7-f2ffec5a2e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:24.343247 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aabb59-743c-4403-b4d7-f2ffec5a2e9f admin admin] PATH_INFO: `/v3/projects/b49982a4b5394c24b16bc4f6d3de4494/users/ed092c2ab3ec4955a4bcfcddefd43e31/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:24.359986 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aabb59-743c-4403-b4d7-f2ffec5a2e9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49982a4b5394c24b16bc4f6d3de4494, user_id=ed092c2ab3ec4955a4bcfcddefd43e31, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:24.362740 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aabb59-743c-4403-b4d7-f2ffec5a2e9f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:24.376990 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1146/2280] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:01:24 2022] PUT /identity/v3/projects/b49982a4b5394c24b16bc4f6d3de4494/users/ed092c2ab3ec4955a4bcfcddefd43e31/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 21:01:24.387277 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208c550-d85f-406d-9028-7d525f290e3e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:24.387748 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208c550-d85f-406d-9028-7d525f290e3e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:24.387863 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208c550-d85f-406d-9028-7d525f290e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:24.416792 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-d208c550-d85f-406d-9028-7d525f290e3e None None] MFA Rules not processed for user `ed092c2ab3ec4955a4bcfcddefd43e31`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:24.418240 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d208c550-d85f-406d-9028-7d525f290e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:24.484652 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1135/2281] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:24.489386 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aabb59-743c-4403-b4d7-f2ffec5a2e9f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:24.554003 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aabb59-743c-4403-b4d7-f2ffec5a2e9f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:24.559223 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca0980-b2c5-481b-a7fd-16398506645b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:24.559877 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca0980-b2c5-481b-a7fd-16398506645b admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:24.560159 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca0980-b2c5-481b-a7fd-16398506645b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:24.560430 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca0980-b2c5-481b-a7fd-16398506645b admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:24.561130 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca0980-b2c5-481b-a7fd-16398506645b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:24.563060 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca0980-b2c5-481b-a7fd-16398506645b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:24.590797 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1147/2282] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:01:24 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:01:24.594866 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208c550-d85f-406d-9028-7d525f290e3e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:24.605855 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208c550-d85f-406d-9028-7d525f290e3e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:24.661593 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cb01d-1314-43c3-927f-f4451dbc927f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:24.662258 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cb01d-1314-43c3-927f-f4451dbc927f admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:24.662537 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cb01d-1314-43c3-927f-f4451dbc927f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:24.662810 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cb01d-1314-43c3-927f-f4451dbc927f admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:24.663525 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087cb01d-1314-43c3-927f-f4451dbc927f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:24.665519 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087cb01d-1314-43c3-927f-f4451dbc927f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:24.692968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1136/2283] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:01:24 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:01:24.698967 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca0980-b2c5-481b-a7fd-16398506645b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:24.710236 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca0980-b2c5-481b-a7fd-16398506645b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:24.715787 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34951194-dbe4-4e05-8f79-ec62387b9c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:24.716443 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34951194-dbe4-4e05-8f79-ec62387b9c24 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:24.716753 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34951194-dbe4-4e05-8f79-ec62387b9c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:24.716995 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34951194-dbe4-4e05-8f79-ec62387b9c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:24.717973 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34951194-dbe4-4e05-8f79-ec62387b9c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:24.719677 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34951194-dbe4-4e05-8f79-ec62387b9c24 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:24.731456 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1148/2284] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:01:24.735754 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cb01d-1314-43c3-927f-f4451dbc927f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:24.747010 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cb01d-1314-43c3-927f-f4451dbc927f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:24.752840 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cca6e-d66d-40da-8a6a-cd4559ecf76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:24.753752 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cca6e-d66d-40da-8a6a-cd4559ecf76b admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:24.754024 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cca6e-d66d-40da-8a6a-cd4559ecf76b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:24.754312 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cca6e-d66d-40da-8a6a-cd4559ecf76b admin admin] PATH_INFO: `/v3/projects/e0021484062d4c66a7c594105fdaf7ca/users/cdb1c9570a664fa3ad6ac92a0ddd9b04/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:24.769205 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cca6e-d66d-40da-8a6a-cd4559ecf76b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0021484062d4c66a7c594105fdaf7ca, user_id=cdb1c9570a664fa3ad6ac92a0ddd9b04, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:24.771892 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cca6e-d66d-40da-8a6a-cd4559ecf76b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:24.786687 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1137/2285] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:01:24 2022] PUT /identity/v3/projects/e0021484062d4c66a7c594105fdaf7ca/users/cdb1c9570a664fa3ad6ac92a0ddd9b04/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:24.790819 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34951194-dbe4-4e05-8f79-ec62387b9c24 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:24.801144 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34951194-dbe4-4e05-8f79-ec62387b9c24 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:24.859178 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634e1c9-ac2f-4ebd-9475-6a9e2a05ff3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:24.859844 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634e1c9-ac2f-4ebd-9475-6a9e2a05ff3a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:24.860124 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634e1c9-ac2f-4ebd-9475-6a9e2a05ff3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:24.860406 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634e1c9-ac2f-4ebd-9475-6a9e2a05ff3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:24.861216 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634e1c9-ac2f-4ebd-9475-6a9e2a05ff3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:24.862838 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634e1c9-ac2f-4ebd-9475-6a9e2a05ff3a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:24.873021 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1149/2286] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:01:24.877444 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cca6e-d66d-40da-8a6a-cd4559ecf76b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:24.887558 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cca6e-d66d-40da-8a6a-cd4559ecf76b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:24.892366 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53763ba4-e871-43d0-a7fb-06338f4881ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:24.893241 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53763ba4-e871-43d0-a7fb-06338f4881ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:24.893620 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53763ba4-e871-43d0-a7fb-06338f4881ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:24.893891 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53763ba4-e871-43d0-a7fb-06338f4881ab admin admin] PATH_INFO: `/v3/projects/e0021484062d4c66a7c594105fdaf7ca/users/cdb1c9570a664fa3ad6ac92a0ddd9b04/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:24.895903 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53763ba4-e871-43d0-a7fb-06338f4881ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0021484062d4c66a7c594105fdaf7ca, user_id=cdb1c9570a664fa3ad6ac92a0ddd9b04, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:24.898883 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53763ba4-e871-43d0-a7fb-06338f4881ab admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:24.909393 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1138/2287] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:01:24 2022] PUT /identity/v3/projects/e0021484062d4c66a7c594105fdaf7ca/users/cdb1c9570a664fa3ad6ac92a0ddd9b04/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:24.921046 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bbf69-2c53-4089-a1a1-7a752a36d14c None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:24.921338 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bbf69-2c53-4089-a1a1-7a752a36d14c None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:24.921648 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bbf69-2c53-4089-a1a1-7a752a36d14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:24.948192 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-006bbf69-2c53-4089-a1a1-7a752a36d14c None None] MFA Rules not processed for user `cdb1c9570a664fa3ad6ac92a0ddd9b04`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:24.949410 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-006bbf69-2c53-4089-a1a1-7a752a36d14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:25.016164 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1150/2288] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:24 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:25.026522 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53763ba4-e871-43d0-a7fb-06338f4881ab admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:25.028414 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-53763ba4-e871-43d0-a7fb-06338f4881ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:25.104119 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53763ba4-e871-43d0-a7fb-06338f4881ab admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:25.108028 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8762c-b8e8-4a55-b8a4-abf217fa2b78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:25.108666 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8762c-b8e8-4a55-b8a4-abf217fa2b78 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:25.108947 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8762c-b8e8-4a55-b8a4-abf217fa2b78 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:25.109211 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8762c-b8e8-4a55-b8a4-abf217fa2b78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:25.118623 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8762c-b8e8-4a55-b8a4-abf217fa2b78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:25.120042 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8762c-b8e8-4a55-b8a4-abf217fa2b78 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:25.129283 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1139/2289] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:01:25 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:01:25.300758 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bbf69-2c53-4089-a1a1-7a752a36d14c None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:25.361944 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bbf69-2c53-4089-a1a1-7a752a36d14c None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:25.367031 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e6722-99c5-4f39-96b5-6fd6dba9f492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:25.367892 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e6722-99c5-4f39-96b5-6fd6dba9f492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:25.368166 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e6722-99c5-4f39-96b5-6fd6dba9f492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:25.368436 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e6722-99c5-4f39-96b5-6fd6dba9f492 admin admin] PATH_INFO: `/v3/users/ed092c2ab3ec4955a4bcfcddefd43e31` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:25.369710 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e6722-99c5-4f39-96b5-6fd6dba9f492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed092c2ab3ec4955a4bcfcddefd43e31)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:25.371643 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e6722-99c5-4f39-96b5-6fd6dba9f492 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:25.420228 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-cd2e6722-99c5-4f39-96b5-6fd6dba9f492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed092c2ab3ec4955a4bcfcddefd43e31'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:25.427128 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-cd2e6722-99c5-4f39-96b5-6fd6dba9f492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed092c2ab3ec4955a4bcfcddefd43e31'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:25.439348 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-cd2e6722-99c5-4f39-96b5-6fd6dba9f492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed092c2ab3ec4955a4bcfcddefd43e31'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:25.440042 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-cd2e6722-99c5-4f39-96b5-6fd6dba9f492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed092c2ab3ec4955a4bcfcddefd43e31'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:25.440645 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-cd2e6722-99c5-4f39-96b5-6fd6dba9f492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed092c2ab3ec4955a4bcfcddefd43e31'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:25.455708 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1151/2290] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:01:25 2022] DELETE /identity/v3/users/ed092c2ab3ec4955a4bcfcddefd43e31 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:25.460463 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8a4b8-4f0e-47c5-9fdb-e642b9090c65 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:25.461034 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8a4b8-4f0e-47c5-9fdb-e642b9090c65 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:25.461140 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8a4b8-4f0e-47c5-9fdb-e642b9090c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:25.478924 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-90b8a4b8-4f0e-47c5-9fdb-e642b9090c65 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:25.480126 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-90b8a4b8-4f0e-47c5-9fdb-e642b9090c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:25.541925 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1140/2291] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:25.551969 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e6722-99c5-4f39-96b5-6fd6dba9f492 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:25.553501 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-cd2e6722-99c5-4f39-96b5-6fd6dba9f492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:25.638696 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e6722-99c5-4f39-96b5-6fd6dba9f492 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:25.642616 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd61588-5703-4e51-b36c-8cc95a1be8a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:25.643235 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd61588-5703-4e51-b36c-8cc95a1be8a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:25.643512 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd61588-5703-4e51-b36c-8cc95a1be8a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:25.643790 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd61588-5703-4e51-b36c-8cc95a1be8a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:25.654408 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd61588-5703-4e51-b36c-8cc95a1be8a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:25.655842 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd61588-5703-4e51-b36c-8cc95a1be8a7 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:25.665614 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1152/2292] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:01:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:01:25.931020 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8a4b8-4f0e-47c5-9fdb-e642b9090c65 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:25.932461 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-90b8a4b8-4f0e-47c5-9fdb-e642b9090c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:25.945706 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8a4b8-4f0e-47c5-9fdb-e642b9090c65 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:25.950640 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f9472-5e86-43aa-994b-823e6f16e1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:25.951496 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f9472-5e86-43aa-994b-823e6f16e1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:25.951792 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f9472-5e86-43aa-994b-823e6f16e1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:25.952057 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f9472-5e86-43aa-994b-823e6f16e1e0 admin admin] PATH_INFO: `/v3/projects/b49982a4b5394c24b16bc4f6d3de4494` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:25.954157 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f9472-5e86-43aa-994b-823e6f16e1e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b49982a4b5394c24b16bc4f6d3de4494)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:25.956270 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f9472-5e86-43aa-994b-823e6f16e1e0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:26.004663 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9c6f9472-5e86-43aa-994b-823e6f16e1e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b49982a4b5394c24b16bc4f6d3de4494', 'request_id': 'req-9c6f9472-5e86-43aa-994b-823e6f16e1e0'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:26.010158 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9c6f9472-5e86-43aa-994b-823e6f16e1e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b49982a4b5394c24b16bc4f6d3de4494', 'request_id': 'req-9c6f9472-5e86-43aa-994b-823e6f16e1e0'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:26.016238 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9c6f9472-5e86-43aa-994b-823e6f16e1e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b49982a4b5394c24b16bc4f6d3de4494', 'request_id': 'req-9c6f9472-5e86-43aa-994b-823e6f16e1e0'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:26.032140 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9c6f9472-5e86-43aa-994b-823e6f16e1e0 admin admin] The token cache is being invalidate because project b49982a4b5394c24b16bc4f6d3de4494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:01:26.032423 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9c6f9472-5e86-43aa-994b-823e6f16e1e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:26.033504 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9c6f9472-5e86-43aa-994b-823e6f16e1e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:26.034670 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1141/2293] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:01:25 2022] DELETE /identity/v3/projects/b49982a4b5394c24b16bc4f6d3de4494 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:26.041249 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd61588-5703-4e51-b36c-8cc95a1be8a7 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:26.051319 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd61588-5703-4e51-b36c-8cc95a1be8a7 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:26.105388 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711a2de-0c23-444e-84a5-8b197b9b59c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:26.106282 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711a2de-0c23-444e-84a5-8b197b9b59c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:26.106557 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711a2de-0c23-444e-84a5-8b197b9b59c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:26.106827 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711a2de-0c23-444e-84a5-8b197b9b59c4 admin admin] PATH_INFO: `/v3/users/cdb1c9570a664fa3ad6ac92a0ddd9b04` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:26.108032 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711a2de-0c23-444e-84a5-8b197b9b59c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdb1c9570a664fa3ad6ac92a0ddd9b04)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:26.109986 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711a2de-0c23-444e-84a5-8b197b9b59c4 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:26.160289 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b711a2de-0c23-444e-84a5-8b197b9b59c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdb1c9570a664fa3ad6ac92a0ddd9b04'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:26.167177 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b711a2de-0c23-444e-84a5-8b197b9b59c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdb1c9570a664fa3ad6ac92a0ddd9b04'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:26.178617 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b711a2de-0c23-444e-84a5-8b197b9b59c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdb1c9570a664fa3ad6ac92a0ddd9b04'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:26.179272 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b711a2de-0c23-444e-84a5-8b197b9b59c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdb1c9570a664fa3ad6ac92a0ddd9b04'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:26.179863 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b711a2de-0c23-444e-84a5-8b197b9b59c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdb1c9570a664fa3ad6ac92a0ddd9b04'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:26.193808 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1153/2294] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:01:26 2022] DELETE /identity/v3/users/cdb1c9570a664fa3ad6ac92a0ddd9b04 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 21:01:26.475555 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f9472-5e86-43aa-994b-823e6f16e1e0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:26.477327 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9c6f9472-5e86-43aa-994b-823e6f16e1e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:26.491506 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f9472-5e86-43aa-994b-823e6f16e1e0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:26.547939 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2dc633-093b-47e3-86ac-1499399857a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:26.548827 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2dc633-093b-47e3-86ac-1499399857a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:26.549087 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2dc633-093b-47e3-86ac-1499399857a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:26.549413 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2dc633-093b-47e3-86ac-1499399857a3 admin admin] PATH_INFO: `/v3/projects/e0021484062d4c66a7c594105fdaf7ca` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:26.550588 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2dc633-093b-47e3-86ac-1499399857a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0021484062d4c66a7c594105fdaf7ca)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:26.552471 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2dc633-093b-47e3-86ac-1499399857a3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:26.598428 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1e2dc633-093b-47e3-86ac-1499399857a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0021484062d4c66a7c594105fdaf7ca', 'request_id': 'req-1e2dc633-093b-47e3-86ac-1499399857a3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:26.604100 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1e2dc633-093b-47e3-86ac-1499399857a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0021484062d4c66a7c594105fdaf7ca', 'request_id': 'req-1e2dc633-093b-47e3-86ac-1499399857a3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:26.610402 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1e2dc633-093b-47e3-86ac-1499399857a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0021484062d4c66a7c594105fdaf7ca', 'request_id': 'req-1e2dc633-093b-47e3-86ac-1499399857a3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:26.623406 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1e2dc633-093b-47e3-86ac-1499399857a3 admin admin] The token cache is being invalidate because project e0021484062d4c66a7c594105fdaf7ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:01:26.623688 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1e2dc633-093b-47e3-86ac-1499399857a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:26.624313 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1e2dc633-093b-47e3-86ac-1499399857a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:26.625892 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1142/2295] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:01:26 2022] DELETE /identity/v3/projects/e0021484062d4c66a7c594105fdaf7ca => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:26.630914 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c422e4-ba02-4923-bc51-8465ba4735a0 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:26.631226 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c422e4-ba02-4923-bc51-8465ba4735a0 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:26.631467 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c422e4-ba02-4923-bc51-8465ba4735a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:26.650666 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-53c422e4-ba02-4923-bc51-8465ba4735a0 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:26.651888 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-53c422e4-ba02-4923-bc51-8465ba4735a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:26.711889 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1154/2296] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 21:01:26.719881 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d7253-a665-4833-bdf8-809addd8822e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:26.720096 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d7253-a665-4833-bdf8-809addd8822e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:26.720362 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d7253-a665-4833-bdf8-809addd8822e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:26.738490 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-663d7253-a665-4833-bdf8-809addd8822e None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:26.739694 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-663d7253-a665-4833-bdf8-809addd8822e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:26.748314 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1143/2297] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:26.752446 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c422e4-ba02-4923-bc51-8465ba4735a0 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:26.762676 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c422e4-ba02-4923-bc51-8465ba4735a0 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:26.768108 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d9e08-f1f9-42c6-afe6-b033725a1639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:26.768770 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d9e08-f1f9-42c6-afe6-b033725a1639 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:26.769040 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d9e08-f1f9-42c6-afe6-b033725a1639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:26.769305 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d9e08-f1f9-42c6-afe6-b033725a1639 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:26.770086 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d9e08-f1f9-42c6-afe6-b033725a1639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:01:26.770410 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d9e08-f1f9-42c6-afe6-b033725a1639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:26.772003 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d9e08-f1f9-42c6-afe6-b033725a1639 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:26.784759 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1155/2298] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:01:26.789304 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d7253-a665-4833-bdf8-809addd8822e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:26.799055 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d7253-a665-4833-bdf8-809addd8822e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:26.804128 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74c8ea-7ed4-4e92-958a-362d507c84ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:26.804780 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74c8ea-7ed4-4e92-958a-362d507c84ce admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:26.805077 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74c8ea-7ed4-4e92-958a-362d507c84ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:26.805344 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74c8ea-7ed4-4e92-958a-362d507c84ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:26.806514 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74c8ea-7ed4-4e92-958a-362d507c84ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:26.808694 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74c8ea-7ed4-4e92-958a-362d507c84ce admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:26.836762 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1144/2299] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:01:26 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:01:26.840870 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d9e08-f1f9-42c6-afe6-b033725a1639 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:26.850882 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d9e08-f1f9-42c6-afe6-b033725a1639 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:26.907468 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59538a1-7331-48ac-89b7-d36c40cf8794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:26.908142 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59538a1-7331-48ac-89b7-d36c40cf8794 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:26.908420 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59538a1-7331-48ac-89b7-d36c40cf8794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:26.908896 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59538a1-7331-48ac-89b7-d36c40cf8794 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:26.910046 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59538a1-7331-48ac-89b7-d36c40cf8794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:26.911955 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59538a1-7331-48ac-89b7-d36c40cf8794 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:26.935339 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1156/2300] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:01:26 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:01:26.940266 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74c8ea-7ed4-4e92-958a-362d507c84ce admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:26.951412 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74c8ea-7ed4-4e92-958a-362d507c84ce admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:26.956357 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51f8f9-aca1-4b22-89ad-ed76142fe209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:26.957120 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51f8f9-aca1-4b22-89ad-ed76142fe209 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:26.957466 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51f8f9-aca1-4b22-89ad-ed76142fe209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:26.957906 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51f8f9-aca1-4b22-89ad-ed76142fe209 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:26.958756 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51f8f9-aca1-4b22-89ad-ed76142fe209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:26.960422 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51f8f9-aca1-4b22-89ad-ed76142fe209 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:26.972840 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1145/2301] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:01:26.978017 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59538a1-7331-48ac-89b7-d36c40cf8794 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:26.988218 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59538a1-7331-48ac-89b7-d36c40cf8794 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:26.992994 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b012cd-4b4b-49d9-b66e-412fc5e51f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:26.993719 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b012cd-4b4b-49d9-b66e-412fc5e51f07 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:26.994019 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b012cd-4b4b-49d9-b66e-412fc5e51f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:26.994287 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b012cd-4b4b-49d9-b66e-412fc5e51f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:26.995019 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b012cd-4b4b-49d9-b66e-412fc5e51f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:26.996668 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b012cd-4b4b-49d9-b66e-412fc5e51f07 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:27.009442 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1157/2302] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:01:27.013855 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51f8f9-aca1-4b22-89ad-ed76142fe209 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:27.028582 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51f8f9-aca1-4b22-89ad-ed76142fe209 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:27.035326 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028f871-057a-4055-b033-711460fda5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:27.036201 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028f871-057a-4055-b033-711460fda5bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:27.036472 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028f871-057a-4055-b033-711460fda5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:27.036739 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028f871-057a-4055-b033-711460fda5bf admin admin] PATH_INFO: `/v3/projects/34a57d104a0f4d168393fcc739717cad/users/15b9a0826c0c4a619eac172e8de32fe1/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:27.054171 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028f871-057a-4055-b033-711460fda5bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a57d104a0f4d168393fcc739717cad, user_id=15b9a0826c0c4a619eac172e8de32fe1, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:27.056778 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028f871-057a-4055-b033-711460fda5bf admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:27.072317 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1146/2303] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:01:27 2022] PUT /identity/v3/projects/34a57d104a0f4d168393fcc739717cad/users/15b9a0826c0c4a619eac172e8de32fe1/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:27.082955 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012c5f0-7306-4bb9-8e41-3ef41c1f651a None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:27.083506 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012c5f0-7306-4bb9-8e41-3ef41c1f651a None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:27.083682 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012c5f0-7306-4bb9-8e41-3ef41c1f651a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:27.111501 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-d012c5f0-7306-4bb9-8e41-3ef41c1f651a None None] MFA Rules not processed for user `15b9a0826c0c4a619eac172e8de32fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:27.113001 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d012c5f0-7306-4bb9-8e41-3ef41c1f651a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:27.178284 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1158/2304] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:27.182692 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028f871-057a-4055-b033-711460fda5bf admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:27.245629 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028f871-057a-4055-b033-711460fda5bf admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:27.250637 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfc682-0972-4acd-a9a9-1715762cb71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:27.251302 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfc682-0972-4acd-a9a9-1715762cb71e admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:27.251580 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfc682-0972-4acd-a9a9-1715762cb71e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:27.251849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfc682-0972-4acd-a9a9-1715762cb71e admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:27.252548 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfc682-0972-4acd-a9a9-1715762cb71e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:27.254462 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfc682-0972-4acd-a9a9-1715762cb71e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:27.287022 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1147/2305] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:01:27 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:01:27.288313 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012c5f0-7306-4bb9-8e41-3ef41c1f651a None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:27.301968 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012c5f0-7306-4bb9-8e41-3ef41c1f651a None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:27.381214 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497f6a7-8671-42f3-8367-450ac7d42bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:27.381214 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497f6a7-8671-42f3-8367-450ac7d42bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:27.381887 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497f6a7-8671-42f3-8367-450ac7d42bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:27.382296 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497f6a7-8671-42f3-8367-450ac7d42bb8 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:27.382874 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497f6a7-8671-42f3-8367-450ac7d42bb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:27.384796 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497f6a7-8671-42f3-8367-450ac7d42bb8 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:27.423663 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1159/2306] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:01:27 2022] POST /identity/v3/users => generated 300 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:01:27.427467 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfc682-0972-4acd-a9a9-1715762cb71e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:27.439140 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfc682-0972-4acd-a9a9-1715762cb71e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:27.445775 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31bde9-4089-4536-9b19-33c97c746076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:27.446785 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31bde9-4089-4536-9b19-33c97c746076 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:27.447183 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31bde9-4089-4536-9b19-33c97c746076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:27.447505 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31bde9-4089-4536-9b19-33c97c746076 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:27.448396 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31bde9-4089-4536-9b19-33c97c746076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:27.457386 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31bde9-4089-4536-9b19-33c97c746076 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:27.466859 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1148/2307] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:01:27.472904 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497f6a7-8671-42f3-8367-450ac7d42bb8 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:27.496464 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497f6a7-8671-42f3-8367-450ac7d42bb8 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:27.507865 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6abde-7c5a-4042-822b-3d8a1e1fca06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:27.509017 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6abde-7c5a-4042-822b-3d8a1e1fca06 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:27.509302 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6abde-7c5a-4042-822b-3d8a1e1fca06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:27.509807 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6abde-7c5a-4042-822b-3d8a1e1fca06 admin admin] PATH_INFO: `/v3/projects/985211cb79984046af64af5671d0bc19/users/4af75214a7ea40a2b53aaa1f52b5603a/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:27.556397 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6abde-7c5a-4042-822b-3d8a1e1fca06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=985211cb79984046af64af5671d0bc19, user_id=4af75214a7ea40a2b53aaa1f52b5603a, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:27.559859 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6abde-7c5a-4042-822b-3d8a1e1fca06 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:27.578489 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1160/2308] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:01:27 2022] PUT /identity/v3/projects/985211cb79984046af64af5671d0bc19/users/4af75214a7ea40a2b53aaa1f52b5603a/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:27.582493 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31bde9-4089-4536-9b19-33c97c746076 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:27.594681 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31bde9-4089-4536-9b19-33c97c746076 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:27.651960 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3e409-9d7f-4585-8c52-3aef3dfd0cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:27.652629 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3e409-9d7f-4585-8c52-3aef3dfd0cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:27.652946 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3e409-9d7f-4585-8c52-3aef3dfd0cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:27.653214 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3e409-9d7f-4585-8c52-3aef3dfd0cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:27.654216 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3e409-9d7f-4585-8c52-3aef3dfd0cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:27.656098 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3e409-9d7f-4585-8c52-3aef3dfd0cc9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:27.666812 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1149/2309] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:01:27.671557 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6abde-7c5a-4042-822b-3d8a1e1fca06 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:27.681379 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6abde-7c5a-4042-822b-3d8a1e1fca06 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:27.685971 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1c961-52c8-4e39-87c2-3739da18f2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:27.686967 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1c961-52c8-4e39-87c2-3739da18f2c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:27.687233 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1c961-52c8-4e39-87c2-3739da18f2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:27.687532 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1c961-52c8-4e39-87c2-3739da18f2c6 admin admin] PATH_INFO: `/v3/projects/985211cb79984046af64af5671d0bc19/users/4af75214a7ea40a2b53aaa1f52b5603a/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:27.689834 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1c961-52c8-4e39-87c2-3739da18f2c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=985211cb79984046af64af5671d0bc19, user_id=4af75214a7ea40a2b53aaa1f52b5603a, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:27.692811 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1c961-52c8-4e39-87c2-3739da18f2c6 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:27.704202 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1161/2310] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:01:27 2022] PUT /identity/v3/projects/985211cb79984046af64af5671d0bc19/users/4af75214a7ea40a2b53aaa1f52b5603a/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:27.716711 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2e87c-90f9-4998-b255-90589af6923a None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:27.717215 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2e87c-90f9-4998-b255-90589af6923a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:27.717721 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2e87c-90f9-4998-b255-90589af6923a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:27.746048 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-b1a2e87c-90f9-4998-b255-90589af6923a None None] MFA Rules not processed for user `4af75214a7ea40a2b53aaa1f52b5603a`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:27.747245 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b1a2e87c-90f9-4998-b255-90589af6923a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:27.835320 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1150/2311] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:27.845978 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1c961-52c8-4e39-87c2-3739da18f2c6 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:27.847750 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-e6b1c961-52c8-4e39-87c2-3739da18f2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:27.903882 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1c961-52c8-4e39-87c2-3739da18f2c6 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:27.907983 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a55c0c-9757-4753-b043-d8c7f3bf587f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:27.908765 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a55c0c-9757-4753-b043-d8c7f3bf587f service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:27.909109 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a55c0c-9757-4753-b043-d8c7f3bf587f service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:27.909475 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a55c0c-9757-4753-b043-d8c7f3bf587f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:27.919106 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a55c0c-9757-4753-b043-d8c7f3bf587f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:27.920531 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a55c0c-9757-4753-b043-d8c7f3bf587f service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:27.930316 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1162/2312] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:01:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:01:27.993522 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2e87c-90f9-4998-b255-90589af6923a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:28.052913 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337ff90-f5d8-4246-91ea-d6323b8b1b09 None None] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:28.053217 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337ff90-f5d8-4246-91ea-d6323b8b1b09 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:28.053498 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337ff90-f5d8-4246-91ea-d6323b8b1b09 None None] PATH_INFO: `/` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:28.055968 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1163/2313] 10.222.0.31 () {54 vars in 921 bytes} [Thu Feb 10 21:01:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 21:01:28.060241 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2e87c-90f9-4998-b255-90589af6923a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:28.062585 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a0f87-0778-4ea0-8990-cc7a3635e63b None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:28.062869 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a0f87-0778-4ea0-8990-cc7a3635e63b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:28.063139 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a0f87-0778-4ea0-8990-cc7a3635e63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:28.065419 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55747abe-23f0-4e54-8dff-c23c3912cc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:28.066282 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55747abe-23f0-4e54-8dff-c23c3912cc95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:28.066560 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55747abe-23f0-4e54-8dff-c23c3912cc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:28.066866 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55747abe-23f0-4e54-8dff-c23c3912cc95 admin admin] PATH_INFO: `/v3/users/15b9a0826c0c4a619eac172e8de32fe1` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:28.068055 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55747abe-23f0-4e54-8dff-c23c3912cc95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15b9a0826c0c4a619eac172e8de32fe1)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:28.070269 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55747abe-23f0-4e54-8dff-c23c3912cc95 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:28.118232 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-55747abe-23f0-4e54-8dff-c23c3912cc95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15b9a0826c0c4a619eac172e8de32fe1'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:28.119050 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-759a0f87-0778-4ea0-8990-cc7a3635e63b None None] MFA Rules not processed for user `c0d84b0d7e3d423aa972e58be27c772c`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:28.120714 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-759a0f87-0778-4ea0-8990-cc7a3635e63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:28.126479 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-55747abe-23f0-4e54-8dff-c23c3912cc95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15b9a0826c0c4a619eac172e8de32fe1'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:28.138473 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-55747abe-23f0-4e54-8dff-c23c3912cc95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15b9a0826c0c4a619eac172e8de32fe1'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:28.139217 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-55747abe-23f0-4e54-8dff-c23c3912cc95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15b9a0826c0c4a619eac172e8de32fe1'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:28.148269 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-55747abe-23f0-4e54-8dff-c23c3912cc95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15b9a0826c0c4a619eac172e8de32fe1'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:28.154651 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1151/2314] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:01:27 2022] DELETE /identity/v3/users/15b9a0826c0c4a619eac172e8de32fe1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:28.162009 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d03659-d14f-4644-9d97-3b78886be5de None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:28.162009 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d03659-d14f-4644-9d97-3b78886be5de None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:28.162009 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d03659-d14f-4644-9d97-3b78886be5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:28.183520 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e8d03659-d14f-4644-9d97-3b78886be5de None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:28.184913 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e8d03659-d14f-4644-9d97-3b78886be5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:28.219110 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1164/2315] 10.222.0.31 () {58 vars in 1018 bytes} [Thu Feb 10 21:01:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 21:01:28.231267 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a0f87-0778-4ea0-8990-cc7a3635e63b None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:28.232708 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-759a0f87-0778-4ea0-8990-cc7a3635e63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:28.243353 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1152/2316] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 21:01:28.253090 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d03659-d14f-4644-9d97-3b78886be5de None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:28.254415 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e8d03659-d14f-4644-9d97-3b78886be5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:28.286258 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a0f87-0778-4ea0-8990-cc7a3635e63b None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:28.307402 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d03659-d14f-4644-9d97-3b78886be5de None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:28.311144 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03267c-3a0a-4663-b143-2e9352f75f8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:28.311784 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03267c-3a0a-4663-b143-2e9352f75f8e service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:28.312054 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03267c-3a0a-4663-b143-2e9352f75f8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:28.312316 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03267c-3a0a-4663-b143-2e9352f75f8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:28.321219 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03267c-3a0a-4663-b143-2e9352f75f8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:28.322674 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03267c-3a0a-4663-b143-2e9352f75f8e service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:28.331967 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1153/2317] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 21:01:28.332933 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8c346-0e60-4fd4-8a12-89c5450dae2d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '256860d94eb142c6b2175ae89f977e4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:28.333603 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8c346-0e60-4fd4-8a12-89c5450dae2d service glance] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:28.333932 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8c346-0e60-4fd4-8a12-89c5450dae2d service glance] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:28.334201 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8c346-0e60-4fd4-8a12-89c5450dae2d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:28.403556 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8c346-0e60-4fd4-8a12-89c5450dae2d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:28.404987 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8c346-0e60-4fd4-8a12-89c5450dae2d service glance] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:28.415770 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1165/2318] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:01:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 21:01:28.494762 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0084d5-3199-44fc-a97f-e9cc3b26376b None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:28.494963 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0084d5-3199-44fc-a97f-e9cc3b26376b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:28.495363 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0084d5-3199-44fc-a97f-e9cc3b26376b None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:28.497167 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1154/2319] 10.222.0.31 () {54 vars in 921 bytes} [Thu Feb 10 21:01:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 21:01:28.502145 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa52447-58f5-45d6-89f9-f636736e4600 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:28.502494 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa52447-58f5-45d6-89f9-f636736e4600 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:28.502846 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa52447-58f5-45d6-89f9-f636736e4600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:28.522538 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-2aa52447-58f5-45d6-89f9-f636736e4600 None None] MFA Rules not processed for user `b07a9ae7262b44ce88e1338c83360356`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:28.523605 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-2aa52447-58f5-45d6-89f9-f636736e4600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:28.536149 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1166/2320] 10.222.0.31 () {58 vars in 1018 bytes} [Thu Feb 10 21:01:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:28.552719 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0084d5-3199-44fc-a97f-e9cc3b26376b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:28.563345 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0084d5-3199-44fc-a97f-e9cc3b26376b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:28.566843 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2693d-7f45-4a1e-9fff-ebc337cdd2f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:28.567583 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2693d-7f45-4a1e-9fff-ebc337cdd2f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:28.567942 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2693d-7f45-4a1e-9fff-ebc337cdd2f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:28.568271 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2693d-7f45-4a1e-9fff-ebc337cdd2f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:28.575285 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2693d-7f45-4a1e-9fff-ebc337cdd2f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:28.576789 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2693d-7f45-4a1e-9fff-ebc337cdd2f3 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:28.584692 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1155/2321] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:01:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:01:28.604128 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa52447-58f5-45d6-89f9-f636736e4600 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:28.605702 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-2aa52447-58f5-45d6-89f9-f636736e4600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:28.635621 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa52447-58f5-45d6-89f9-f636736e4600 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:28.640337 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985307f-175d-4c7d-b6e7-fbfd98ac3ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:28.641039 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985307f-175d-4c7d-b6e7-fbfd98ac3ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:28.641315 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985307f-175d-4c7d-b6e7-fbfd98ac3ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:28.641616 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985307f-175d-4c7d-b6e7-fbfd98ac3ff6 admin admin] PATH_INFO: `/v3/projects/34a57d104a0f4d168393fcc739717cad` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:28.642792 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985307f-175d-4c7d-b6e7-fbfd98ac3ff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34a57d104a0f4d168393fcc739717cad)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:28.644671 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985307f-175d-4c7d-b6e7-fbfd98ac3ff6 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:28.674578 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa007c-6b3c-4db9-ab8c-cdd0753b27d8 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:28.674886 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa007c-6b3c-4db9-ab8c-cdd0753b27d8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:28.675173 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa007c-6b3c-4db9-ab8c-cdd0753b27d8 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:28.677206 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1156/2322] 10.222.0.31 () {54 vars in 921 bytes} [Thu Feb 10 21:01:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 21:01:28.682494 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c81a4-0052-4bbe-bbf9-48463209daaa None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:28.682806 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c81a4-0052-4bbe-bbf9-48463209daaa None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:28.683249 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c81a4-0052-4bbe-bbf9-48463209daaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:28.692841 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-7985307f-175d-4c7d-b6e7-fbfd98ac3ff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34a57d104a0f4d168393fcc739717cad', 'request_id': 'req-7985307f-175d-4c7d-b6e7-fbfd98ac3ff6'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:28.698255 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-7985307f-175d-4c7d-b6e7-fbfd98ac3ff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34a57d104a0f4d168393fcc739717cad', 'request_id': 'req-7985307f-175d-4c7d-b6e7-fbfd98ac3ff6'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:28.701403 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-946c81a4-0052-4bbe-bbf9-48463209daaa None None] MFA Rules not processed for user `c0d84b0d7e3d423aa972e58be27c772c`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:28.702812 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-946c81a4-0052-4bbe-bbf9-48463209daaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:28.704796 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-7985307f-175d-4c7d-b6e7-fbfd98ac3ff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34a57d104a0f4d168393fcc739717cad', 'request_id': 'req-7985307f-175d-4c7d-b6e7-fbfd98ac3ff6'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:28.717644 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-7985307f-175d-4c7d-b6e7-fbfd98ac3ff6 admin admin] The token cache is being invalidate because project 34a57d104a0f4d168393fcc739717cad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:01:28.718047 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-7985307f-175d-4c7d-b6e7-fbfd98ac3ff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:28.718813 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-7985307f-175d-4c7d-b6e7-fbfd98ac3ff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:28.720460 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1167/2323] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:01:28 2022] DELETE /identity/v3/projects/34a57d104a0f4d168393fcc739717cad => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:28.724353 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985307f-175d-4c7d-b6e7-fbfd98ac3ff6 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:28.725705 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-7985307f-175d-4c7d-b6e7-fbfd98ac3ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:28.767969 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1157/2324] 10.222.0.31 () {58 vars in 1018 bytes} [Thu Feb 10 21:01:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 21:01:28.778845 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c81a4-0052-4bbe-bbf9-48463209daaa None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:28.780178 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-946c81a4-0052-4bbe-bbf9-48463209daaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:28.786559 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985307f-175d-4c7d-b6e7-fbfd98ac3ff6 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:28.791364 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffcdfb-2ad4-428c-9616-67be63eaadd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:28.792260 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffcdfb-2ad4-428c-9616-67be63eaadd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:28.792568 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffcdfb-2ad4-428c-9616-67be63eaadd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:28.792794 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffcdfb-2ad4-428c-9616-67be63eaadd4 admin admin] PATH_INFO: `/v3/users/4af75214a7ea40a2b53aaa1f52b5603a` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:28.794129 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffcdfb-2ad4-428c-9616-67be63eaadd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4af75214a7ea40a2b53aaa1f52b5603a)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:28.796019 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffcdfb-2ad4-428c-9616-67be63eaadd4 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:28.835854 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c81a4-0052-4bbe-bbf9-48463209daaa None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:28.839610 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014d289-93cd-4c7a-90c0-0d9664c6a741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:28.840255 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014d289-93cd-4c7a-90c0-0d9664c6a741 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:28.840532 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014d289-93cd-4c7a-90c0-0d9664c6a741 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:28.840799 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014d289-93cd-4c7a-90c0-0d9664c6a741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:28.845983 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-69ffcdfb-2ad4-428c-9616-67be63eaadd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4af75214a7ea40a2b53aaa1f52b5603a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:28.851881 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014d289-93cd-4c7a-90c0-0d9664c6a741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:28.853098 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-69ffcdfb-2ad4-428c-9616-67be63eaadd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4af75214a7ea40a2b53aaa1f52b5603a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:28.853285 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014d289-93cd-4c7a-90c0-0d9664c6a741 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:28.864201 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-69ffcdfb-2ad4-428c-9616-67be63eaadd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4af75214a7ea40a2b53aaa1f52b5603a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:28.864883 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-69ffcdfb-2ad4-428c-9616-67be63eaadd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4af75214a7ea40a2b53aaa1f52b5603a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:28.865405 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1158/2325] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:01:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 21:01:28.865546 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-69ffcdfb-2ad4-428c-9616-67be63eaadd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4af75214a7ea40a2b53aaa1f52b5603a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:28.878611 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1168/2326] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:01:28 2022] DELETE /identity/v3/users/4af75214a7ea40a2b53aaa1f52b5603a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 21:01:29.143879 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014d289-93cd-4c7a-90c0-0d9664c6a741 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:29.155896 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014d289-93cd-4c7a-90c0-0d9664c6a741 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:29.222854 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466af80-3991-4094-bf5a-c686c1313057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:29.223566 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466af80-3991-4094-bf5a-c686c1313057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:29.223840 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466af80-3991-4094-bf5a-c686c1313057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:29.224106 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466af80-3991-4094-bf5a-c686c1313057 admin admin] PATH_INFO: `/v3/projects/985211cb79984046af64af5671d0bc19` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:29.225681 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466af80-3991-4094-bf5a-c686c1313057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=985211cb79984046af64af5671d0bc19)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:29.227836 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466af80-3991-4094-bf5a-c686c1313057 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:29.273628 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a466af80-3991-4094-bf5a-c686c1313057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985211cb79984046af64af5671d0bc19', 'request_id': 'req-a466af80-3991-4094-bf5a-c686c1313057'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:29.278718 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a466af80-3991-4094-bf5a-c686c1313057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985211cb79984046af64af5671d0bc19', 'request_id': 'req-a466af80-3991-4094-bf5a-c686c1313057'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:29.284753 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a466af80-3991-4094-bf5a-c686c1313057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985211cb79984046af64af5671d0bc19', 'request_id': 'req-a466af80-3991-4094-bf5a-c686c1313057'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:29.298556 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a466af80-3991-4094-bf5a-c686c1313057 admin admin] The token cache is being invalidate because project 985211cb79984046af64af5671d0bc19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:01:29.298835 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a466af80-3991-4094-bf5a-c686c1313057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:29.299533 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a466af80-3991-4094-bf5a-c686c1313057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:29.301402 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1159/2327] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:01:29 2022] DELETE /identity/v3/projects/985211cb79984046af64af5671d0bc19 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:29.306363 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0015ce-545a-41c8-b5fc-46c3bc2a20a8 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:29.306848 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0015ce-545a-41c8-b5fc-46c3bc2a20a8 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:29.306965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0015ce-545a-41c8-b5fc-46c3bc2a20a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:29.325288 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-8e0015ce-545a-41c8-b5fc-46c3bc2a20a8 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:29.326542 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-8e0015ce-545a-41c8-b5fc-46c3bc2a20a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:29.394148 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1169/2328] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 21:01:29.403294 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5554e3a-6463-49d5-8a16-936e13a42cc9 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:29.403670 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5554e3a-6463-49d5-8a16-936e13a42cc9 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:29.404059 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5554e3a-6463-49d5-8a16-936e13a42cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:29.430330 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-c5554e3a-6463-49d5-8a16-936e13a42cc9 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:29.432028 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c5554e3a-6463-49d5-8a16-936e13a42cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:29.440844 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1160/2329] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:29.445475 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0015ce-545a-41c8-b5fc-46c3bc2a20a8 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:29.455534 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0015ce-545a-41c8-b5fc-46c3bc2a20a8 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:29.460481 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819af368-edba-4245-a21a-f48b971a97b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:29.461124 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819af368-edba-4245-a21a-f48b971a97b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:29.461397 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819af368-edba-4245-a21a-f48b971a97b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:29.461667 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819af368-edba-4245-a21a-f48b971a97b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:29.462397 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819af368-edba-4245-a21a-f48b971a97b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:01:29.462688 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819af368-edba-4245-a21a-f48b971a97b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:29.464322 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819af368-edba-4245-a21a-f48b971a97b7 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:29.481070 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1170/2330] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:01:29.485782 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5554e3a-6463-49d5-8a16-936e13a42cc9 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:29.495191 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5554e3a-6463-49d5-8a16-936e13a42cc9 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:29.500973 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c93bc8-9fbe-49ac-9503-85a25ef1e1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:29.501667 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c93bc8-9fbe-49ac-9503-85a25ef1e1bf admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:29.501907 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c93bc8-9fbe-49ac-9503-85a25ef1e1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:29.502168 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c93bc8-9fbe-49ac-9503-85a25ef1e1bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:29.502861 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c93bc8-9fbe-49ac-9503-85a25ef1e1bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:29.504741 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c93bc8-9fbe-49ac-9503-85a25ef1e1bf admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:29.533279 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1161/2331] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:01:29 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:01:29.537377 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819af368-edba-4245-a21a-f48b971a97b7 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:29.547480 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819af368-edba-4245-a21a-f48b971a97b7 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:29.608219 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab90449-f651-42e8-a978-c5cb7f29a0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:29.608890 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab90449-f651-42e8-a978-c5cb7f29a0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:29.609172 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab90449-f651-42e8-a978-c5cb7f29a0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:29.609479 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab90449-f651-42e8-a978-c5cb7f29a0f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:29.610176 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab90449-f651-42e8-a978-c5cb7f29a0f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:29.612091 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab90449-f651-42e8-a978-c5cb7f29a0f1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:29.634393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1171/2332] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:01:29 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:01:29.638574 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c93bc8-9fbe-49ac-9503-85a25ef1e1bf admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:29.649338 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c93bc8-9fbe-49ac-9503-85a25ef1e1bf admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:29.654474 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52ab1a-9ad9-42dd-96c5-7eabac9bc8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:29.655128 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52ab1a-9ad9-42dd-96c5-7eabac9bc8dc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:29.655411 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52ab1a-9ad9-42dd-96c5-7eabac9bc8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:29.655681 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52ab1a-9ad9-42dd-96c5-7eabac9bc8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:29.656414 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52ab1a-9ad9-42dd-96c5-7eabac9bc8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:29.658068 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52ab1a-9ad9-42dd-96c5-7eabac9bc8dc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:29.668664 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1162/2333] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:01:29.672693 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab90449-f651-42e8-a978-c5cb7f29a0f1 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:29.683111 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab90449-f651-42e8-a978-c5cb7f29a0f1 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:29.688811 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef521279-5c5b-41f6-a290-934ca6a8e82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:29.689499 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef521279-5c5b-41f6-a290-934ca6a8e82b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:29.689775 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef521279-5c5b-41f6-a290-934ca6a8e82b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:29.690041 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef521279-5c5b-41f6-a290-934ca6a8e82b admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:29.690777 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef521279-5c5b-41f6-a290-934ca6a8e82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:29.692364 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef521279-5c5b-41f6-a290-934ca6a8e82b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:29.702683 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1172/2334] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:01:29.706823 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52ab1a-9ad9-42dd-96c5-7eabac9bc8dc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:29.716566 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52ab1a-9ad9-42dd-96c5-7eabac9bc8dc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:29.721763 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78662b4-30c7-4a19-8601-6affed12ab5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:29.722977 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78662b4-30c7-4a19-8601-6affed12ab5f admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:29.723263 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78662b4-30c7-4a19-8601-6affed12ab5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:29.723527 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78662b4-30c7-4a19-8601-6affed12ab5f admin admin] PATH_INFO: `/v3/projects/0ba556a209934b0191a86500f6d8f248/users/37cae0ef46cf44aa9d31673aff5a1e49/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:29.737959 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78662b4-30c7-4a19-8601-6affed12ab5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba556a209934b0191a86500f6d8f248, user_id=37cae0ef46cf44aa9d31673aff5a1e49, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:29.740577 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78662b4-30c7-4a19-8601-6affed12ab5f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:29.754489 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1163/2335] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:01:29 2022] PUT /identity/v3/projects/0ba556a209934b0191a86500f6d8f248/users/37cae0ef46cf44aa9d31673aff5a1e49/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:29.764905 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773ed2f-7c45-4fa8-afab-ee85194fb7a9 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:29.765211 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773ed2f-7c45-4fa8-afab-ee85194fb7a9 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:29.765496 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773ed2f-7c45-4fa8-afab-ee85194fb7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:29.799513 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-a773ed2f-7c45-4fa8-afab-ee85194fb7a9 None None] MFA Rules not processed for user `37cae0ef46cf44aa9d31673aff5a1e49`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:29.800646 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-a773ed2f-7c45-4fa8-afab-ee85194fb7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:29.868110 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1173/2336] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:29.873093 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78662b4-30c7-4a19-8601-6affed12ab5f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:29.940574 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78662b4-30c7-4a19-8601-6affed12ab5f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:29.945498 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed44fe5-1afb-4055-b7ef-173b7198963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:29.946143 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed44fe5-1afb-4055-b7ef-173b7198963a admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:29.946414 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed44fe5-1afb-4055-b7ef-173b7198963a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:29.946676 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed44fe5-1afb-4055-b7ef-173b7198963a admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:29.947359 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed44fe5-1afb-4055-b7ef-173b7198963a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:29.949342 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed44fe5-1afb-4055-b7ef-173b7198963a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:29.977611 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1164/2337] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:01:29 2022] POST /identity/v3/projects => generated 401 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:01:29.984159 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773ed2f-7c45-4fa8-afab-ee85194fb7a9 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:29.999343 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773ed2f-7c45-4fa8-afab-ee85194fb7a9 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:30.055828 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50366f4-74d1-42f9-bd50-ef5c29c92f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:30.056408 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50366f4-74d1-42f9-bd50-ef5c29c92f7e admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:30.056689 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50366f4-74d1-42f9-bd50-ef5c29c92f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:30.056961 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50366f4-74d1-42f9-bd50-ef5c29c92f7e admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:30.057741 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50366f4-74d1-42f9-bd50-ef5c29c92f7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:30.059638 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50366f4-74d1-42f9-bd50-ef5c29c92f7e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:30.082800 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1174/2338] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:01:29 2022] POST /identity/v3/users => generated 307 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:01:30.086847 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed44fe5-1afb-4055-b7ef-173b7198963a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:30.097521 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed44fe5-1afb-4055-b7ef-173b7198963a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:30.102934 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe61b7-7db2-4a0c-b505-728a15cfb761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:30.103590 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe61b7-7db2-4a0c-b505-728a15cfb761 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:30.103868 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe61b7-7db2-4a0c-b505-728a15cfb761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:30.104136 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe61b7-7db2-4a0c-b505-728a15cfb761 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:30.104875 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe61b7-7db2-4a0c-b505-728a15cfb761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:30.106589 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe61b7-7db2-4a0c-b505-728a15cfb761 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:30.117645 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1165/2339] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:01:30.122180 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50366f4-74d1-42f9-bd50-ef5c29c92f7e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:30.138511 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50366f4-74d1-42f9-bd50-ef5c29c92f7e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:30.147155 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378705f2-8aa8-44ef-b720-86dd5ebeb74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:30.148058 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378705f2-8aa8-44ef-b720-86dd5ebeb74b admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:30.148332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378705f2-8aa8-44ef-b720-86dd5ebeb74b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:30.148596 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378705f2-8aa8-44ef-b720-86dd5ebeb74b admin admin] PATH_INFO: `/v3/projects/767f762dadb14e65866326304dffe851/users/ee38511700e744a88e3689e6e12ebeeb/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:30.163972 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378705f2-8aa8-44ef-b720-86dd5ebeb74b admin admin] RBAC: Authorizing `identity:create_grant(project_id=767f762dadb14e65866326304dffe851, user_id=ee38511700e744a88e3689e6e12ebeeb, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:30.166646 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378705f2-8aa8-44ef-b720-86dd5ebeb74b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:30.182638 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1175/2340] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:01:30 2022] PUT /identity/v3/projects/767f762dadb14e65866326304dffe851/users/ee38511700e744a88e3689e6e12ebeeb/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:30.187647 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe61b7-7db2-4a0c-b505-728a15cfb761 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:30.198629 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe61b7-7db2-4a0c-b505-728a15cfb761 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:30.269676 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7eba6-798e-41f5-b76e-2a15aa3df517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:30.270365 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7eba6-798e-41f5-b76e-2a15aa3df517 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:30.270645 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7eba6-798e-41f5-b76e-2a15aa3df517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:30.270936 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7eba6-798e-41f5-b76e-2a15aa3df517 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:30.272063 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7eba6-798e-41f5-b76e-2a15aa3df517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:30.273671 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7eba6-798e-41f5-b76e-2a15aa3df517 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:30.285218 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1166/2341] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:01:30.291242 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378705f2-8aa8-44ef-b720-86dd5ebeb74b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:30.302684 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378705f2-8aa8-44ef-b720-86dd5ebeb74b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:30.308992 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f72d0-f640-427a-a304-d77eeb6aa153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:30.309826 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f72d0-f640-427a-a304-d77eeb6aa153 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:30.310103 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f72d0-f640-427a-a304-d77eeb6aa153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:30.310350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f72d0-f640-427a-a304-d77eeb6aa153 admin admin] PATH_INFO: `/v3/projects/767f762dadb14e65866326304dffe851/users/ee38511700e744a88e3689e6e12ebeeb/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:30.312577 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f72d0-f640-427a-a304-d77eeb6aa153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=767f762dadb14e65866326304dffe851, user_id=ee38511700e744a88e3689e6e12ebeeb, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:30.315270 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f72d0-f640-427a-a304-d77eeb6aa153 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:30.326793 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1176/2342] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:01:30 2022] PUT /identity/v3/projects/767f762dadb14e65866326304dffe851/users/ee38511700e744a88e3689e6e12ebeeb/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:30.338281 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8155d-5775-4f34-a3d4-f84b3ada7725 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:30.338560 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8155d-5775-4f34-a3d4-f84b3ada7725 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:30.338828 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8155d-5775-4f34-a3d4-f84b3ada7725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:30.368692 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-36e8155d-5775-4f34-a3d4-f84b3ada7725 None None] MFA Rules not processed for user `ee38511700e744a88e3689e6e12ebeeb`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:30.369929 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-36e8155d-5775-4f34-a3d4-f84b3ada7725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:30.438889 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1167/2343] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:30 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:30.449256 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f72d0-f640-427a-a304-d77eeb6aa153 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:30.451344 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d77f72d0-f640-427a-a304-d77eeb6aa153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:30.507238 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f72d0-f640-427a-a304-d77eeb6aa153 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:30.511310 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0e200-b2d0-4ea8-a112-30a548f15344 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:30.512002 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0e200-b2d0-4ea8-a112-30a548f15344 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:30.512241 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0e200-b2d0-4ea8-a112-30a548f15344 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:30.512512 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0e200-b2d0-4ea8-a112-30a548f15344 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:30.524300 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0e200-b2d0-4ea8-a112-30a548f15344 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:30.526339 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0e200-b2d0-4ea8-a112-30a548f15344 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:30.543464 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1177/2344] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:01:30 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:01:30.624291 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8155d-5775-4f34-a3d4-f84b3ada7725 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:30.633922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8155d-5775-4f34-a3d4-f84b3ada7725 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:30.637591 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807aeaf-055c-4bc0-925e-47c3ba970cef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:30.638225 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807aeaf-055c-4bc0-925e-47c3ba970cef service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:30.638503 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807aeaf-055c-4bc0-925e-47c3ba970cef service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:30.638773 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807aeaf-055c-4bc0-925e-47c3ba970cef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:30.696501 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807aeaf-055c-4bc0-925e-47c3ba970cef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:30.698081 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807aeaf-055c-4bc0-925e-47c3ba970cef service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:30.707659 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1168/2345] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:01:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:01:41.028339 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0e200-b2d0-4ea8-a112-30a548f15344 service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:41.092406 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0e200-b2d0-4ea8-a112-30a548f15344 service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:41.098206 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfd3a2-fee5-4530-961f-fce23df1a7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:41.099076 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfd3a2-fee5-4530-961f-fce23df1a7af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:41.099351 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfd3a2-fee5-4530-961f-fce23df1a7af admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:41.099624 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfd3a2-fee5-4530-961f-fce23df1a7af admin admin] PATH_INFO: `/v3/users/37cae0ef46cf44aa9d31673aff5a1e49` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:41.100816 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccfd3a2-fee5-4530-961f-fce23df1a7af admin admin] RBAC: Authorizing `identity:delete_user(user_id=37cae0ef46cf44aa9d31673aff5a1e49)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:41.102778 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccfd3a2-fee5-4530-961f-fce23df1a7af admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:41.150776 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-fccfd3a2-fee5-4530-961f-fce23df1a7af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37cae0ef46cf44aa9d31673aff5a1e49'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:41.158301 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-fccfd3a2-fee5-4530-961f-fce23df1a7af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37cae0ef46cf44aa9d31673aff5a1e49'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:41.171253 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-fccfd3a2-fee5-4530-961f-fce23df1a7af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37cae0ef46cf44aa9d31673aff5a1e49'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:41.172204 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-fccfd3a2-fee5-4530-961f-fce23df1a7af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37cae0ef46cf44aa9d31673aff5a1e49'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:41.172843 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-fccfd3a2-fee5-4530-961f-fce23df1a7af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37cae0ef46cf44aa9d31673aff5a1e49'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:41.186628 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1178/2346] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:01:41 2022] DELETE /identity/v3/users/37cae0ef46cf44aa9d31673aff5a1e49 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:41.190936 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a0cd4-be0f-419d-9f80-0b7c1684ce31 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:41.191399 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a0cd4-be0f-419d-9f80-0b7c1684ce31 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:41.191523 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a0cd4-be0f-419d-9f80-0b7c1684ce31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:41.208160 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-c04a0cd4-be0f-419d-9f80-0b7c1684ce31 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:41.210930 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c04a0cd4-be0f-419d-9f80-0b7c1684ce31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:41.280868 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1169/2347] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:41.287798 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfd3a2-fee5-4530-961f-fce23df1a7af admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:41.289280 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-fccfd3a2-fee5-4530-961f-fce23df1a7af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:41.344536 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfd3a2-fee5-4530-961f-fce23df1a7af admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:41.348107 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdba0a-3636-4681-8c0f-7776aa3c4243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:41.348746 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdba0a-3636-4681-8c0f-7776aa3c4243 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:41.349019 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdba0a-3636-4681-8c0f-7776aa3c4243 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:41.349294 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdba0a-3636-4681-8c0f-7776aa3c4243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:41.359052 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdba0a-3636-4681-8c0f-7776aa3c4243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:41.361011 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdba0a-3636-4681-8c0f-7776aa3c4243 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:41.371679 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1179/2348] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:01:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:01:41.632151 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a0cd4-be0f-419d-9f80-0b7c1684ce31 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:41.633783 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c04a0cd4-be0f-419d-9f80-0b7c1684ce31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:41.650968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a0cd4-be0f-419d-9f80-0b7c1684ce31 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:41.656521 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eba18a-cd65-4b45-8e53-cf2eb66c3615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:41.657408 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eba18a-cd65-4b45-8e53-cf2eb66c3615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:41.658793 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eba18a-cd65-4b45-8e53-cf2eb66c3615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:41.659357 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eba18a-cd65-4b45-8e53-cf2eb66c3615 admin admin] PATH_INFO: `/v3/projects/0ba556a209934b0191a86500f6d8f248` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:41.661028 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eba18a-cd65-4b45-8e53-cf2eb66c3615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ba556a209934b0191a86500f6d8f248)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:41.663014 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eba18a-cd65-4b45-8e53-cf2eb66c3615 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:41.707730 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f59f2-5f40-4d49-ba3b-d3b3f3867b89 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:41.707955 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f59f2-5f40-4d49-ba3b-d3b3f3867b89 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:41.708227 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f59f2-5f40-4d49-ba3b-d3b3f3867b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:41.710064 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f5eba18a-cd65-4b45-8e53-cf2eb66c3615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ba556a209934b0191a86500f6d8f248', 'request_id': 'req-f5eba18a-cd65-4b45-8e53-cf2eb66c3615'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:41.715235 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f5eba18a-cd65-4b45-8e53-cf2eb66c3615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ba556a209934b0191a86500f6d8f248', 'request_id': 'req-f5eba18a-cd65-4b45-8e53-cf2eb66c3615'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:41.721645 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f5eba18a-cd65-4b45-8e53-cf2eb66c3615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ba556a209934b0191a86500f6d8f248', 'request_id': 'req-f5eba18a-cd65-4b45-8e53-cf2eb66c3615'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:41.735715 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f5eba18a-cd65-4b45-8e53-cf2eb66c3615 admin admin] The token cache is being invalidate because project 0ba556a209934b0191a86500f6d8f248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:01:41.735971 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f5eba18a-cd65-4b45-8e53-cf2eb66c3615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:41.736640 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f5eba18a-cd65-4b45-8e53-cf2eb66c3615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:41.738225 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1170/2349] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:01:41 2022] DELETE /identity/v3/projects/0ba556a209934b0191a86500f6d8f248 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:41.742131 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eba18a-cd65-4b45-8e53-cf2eb66c3615 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:41.743446 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f5eba18a-cd65-4b45-8e53-cf2eb66c3615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:41.759801 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-215f59f2-5f40-4d49-ba3b-d3b3f3867b89 None None] MFA Rules not processed for user `de790a1a69994f7498834ded10480e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:41.760981 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-215f59f2-5f40-4d49-ba3b-d3b3f3867b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:41.803285 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eba18a-cd65-4b45-8e53-cf2eb66c3615 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:41.808643 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b0fd7-afe6-4f76-9081-bd0b56c3592f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:41.809551 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b0fd7-afe6-4f76-9081-bd0b56c3592f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:41.809884 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b0fd7-afe6-4f76-9081-bd0b56c3592f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:41.810152 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b0fd7-afe6-4f76-9081-bd0b56c3592f admin admin] PATH_INFO: `/v3/users/ee38511700e744a88e3689e6e12ebeeb` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:41.811459 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b0fd7-afe6-4f76-9081-bd0b56c3592f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee38511700e744a88e3689e6e12ebeeb)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:41.813411 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b0fd7-afe6-4f76-9081-bd0b56c3592f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:41.824982 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1180/2350] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 10 21:01:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 21:01:41.837757 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f59f2-5f40-4d49-ba3b-d3b3f3867b89 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:41.839218 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-215f59f2-5f40-4d49-ba3b-d3b3f3867b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:41.861016 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8c7b0fd7-afe6-4f76-9081-bd0b56c3592f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee38511700e744a88e3689e6e12ebeeb'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:41.867740 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8c7b0fd7-afe6-4f76-9081-bd0b56c3592f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee38511700e744a88e3689e6e12ebeeb'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:41.878948 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8c7b0fd7-afe6-4f76-9081-bd0b56c3592f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee38511700e744a88e3689e6e12ebeeb'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:41.879616 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8c7b0fd7-afe6-4f76-9081-bd0b56c3592f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee38511700e744a88e3689e6e12ebeeb'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:41.888685 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8c7b0fd7-afe6-4f76-9081-bd0b56c3592f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee38511700e744a88e3689e6e12ebeeb'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:41.895196 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1171/2351] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:01:41 2022] DELETE /identity/v3/users/ee38511700e744a88e3689e6e12ebeeb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 21:01:41.933013 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f59f2-5f40-4d49-ba3b-d3b3f3867b89 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:42.000081 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c6f2d-2745-4fcb-98d7-f7d3c80916f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f09689635e54a4e85c0ef0e3539d911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:42.000738 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c6f2d-2745-4fcb-98d7-f7d3c80916f1 service swift] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:42.001016 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c6f2d-2745-4fcb-98d7-f7d3c80916f1 service swift] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:42.001285 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c6f2d-2745-4fcb-98d7-f7d3c80916f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:42.003141 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b96c6f2d-2745-4fcb-98d7-f7d3c80916f1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:42.063939 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c6f2d-2745-4fcb-98d7-f7d3c80916f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:42.065587 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c6f2d-2745-4fcb-98d7-f7d3c80916f1 service swift] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:42.073951 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1181/2352] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 10 21:01:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 21:01:42.172073 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b0fd7-afe6-4f76-9081-bd0b56c3592f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:42.174200 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8c7b0fd7-afe6-4f76-9081-bd0b56c3592f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:42.269227 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b0fd7-afe6-4f76-9081-bd0b56c3592f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:42.278369 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116418d7-6eb1-4ee5-a24d-ec8e115f282c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:42.279768 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116418d7-6eb1-4ee5-a24d-ec8e115f282c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:42.280248 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116418d7-6eb1-4ee5-a24d-ec8e115f282c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:42.281037 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116418d7-6eb1-4ee5-a24d-ec8e115f282c admin admin] PATH_INFO: `/v3/projects/767f762dadb14e65866326304dffe851` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:42.282700 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116418d7-6eb1-4ee5-a24d-ec8e115f282c admin admin] RBAC: Authorizing `identity:delete_project(project_id=767f762dadb14e65866326304dffe851)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:42.285383 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116418d7-6eb1-4ee5-a24d-ec8e115f282c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:42.367999 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-116418d7-6eb1-4ee5-a24d-ec8e115f282c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '767f762dadb14e65866326304dffe851', 'request_id': 'req-116418d7-6eb1-4ee5-a24d-ec8e115f282c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:42.374019 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-116418d7-6eb1-4ee5-a24d-ec8e115f282c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '767f762dadb14e65866326304dffe851', 'request_id': 'req-116418d7-6eb1-4ee5-a24d-ec8e115f282c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:42.382440 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-116418d7-6eb1-4ee5-a24d-ec8e115f282c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '767f762dadb14e65866326304dffe851', 'request_id': 'req-116418d7-6eb1-4ee5-a24d-ec8e115f282c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:42.400142 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-116418d7-6eb1-4ee5-a24d-ec8e115f282c admin admin] The token cache is being invalidate because project 767f762dadb14e65866326304dffe851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:01:42.400432 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-116418d7-6eb1-4ee5-a24d-ec8e115f282c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:42.401163 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-116418d7-6eb1-4ee5-a24d-ec8e115f282c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:42.404641 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1172/2353] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:01:42 2022] DELETE /identity/v3/projects/767f762dadb14e65866326304dffe851 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:42.408354 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791435ec-8326-473d-8fb8-5ed97d317bca None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:42.408703 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791435ec-8326-473d-8fb8-5ed97d317bca None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:42.408911 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791435ec-8326-473d-8fb8-5ed97d317bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:42.429962 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-791435ec-8326-473d-8fb8-5ed97d317bca None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:42.431372 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-791435ec-8326-473d-8fb8-5ed97d317bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:42.516260 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1182/2354] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:42.524230 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737fc8a-d80f-4492-a4aa-7000d9074250 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:42.525481 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737fc8a-d80f-4492-a4aa-7000d9074250 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:42.525976 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737fc8a-d80f-4492-a4aa-7000d9074250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:42.567646 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-a737fc8a-d80f-4492-a4aa-7000d9074250 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:42.568958 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a737fc8a-d80f-4492-a4aa-7000d9074250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:42.577452 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1173/2355] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:42.581966 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791435ec-8326-473d-8fb8-5ed97d317bca None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:42.594392 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791435ec-8326-473d-8fb8-5ed97d317bca None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:42.599179 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ef31c-0c72-4b40-bbd9-e7c77f7b6ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:42.599968 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ef31c-0c72-4b40-bbd9-e7c77f7b6ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:42.600326 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ef31c-0c72-4b40-bbd9-e7c77f7b6ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:42.600690 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ef31c-0c72-4b40-bbd9-e7c77f7b6ac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:42.601712 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ef31c-0c72-4b40-bbd9-e7c77f7b6ac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:01:42.602117 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ef31c-0c72-4b40-bbd9-e7c77f7b6ac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:42.603864 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ef31c-0c72-4b40-bbd9-e7c77f7b6ac9 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:42.617861 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1183/2356] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:01:42.622507 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737fc8a-d80f-4492-a4aa-7000d9074250 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:42.631607 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737fc8a-d80f-4492-a4aa-7000d9074250 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:42.636159 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f81dd8-6168-4c07-b74d-c1c6aae9aafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:42.636798 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f81dd8-6168-4c07-b74d-c1c6aae9aafe admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:42.637071 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f81dd8-6168-4c07-b74d-c1c6aae9aafe admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:42.637337 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f81dd8-6168-4c07-b74d-c1c6aae9aafe admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:42.638080 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f81dd8-6168-4c07-b74d-c1c6aae9aafe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:42.640009 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f81dd8-6168-4c07-b74d-c1c6aae9aafe admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:42.667077 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1174/2357] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:01:42 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:01:42.671567 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ef31c-0c72-4b40-bbd9-e7c77f7b6ac9 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:42.682940 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ef31c-0c72-4b40-bbd9-e7c77f7b6ac9 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:42.737815 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a2182-ec0c-4f04-9b3e-c958dc07418f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:42.738476 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a2182-ec0c-4f04-9b3e-c958dc07418f admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:42.738752 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a2182-ec0c-4f04-9b3e-c958dc07418f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:42.739015 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a2182-ec0c-4f04-9b3e-c958dc07418f admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:42.739731 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a2182-ec0c-4f04-9b3e-c958dc07418f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:42.741642 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a2182-ec0c-4f04-9b3e-c958dc07418f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:42.770295 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f81dd8-6168-4c07-b74d-c1c6aae9aafe admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:42.772174 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1184/2358] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:01:42 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:01:42.781822 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f81dd8-6168-4c07-b74d-c1c6aae9aafe admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:42.787640 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66eb519-cb10-4a41-a5d2-0b609572df27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:42.788389 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66eb519-cb10-4a41-a5d2-0b609572df27 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:42.788750 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66eb519-cb10-4a41-a5d2-0b609572df27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:42.789084 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66eb519-cb10-4a41-a5d2-0b609572df27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:42.789928 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66eb519-cb10-4a41-a5d2-0b609572df27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:42.791624 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66eb519-cb10-4a41-a5d2-0b609572df27 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:42.802909 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1175/2359] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:01:42.806927 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a2182-ec0c-4f04-9b3e-c958dc07418f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:42.817060 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a2182-ec0c-4f04-9b3e-c958dc07418f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:42.822116 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8829b4-c813-4c8c-a3ed-ff94e8e20d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:42.822766 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8829b4-c813-4c8c-a3ed-ff94e8e20d54 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:42.823026 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8829b4-c813-4c8c-a3ed-ff94e8e20d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:42.823297 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8829b4-c813-4c8c-a3ed-ff94e8e20d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:42.824055 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8829b4-c813-4c8c-a3ed-ff94e8e20d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:42.825719 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8829b4-c813-4c8c-a3ed-ff94e8e20d54 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:42.835457 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1185/2360] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:01:42.839259 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66eb519-cb10-4a41-a5d2-0b609572df27 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:42.849558 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66eb519-cb10-4a41-a5d2-0b609572df27 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:42.855666 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20bcba-9113-47b1-b99c-2e391e148dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:42.856564 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20bcba-9113-47b1-b99c-2e391e148dee admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:42.856839 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20bcba-9113-47b1-b99c-2e391e148dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:42.857109 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20bcba-9113-47b1-b99c-2e391e148dee admin admin] PATH_INFO: `/v3/projects/8cef4f7fd08c4539a0bfa59136d5428a/users/496d7f10b4e44c22b2bbd4fc6c3b0f21/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:42.872938 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20bcba-9113-47b1-b99c-2e391e148dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cef4f7fd08c4539a0bfa59136d5428a, user_id=496d7f10b4e44c22b2bbd4fc6c3b0f21, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:42.875593 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20bcba-9113-47b1-b99c-2e391e148dee admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:42.892762 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1176/2361] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:01:42 2022] PUT /identity/v3/projects/8cef4f7fd08c4539a0bfa59136d5428a/users/496d7f10b4e44c22b2bbd4fc6c3b0f21/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:42.903513 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec3ca2-c292-4298-a64f-0e8ac38342e4 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:42.903797 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec3ca2-c292-4298-a64f-0e8ac38342e4 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:42.904032 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec3ca2-c292-4298-a64f-0e8ac38342e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:42.933480 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-84ec3ca2-c292-4298-a64f-0e8ac38342e4 None None] MFA Rules not processed for user `496d7f10b4e44c22b2bbd4fc6c3b0f21`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:42.934840 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-84ec3ca2-c292-4298-a64f-0e8ac38342e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:43.003954 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1186/2362] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:43.008481 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20bcba-9113-47b1-b99c-2e391e148dee admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:43.082187 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20bcba-9113-47b1-b99c-2e391e148dee admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:43.087280 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a91a26-4d8a-4fbd-864a-d8d403626c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:43.088714 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a91a26-4d8a-4fbd-864a-d8d403626c59 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:43.089029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a91a26-4d8a-4fbd-864a-d8d403626c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:43.089336 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a91a26-4d8a-4fbd-864a-d8d403626c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:43.090080 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a91a26-4d8a-4fbd-864a-d8d403626c59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:43.092048 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a91a26-4d8a-4fbd-864a-d8d403626c59 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:43.118968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1177/2363] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:01:43 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:01:43.123571 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec3ca2-c292-4298-a64f-0e8ac38342e4 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:43.134647 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec3ca2-c292-4298-a64f-0e8ac38342e4 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:43.203345 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becba472-54d8-4c1e-8b19-1597882e06b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:43.204044 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becba472-54d8-4c1e-8b19-1597882e06b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:43.204314 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becba472-54d8-4c1e-8b19-1597882e06b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:43.204578 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becba472-54d8-4c1e-8b19-1597882e06b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:43.205270 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becba472-54d8-4c1e-8b19-1597882e06b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:43.207229 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becba472-54d8-4c1e-8b19-1597882e06b5 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:43.230419 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1187/2364] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:01:43 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:01:43.235227 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a91a26-4d8a-4fbd-864a-d8d403626c59 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:43.249727 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a91a26-4d8a-4fbd-864a-d8d403626c59 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:43.256836 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5e081-5e15-4cdc-8383-66e36dcf44b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:43.257839 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5e081-5e15-4cdc-8383-66e36dcf44b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:43.258158 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5e081-5e15-4cdc-8383-66e36dcf44b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:43.258513 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5e081-5e15-4cdc-8383-66e36dcf44b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:43.259624 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5e081-5e15-4cdc-8383-66e36dcf44b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:43.261904 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5e081-5e15-4cdc-8383-66e36dcf44b4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:43.273014 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1178/2365] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 21:01:43.277188 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becba472-54d8-4c1e-8b19-1597882e06b5 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:43.287499 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becba472-54d8-4c1e-8b19-1597882e06b5 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:43.293033 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3ef99-60e2-4324-9f6e-ff20d76ca940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:43.294060 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3ef99-60e2-4324-9f6e-ff20d76ca940 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:43.294336 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3ef99-60e2-4324-9f6e-ff20d76ca940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:43.294603 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3ef99-60e2-4324-9f6e-ff20d76ca940 admin admin] PATH_INFO: `/v3/projects/f7aad1b0a19043d7bdf10b4ed911f1a4/users/b5e7a8c9cd5f40c48261a924b64249b7/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:43.310961 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3ef99-60e2-4324-9f6e-ff20d76ca940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7aad1b0a19043d7bdf10b4ed911f1a4, user_id=b5e7a8c9cd5f40c48261a924b64249b7, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:43.313619 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3ef99-60e2-4324-9f6e-ff20d76ca940 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:43.329639 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1188/2366] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:01:43 2022] PUT /identity/v3/projects/f7aad1b0a19043d7bdf10b4ed911f1a4/users/b5e7a8c9cd5f40c48261a924b64249b7/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:43.333925 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5e081-5e15-4cdc-8383-66e36dcf44b4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:43.344575 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5e081-5e15-4cdc-8383-66e36dcf44b4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:43.399746 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2698d64-59d4-4dce-ae7f-795c83943b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:43.400407 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2698d64-59d4-4dce-ae7f-795c83943b55 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:43.400684 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2698d64-59d4-4dce-ae7f-795c83943b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:43.400948 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2698d64-59d4-4dce-ae7f-795c83943b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:43.401721 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2698d64-59d4-4dce-ae7f-795c83943b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:43.403478 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2698d64-59d4-4dce-ae7f-795c83943b55 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:43.413251 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1179/2367] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:01:43.418263 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3ef99-60e2-4324-9f6e-ff20d76ca940 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:43.429295 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3ef99-60e2-4324-9f6e-ff20d76ca940 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:43.435354 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca038c42-41f0-480e-8cd9-fe844de9ece2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:43.436394 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca038c42-41f0-480e-8cd9-fe844de9ece2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:43.436674 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca038c42-41f0-480e-8cd9-fe844de9ece2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:43.436922 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca038c42-41f0-480e-8cd9-fe844de9ece2 admin admin] PATH_INFO: `/v3/projects/f7aad1b0a19043d7bdf10b4ed911f1a4/users/b5e7a8c9cd5f40c48261a924b64249b7/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:43.439189 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca038c42-41f0-480e-8cd9-fe844de9ece2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7aad1b0a19043d7bdf10b4ed911f1a4, user_id=b5e7a8c9cd5f40c48261a924b64249b7, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:43.441864 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca038c42-41f0-480e-8cd9-fe844de9ece2 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:43.465333 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1189/2368] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:01:43 2022] PUT /identity/v3/projects/f7aad1b0a19043d7bdf10b4ed911f1a4/users/b5e7a8c9cd5f40c48261a924b64249b7/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:43.467272 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93da99-e974-4c42-8d99-74c088e88d30 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:43.467582 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93da99-e974-4c42-8d99-74c088e88d30 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:43.467851 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93da99-e974-4c42-8d99-74c088e88d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:43.496151 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-8c93da99-e974-4c42-8d99-74c088e88d30 None None] MFA Rules not processed for user `b5e7a8c9cd5f40c48261a924b64249b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:43.497527 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8c93da99-e974-4c42-8d99-74c088e88d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:43.574645 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1180/2369] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 21:01:43.586280 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca038c42-41f0-480e-8cd9-fe844de9ece2 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:43.587930 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ca038c42-41f0-480e-8cd9-fe844de9ece2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:43.726660 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca038c42-41f0-480e-8cd9-fe844de9ece2 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:43.734589 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536e482-924f-4386-b879-4f0119507586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:43.735767 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536e482-924f-4386-b879-4f0119507586 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:43.736271 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536e482-924f-4386-b879-4f0119507586 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:43.737691 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536e482-924f-4386-b879-4f0119507586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:43.752766 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536e482-924f-4386-b879-4f0119507586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:43.754266 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536e482-924f-4386-b879-4f0119507586 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:43.767332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1190/2370] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:01:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 21:01:43.845035 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93da99-e974-4c42-8d99-74c088e88d30 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:43.854311 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93da99-e974-4c42-8d99-74c088e88d30 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:43.857941 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92beb2bf-4a6f-4198-aa06-74f7d55f44c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:43.858570 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92beb2bf-4a6f-4198-aa06-74f7d55f44c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:43.858847 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92beb2bf-4a6f-4198-aa06-74f7d55f44c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:43.859115 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92beb2bf-4a6f-4198-aa06-74f7d55f44c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:43.914587 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92beb2bf-4a6f-4198-aa06-74f7d55f44c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:43.916016 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92beb2bf-4a6f-4198-aa06-74f7d55f44c3 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:43.924808 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1181/2371] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:01:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:01:44.180528 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536e482-924f-4386-b879-4f0119507586 service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:44.244593 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536e482-924f-4386-b879-4f0119507586 service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:44.251896 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb273557-276e-4309-8044-56a21ad5ab48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:44.253291 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb273557-276e-4309-8044-56a21ad5ab48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:44.253976 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb273557-276e-4309-8044-56a21ad5ab48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:44.254471 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb273557-276e-4309-8044-56a21ad5ab48 admin admin] PATH_INFO: `/v3/users/496d7f10b4e44c22b2bbd4fc6c3b0f21` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:44.256012 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb273557-276e-4309-8044-56a21ad5ab48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=496d7f10b4e44c22b2bbd4fc6c3b0f21)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:44.258315 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb273557-276e-4309-8044-56a21ad5ab48 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:44.312955 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-bb273557-276e-4309-8044-56a21ad5ab48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '496d7f10b4e44c22b2bbd4fc6c3b0f21'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:44.321460 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-bb273557-276e-4309-8044-56a21ad5ab48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '496d7f10b4e44c22b2bbd4fc6c3b0f21'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:44.334684 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-bb273557-276e-4309-8044-56a21ad5ab48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '496d7f10b4e44c22b2bbd4fc6c3b0f21'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:44.335387 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-bb273557-276e-4309-8044-56a21ad5ab48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '496d7f10b4e44c22b2bbd4fc6c3b0f21'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:44.335975 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-bb273557-276e-4309-8044-56a21ad5ab48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '496d7f10b4e44c22b2bbd4fc6c3b0f21'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:44.351232 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1191/2372] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:01:44 2022] DELETE /identity/v3/users/496d7f10b4e44c22b2bbd4fc6c3b0f21 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:44.356471 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff96b8f-67a3-4933-bee2-652ab8b7d263 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:44.357254 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff96b8f-67a3-4933-bee2-652ab8b7d263 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:44.357254 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff96b8f-67a3-4933-bee2-652ab8b7d263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:44.378161 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-0ff96b8f-67a3-4933-bee2-652ab8b7d263 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:44.379373 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0ff96b8f-67a3-4933-bee2-652ab8b7d263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:44.438411 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1182/2373] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:44.448143 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb273557-276e-4309-8044-56a21ad5ab48 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:44.450027 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-bb273557-276e-4309-8044-56a21ad5ab48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:44.512778 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb273557-276e-4309-8044-56a21ad5ab48 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:44.516851 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54419309-ed22-40d4-9ca3-e73055ce8cf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:44.517545 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54419309-ed22-40d4-9ca3-e73055ce8cf4 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:44.518183 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54419309-ed22-40d4-9ca3-e73055ce8cf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:44.518451 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54419309-ed22-40d4-9ca3-e73055ce8cf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:44.530555 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54419309-ed22-40d4-9ca3-e73055ce8cf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:44.532108 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54419309-ed22-40d4-9ca3-e73055ce8cf4 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:44.543276 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1192/2374] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:01:44.848409 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff96b8f-67a3-4933-bee2-652ab8b7d263 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:44.850035 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0ff96b8f-67a3-4933-bee2-652ab8b7d263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:44.868734 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff96b8f-67a3-4933-bee2-652ab8b7d263 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:44.888253 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f156a28-fb57-4189-95ba-ee7d8f89feaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:44.889175 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f156a28-fb57-4189-95ba-ee7d8f89feaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:44.889528 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f156a28-fb57-4189-95ba-ee7d8f89feaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:44.890040 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f156a28-fb57-4189-95ba-ee7d8f89feaf admin admin] PATH_INFO: `/v3/projects/8cef4f7fd08c4539a0bfa59136d5428a` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:44.896409 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f156a28-fb57-4189-95ba-ee7d8f89feaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cef4f7fd08c4539a0bfa59136d5428a)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:44.898709 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f156a28-fb57-4189-95ba-ee7d8f89feaf admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:44.949706 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3f156a28-fb57-4189-95ba-ee7d8f89feaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cef4f7fd08c4539a0bfa59136d5428a', 'request_id': 'req-3f156a28-fb57-4189-95ba-ee7d8f89feaf'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:44.955241 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3f156a28-fb57-4189-95ba-ee7d8f89feaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cef4f7fd08c4539a0bfa59136d5428a', 'request_id': 'req-3f156a28-fb57-4189-95ba-ee7d8f89feaf'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:44.961484 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3f156a28-fb57-4189-95ba-ee7d8f89feaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cef4f7fd08c4539a0bfa59136d5428a', 'request_id': 'req-3f156a28-fb57-4189-95ba-ee7d8f89feaf'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:44.980430 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3f156a28-fb57-4189-95ba-ee7d8f89feaf admin admin] The token cache is being invalidate because project 8cef4f7fd08c4539a0bfa59136d5428a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:01:44.980830 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3f156a28-fb57-4189-95ba-ee7d8f89feaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:44.981639 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3f156a28-fb57-4189-95ba-ee7d8f89feaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:44.988262 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54419309-ed22-40d4-9ca3-e73055ce8cf4 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:44.988876 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1183/2375] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:01:44 2022] DELETE /identity/v3/projects/8cef4f7fd08c4539a0bfa59136d5428a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:44.998440 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54419309-ed22-40d4-9ca3-e73055ce8cf4 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:45.055725 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5168b9d-144c-49de-b5f1-2ea70260b29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:45.056614 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5168b9d-144c-49de-b5f1-2ea70260b29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:45.056890 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5168b9d-144c-49de-b5f1-2ea70260b29b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:45.057159 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5168b9d-144c-49de-b5f1-2ea70260b29b admin admin] PATH_INFO: `/v3/users/b5e7a8c9cd5f40c48261a924b64249b7` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:45.058563 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5168b9d-144c-49de-b5f1-2ea70260b29b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5e7a8c9cd5f40c48261a924b64249b7)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:45.060628 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5168b9d-144c-49de-b5f1-2ea70260b29b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:45.111652 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f5168b9d-144c-49de-b5f1-2ea70260b29b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5e7a8c9cd5f40c48261a924b64249b7'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:45.118104 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f5168b9d-144c-49de-b5f1-2ea70260b29b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5e7a8c9cd5f40c48261a924b64249b7'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:45.129051 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f5168b9d-144c-49de-b5f1-2ea70260b29b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5e7a8c9cd5f40c48261a924b64249b7'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:45.129792 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f5168b9d-144c-49de-b5f1-2ea70260b29b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5e7a8c9cd5f40c48261a924b64249b7'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:45.130443 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f5168b9d-144c-49de-b5f1-2ea70260b29b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5e7a8c9cd5f40c48261a924b64249b7'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:45.145745 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1193/2376] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:01:44 2022] DELETE /identity/v3/users/b5e7a8c9cd5f40c48261a924b64249b7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:45.438750 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f156a28-fb57-4189-95ba-ee7d8f89feaf admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:45.441409 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3f156a28-fb57-4189-95ba-ee7d8f89feaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:45.464993 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f156a28-fb57-4189-95ba-ee7d8f89feaf admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:45.527213 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bb17b-ad03-4129-b772-04263908346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:45.528328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bb17b-ad03-4129-b772-04263908346d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:45.528668 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bb17b-ad03-4129-b772-04263908346d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:45.529002 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bb17b-ad03-4129-b772-04263908346d admin admin] PATH_INFO: `/v3/projects/f7aad1b0a19043d7bdf10b4ed911f1a4` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:45.530332 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bb17b-ad03-4129-b772-04263908346d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7aad1b0a19043d7bdf10b4ed911f1a4)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:45.532371 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bb17b-ad03-4129-b772-04263908346d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:45.579363 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d05bb17b-ad03-4129-b772-04263908346d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7aad1b0a19043d7bdf10b4ed911f1a4', 'request_id': 'req-d05bb17b-ad03-4129-b772-04263908346d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:45.584545 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d05bb17b-ad03-4129-b772-04263908346d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7aad1b0a19043d7bdf10b4ed911f1a4', 'request_id': 'req-d05bb17b-ad03-4129-b772-04263908346d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:45.590481 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d05bb17b-ad03-4129-b772-04263908346d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7aad1b0a19043d7bdf10b4ed911f1a4', 'request_id': 'req-d05bb17b-ad03-4129-b772-04263908346d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:45.604593 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d05bb17b-ad03-4129-b772-04263908346d admin admin] The token cache is being invalidate because project f7aad1b0a19043d7bdf10b4ed911f1a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:01:45.604876 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d05bb17b-ad03-4129-b772-04263908346d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:45.605536 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d05bb17b-ad03-4129-b772-04263908346d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:45.607413 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1184/2377] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:01:45 2022] DELETE /identity/v3/projects/f7aad1b0a19043d7bdf10b4ed911f1a4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:45.612220 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bbdc7-709c-4bc2-8f68-2d95e3e7ae48 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:45.612768 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bbdc7-709c-4bc2-8f68-2d95e3e7ae48 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:45.612768 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bbdc7-709c-4bc2-8f68-2d95e3e7ae48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:45.640536 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-3c0bbdc7-709c-4bc2-8f68-2d95e3e7ae48 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:45.641756 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-3c0bbdc7-709c-4bc2-8f68-2d95e3e7ae48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:45.700575 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1194/2378] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:45.710173 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551333a-4982-4cc5-9f51-487f772248df None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:45.710739 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551333a-4982-4cc5-9f51-487f772248df None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:45.711032 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551333a-4982-4cc5-9f51-487f772248df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:45.737769 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-2551333a-4982-4cc5-9f51-487f772248df None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:45.739122 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2551333a-4982-4cc5-9f51-487f772248df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:45.749184 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1185/2379] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:45.753637 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bbdc7-709c-4bc2-8f68-2d95e3e7ae48 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:45.763386 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bbdc7-709c-4bc2-8f68-2d95e3e7ae48 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:45.768519 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77210d-c4ed-4a56-ab01-55148e4b189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:45.769182 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77210d-c4ed-4a56-ab01-55148e4b189c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:45.769490 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77210d-c4ed-4a56-ab01-55148e4b189c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:45.769760 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77210d-c4ed-4a56-ab01-55148e4b189c admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:45.770643 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77210d-c4ed-4a56-ab01-55148e4b189c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:01:45.770946 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77210d-c4ed-4a56-ab01-55148e4b189c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:45.772544 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77210d-c4ed-4a56-ab01-55148e4b189c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:45.786271 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1195/2380] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:01:45.790570 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551333a-4982-4cc5-9f51-487f772248df None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:45.800330 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551333a-4982-4cc5-9f51-487f772248df None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:45.805751 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8634e-4b2f-4e52-ab9b-21000e1eac8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:45.806416 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8634e-4b2f-4e52-ab9b-21000e1eac8b admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:45.806690 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8634e-4b2f-4e52-ab9b-21000e1eac8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:45.806950 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8634e-4b2f-4e52-ab9b-21000e1eac8b admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:45.807641 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8634e-4b2f-4e52-ab9b-21000e1eac8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:45.809743 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8634e-4b2f-4e52-ab9b-21000e1eac8b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:45.844995 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1186/2381] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:01:45 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:01:45.848990 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77210d-c4ed-4a56-ab01-55148e4b189c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:45.858941 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77210d-c4ed-4a56-ab01-55148e4b189c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:45.915474 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13811f-47c9-4af8-b4a5-9bdeede89b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:45.916160 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13811f-47c9-4af8-b4a5-9bdeede89b77 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:45.916436 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13811f-47c9-4af8-b4a5-9bdeede89b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:45.916733 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13811f-47c9-4af8-b4a5-9bdeede89b77 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:45.917465 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13811f-47c9-4af8-b4a5-9bdeede89b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:45.919410 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13811f-47c9-4af8-b4a5-9bdeede89b77 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:45.946879 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1196/2382] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:01:45 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:01:45.957890 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8634e-4b2f-4e52-ab9b-21000e1eac8b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:45.968430 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8634e-4b2f-4e52-ab9b-21000e1eac8b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:45.973226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244d75b-d822-4aab-b78c-9065858c7896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:45.973920 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244d75b-d822-4aab-b78c-9065858c7896 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:45.974195 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244d75b-d822-4aab-b78c-9065858c7896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:45.974458 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244d75b-d822-4aab-b78c-9065858c7896 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:45.975188 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244d75b-d822-4aab-b78c-9065858c7896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:45.976778 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244d75b-d822-4aab-b78c-9065858c7896 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:45.988200 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1187/2383] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:01:45.992455 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13811f-47c9-4af8-b4a5-9bdeede89b77 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:46.003368 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13811f-47c9-4af8-b4a5-9bdeede89b77 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:46.008153 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ba2be-2608-45e1-8e57-68c20545ed61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:46.008812 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ba2be-2608-45e1-8e57-68c20545ed61 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:46.009089 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ba2be-2608-45e1-8e57-68c20545ed61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:46.009343 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ba2be-2608-45e1-8e57-68c20545ed61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:46.010114 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ba2be-2608-45e1-8e57-68c20545ed61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:46.011869 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ba2be-2608-45e1-8e57-68c20545ed61 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:46.022167 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1197/2384] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:01:46.026489 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244d75b-d822-4aab-b78c-9065858c7896 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:46.048192 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244d75b-d822-4aab-b78c-9065858c7896 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:46.053026 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9322370-5a08-4316-bc79-8600dc9b7eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:46.054018 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9322370-5a08-4316-bc79-8600dc9b7eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:46.054296 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9322370-5a08-4316-bc79-8600dc9b7eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:46.054589 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9322370-5a08-4316-bc79-8600dc9b7eb4 admin admin] PATH_INFO: `/v3/projects/d9b38067e1f541efa96251b607957e91/users/e42d57da6cd54886a495434f7defd443/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:46.070806 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9322370-5a08-4316-bc79-8600dc9b7eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b38067e1f541efa96251b607957e91, user_id=e42d57da6cd54886a495434f7defd443, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:46.073932 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9322370-5a08-4316-bc79-8600dc9b7eb4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:46.090703 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1188/2385] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:01:46 2022] PUT /identity/v3/projects/d9b38067e1f541efa96251b607957e91/users/e42d57da6cd54886a495434f7defd443/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 21:01:46.102583 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362b0c5-959e-4ae8-a440-3609552398b6 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:46.102874 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362b0c5-959e-4ae8-a440-3609552398b6 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:46.103152 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362b0c5-959e-4ae8-a440-3609552398b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:46.132127 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-4362b0c5-959e-4ae8-a440-3609552398b6 None None] MFA Rules not processed for user `e42d57da6cd54886a495434f7defd443`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:46.133389 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4362b0c5-959e-4ae8-a440-3609552398b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:46.209231 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1198/2386] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:46.219009 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9322370-5a08-4316-bc79-8600dc9b7eb4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:46.220671 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b9322370-5a08-4316-bc79-8600dc9b7eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:46.277605 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9322370-5a08-4316-bc79-8600dc9b7eb4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:46.281283 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcab32b-7963-4c6e-ab63-9974570fc799 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:46.281963 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcab32b-7963-4c6e-ab63-9974570fc799 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:46.282242 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcab32b-7963-4c6e-ab63-9974570fc799 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:46.282511 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcab32b-7963-4c6e-ab63-9974570fc799 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:46.291498 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcab32b-7963-4c6e-ab63-9974570fc799 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:46.293058 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcab32b-7963-4c6e-ab63-9974570fc799 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:46.301526 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1189/2387] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:01:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:01:46.323782 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362b0c5-959e-4ae8-a440-3609552398b6 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:46.393205 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362b0c5-959e-4ae8-a440-3609552398b6 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:46.398647 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02c2dc-d55c-428d-a144-3a3b04d66496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:46.399523 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02c2dc-d55c-428d-a144-3a3b04d66496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:46.399799 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02c2dc-d55c-428d-a144-3a3b04d66496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:46.400068 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02c2dc-d55c-428d-a144-3a3b04d66496 admin admin] PATH_INFO: `/v3/users/e42d57da6cd54886a495434f7defd443` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:46.401313 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02c2dc-d55c-428d-a144-3a3b04d66496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e42d57da6cd54886a495434f7defd443)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:46.403351 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02c2dc-d55c-428d-a144-3a3b04d66496 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:46.453952 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-3a02c2dc-d55c-428d-a144-3a3b04d66496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e42d57da6cd54886a495434f7defd443'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:46.461412 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-3a02c2dc-d55c-428d-a144-3a3b04d66496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e42d57da6cd54886a495434f7defd443'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:46.473319 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-3a02c2dc-d55c-428d-a144-3a3b04d66496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e42d57da6cd54886a495434f7defd443'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:46.474134 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-3a02c2dc-d55c-428d-a144-3a3b04d66496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e42d57da6cd54886a495434f7defd443'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:46.474740 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-3a02c2dc-d55c-428d-a144-3a3b04d66496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e42d57da6cd54886a495434f7defd443'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:46.489932 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1199/2388] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:01:46 2022] DELETE /identity/v3/users/e42d57da6cd54886a495434f7defd443 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:46.494532 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924e35f-debe-4926-bd31-9a28b37844e3 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:46.495050 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924e35f-debe-4926-bd31-9a28b37844e3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:46.495050 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924e35f-debe-4926-bd31-9a28b37844e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:46.512666 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-f924e35f-debe-4926-bd31-9a28b37844e3 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:46.513894 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f924e35f-debe-4926-bd31-9a28b37844e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:46.587573 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1190/2389] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:46.598088 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02c2dc-d55c-428d-a144-3a3b04d66496 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:46.599506 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-3a02c2dc-d55c-428d-a144-3a3b04d66496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:46.656502 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02c2dc-d55c-428d-a144-3a3b04d66496 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:46.661316 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d8c70-5748-4da0-8375-19680f8cdfb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:46.662018 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d8c70-5748-4da0-8375-19680f8cdfb8 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:46.662294 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d8c70-5748-4da0-8375-19680f8cdfb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:46.662560 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d8c70-5748-4da0-8375-19680f8cdfb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:46.676450 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d8c70-5748-4da0-8375-19680f8cdfb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:46.678183 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d8c70-5748-4da0-8375-19680f8cdfb8 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:46.690247 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1200/2390] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:01:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:01:47.217728 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924e35f-debe-4926-bd31-9a28b37844e3 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:47.219155 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f924e35f-debe-4926-bd31-9a28b37844e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:47.230954 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924e35f-debe-4926-bd31-9a28b37844e3 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:47.235666 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ce0cc-2850-427f-bb04-a71b1073ffe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:47.236533 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ce0cc-2850-427f-bb04-a71b1073ffe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:47.236810 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ce0cc-2850-427f-bb04-a71b1073ffe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:47.237079 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ce0cc-2850-427f-bb04-a71b1073ffe4 admin admin] PATH_INFO: `/v3/projects/d9b38067e1f541efa96251b607957e91` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:47.238312 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ce0cc-2850-427f-bb04-a71b1073ffe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9b38067e1f541efa96251b607957e91)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:47.240273 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ce0cc-2850-427f-bb04-a71b1073ffe4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:47.312299 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-807ce0cc-2850-427f-bb04-a71b1073ffe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b38067e1f541efa96251b607957e91', 'request_id': 'req-807ce0cc-2850-427f-bb04-a71b1073ffe4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:47.318082 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-807ce0cc-2850-427f-bb04-a71b1073ffe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b38067e1f541efa96251b607957e91', 'request_id': 'req-807ce0cc-2850-427f-bb04-a71b1073ffe4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:47.324144 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-807ce0cc-2850-427f-bb04-a71b1073ffe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b38067e1f541efa96251b607957e91', 'request_id': 'req-807ce0cc-2850-427f-bb04-a71b1073ffe4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:47.336551 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-807ce0cc-2850-427f-bb04-a71b1073ffe4 admin admin] The token cache is being invalidate because project d9b38067e1f541efa96251b607957e91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:01:47.336834 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-807ce0cc-2850-427f-bb04-a71b1073ffe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:47.337485 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-807ce0cc-2850-427f-bb04-a71b1073ffe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:01:47.339035 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1191/2391] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:01:47 2022] DELETE /identity/v3/projects/d9b38067e1f541efa96251b607957e91 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:47.346481 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0661bc9-6389-46e7-89fb-6003335aa012 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:47.346880 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0661bc9-6389-46e7-89fb-6003335aa012 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:47.347342 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0661bc9-6389-46e7-89fb-6003335aa012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:47.366809 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-c0661bc9-6389-46e7-89fb-6003335aa012 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:47.368313 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-c0661bc9-6389-46e7-89fb-6003335aa012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:47.433654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1201/2392] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 21:01:47.441324 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb5473-58c3-4cda-93ba-62a9f3bdb242 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:47.441642 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb5473-58c3-4cda-93ba-62a9f3bdb242 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:47.441917 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb5473-58c3-4cda-93ba-62a9f3bdb242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:47.460211 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-54eb5473-58c3-4cda-93ba-62a9f3bdb242 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:47.461388 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-54eb5473-58c3-4cda-93ba-62a9f3bdb242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:47.471365 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1192/2393] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:47.475788 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0661bc9-6389-46e7-89fb-6003335aa012 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:47.485863 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0661bc9-6389-46e7-89fb-6003335aa012 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:47.491047 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358357f0-bb24-4975-9e7b-4372f98469df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:47.491928 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358357f0-bb24-4975-9e7b-4372f98469df admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:47.492382 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358357f0-bb24-4975-9e7b-4372f98469df admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:47.492812 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358357f0-bb24-4975-9e7b-4372f98469df admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:47.494006 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358357f0-bb24-4975-9e7b-4372f98469df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:01:47.494633 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358357f0-bb24-4975-9e7b-4372f98469df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:47.496573 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358357f0-bb24-4975-9e7b-4372f98469df admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:47.509814 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1202/2394] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:01:47.514361 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb5473-58c3-4cda-93ba-62a9f3bdb242 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:47.523948 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb5473-58c3-4cda-93ba-62a9f3bdb242 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:47.528901 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc16120-80c4-4231-8460-902a321394e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:47.529587 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc16120-80c4-4231-8460-902a321394e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:47.529924 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc16120-80c4-4231-8460-902a321394e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:47.530194 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc16120-80c4-4231-8460-902a321394e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:47.530922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc16120-80c4-4231-8460-902a321394e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:47.532800 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc16120-80c4-4231-8460-902a321394e6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:47.563930 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1193/2395] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:01:47 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:01:47.568426 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358357f0-bb24-4975-9e7b-4372f98469df admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:47.579231 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358357f0-bb24-4975-9e7b-4372f98469df admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:47.635003 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5926641-e338-4b7a-bc1e-c2c56fb6c838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:47.635719 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5926641-e338-4b7a-bc1e-c2c56fb6c838 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:47.635990 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5926641-e338-4b7a-bc1e-c2c56fb6c838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:47.636355 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5926641-e338-4b7a-bc1e-c2c56fb6c838 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:47.637056 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5926641-e338-4b7a-bc1e-c2c56fb6c838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:47.638988 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5926641-e338-4b7a-bc1e-c2c56fb6c838 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:47.664255 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1203/2396] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:01:47 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:01:47.665661 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc16120-80c4-4231-8460-902a321394e6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:47.676846 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc16120-80c4-4231-8460-902a321394e6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:47.682438 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e5035-450c-472f-b6b3-c5bf43df2545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:47.683339 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e5035-450c-472f-b6b3-c5bf43df2545 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:47.683774 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e5035-450c-472f-b6b3-c5bf43df2545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:47.684247 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e5035-450c-472f-b6b3-c5bf43df2545 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:47.685140 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e5035-450c-472f-b6b3-c5bf43df2545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:47.686933 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e5035-450c-472f-b6b3-c5bf43df2545 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:47.698620 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1194/2397] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:01:47.702816 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5926641-e338-4b7a-bc1e-c2c56fb6c838 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:47.713180 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5926641-e338-4b7a-bc1e-c2c56fb6c838 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:47.718447 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798b435-a0ac-45ca-a1db-734e73b4fa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:47.719107 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798b435-a0ac-45ca-a1db-734e73b4fa72 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:47.719386 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798b435-a0ac-45ca-a1db-734e73b4fa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:47.719656 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798b435-a0ac-45ca-a1db-734e73b4fa72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:47.720386 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798b435-a0ac-45ca-a1db-734e73b4fa72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:47.722027 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798b435-a0ac-45ca-a1db-734e73b4fa72 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:47.732441 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1204/2398] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:01:47.736466 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e5035-450c-472f-b6b3-c5bf43df2545 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:47.746941 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e5035-450c-472f-b6b3-c5bf43df2545 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:47.752396 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f98c3-69e3-4f48-8dd6-9f7f78c33164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:47.753270 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f98c3-69e3-4f48-8dd6-9f7f78c33164 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:47.753569 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f98c3-69e3-4f48-8dd6-9f7f78c33164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:47.753837 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f98c3-69e3-4f48-8dd6-9f7f78c33164 admin admin] PATH_INFO: `/v3/projects/a0f7286c938b451c99606e53827219ee/users/5cdbe27c1eee4d69941003caebe1c5aa/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:47.770723 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f98c3-69e3-4f48-8dd6-9f7f78c33164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f7286c938b451c99606e53827219ee, user_id=5cdbe27c1eee4d69941003caebe1c5aa, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:47.773370 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f98c3-69e3-4f48-8dd6-9f7f78c33164 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:47.790281 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1195/2399] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:01:47 2022] PUT /identity/v3/projects/a0f7286c938b451c99606e53827219ee/users/5cdbe27c1eee4d69941003caebe1c5aa/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:47.795742 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563ade9-2dbb-41c8-8b63-85ba2c5f686b None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:47.796258 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563ade9-2dbb-41c8-8b63-85ba2c5f686b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:47.796633 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563ade9-2dbb-41c8-8b63-85ba2c5f686b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:47.816942 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-c563ade9-2dbb-41c8-8b63-85ba2c5f686b None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:47.818311 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-c563ade9-2dbb-41c8-8b63-85ba2c5f686b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:47.875993 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1205/2400] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:47.885764 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f98c3-69e3-4f48-8dd6-9f7f78c33164 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:47.887584 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4e9f98c3-69e3-4f48-8dd6-9f7f78c33164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:47.944011 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f98c3-69e3-4f48-8dd6-9f7f78c33164 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:47.947660 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53314cd9-72c2-4790-8701-fc31be5da240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:47.948287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53314cd9-72c2-4790-8701-fc31be5da240 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:47.948591 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53314cd9-72c2-4790-8701-fc31be5da240 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:47.948861 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53314cd9-72c2-4790-8701-fc31be5da240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:47.957461 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53314cd9-72c2-4790-8701-fc31be5da240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:47.958898 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53314cd9-72c2-4790-8701-fc31be5da240 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:47.968095 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1196/2401] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:01:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:01:52.628173 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa73fd-d5fb-4308-9d27-a56b42d43c9f None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:52.628791 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa73fd-d5fb-4308-9d27-a56b42d43c9f None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:52.629020 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa73fd-d5fb-4308-9d27-a56b42d43c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:52.684621 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-f0fa73fd-d5fb-4308-9d27-a56b42d43c9f None None] MFA Rules not processed for user `5cdbe27c1eee4d69941003caebe1c5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:52.685935 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-f0fa73fd-d5fb-4308-9d27-a56b42d43c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:52.753782 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1206/2402] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:52.758384 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53314cd9-72c2-4790-8701-fc31be5da240 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:52.772952 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53314cd9-72c2-4790-8701-fc31be5da240 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:52.778177 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff75465-238a-4055-8069-d8ad254984f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:52.779934 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff75465-238a-4055-8069-d8ad254984f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:52.780793 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff75465-238a-4055-8069-d8ad254984f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:52.781180 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff75465-238a-4055-8069-d8ad254984f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:52.781944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff75465-238a-4055-8069-d8ad254984f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:52.783970 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff75465-238a-4055-8069-d8ad254984f5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:52.812669 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1197/2403] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:01:52 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 21:01:52.816601 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa73fd-d5fb-4308-9d27-a56b42d43c9f None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:52.827502 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa73fd-d5fb-4308-9d27-a56b42d43c9f None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:52.915557 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753637f7-3ca7-4268-9ba4-d5135cbd2c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:52.916151 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753637f7-3ca7-4268-9ba4-d5135cbd2c1e admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:52.916527 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753637f7-3ca7-4268-9ba4-d5135cbd2c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:52.916825 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753637f7-3ca7-4268-9ba4-d5135cbd2c1e admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:52.917623 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753637f7-3ca7-4268-9ba4-d5135cbd2c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:52.919672 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753637f7-3ca7-4268-9ba4-d5135cbd2c1e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:52.956679 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1207/2404] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:01:52 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:01:52.957639 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff75465-238a-4055-8069-d8ad254984f5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:52.971191 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff75465-238a-4055-8069-d8ad254984f5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:52.976214 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f3c6c-c61d-4689-a0f1-fbcd667d13ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:52.976889 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f3c6c-c61d-4689-a0f1-fbcd667d13ac admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:52.977164 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f3c6c-c61d-4689-a0f1-fbcd667d13ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:52.977464 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f3c6c-c61d-4689-a0f1-fbcd667d13ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:52.978368 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f3c6c-c61d-4689-a0f1-fbcd667d13ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:52.979964 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f3c6c-c61d-4689-a0f1-fbcd667d13ac admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:52.996479 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1198/2405] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 21:01:53.000725 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753637f7-3ca7-4268-9ba4-d5135cbd2c1e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:53.011096 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753637f7-3ca7-4268-9ba4-d5135cbd2c1e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:53.015823 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c430bc-1384-4345-9981-192ab3c6b157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:53.016749 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c430bc-1384-4345-9981-192ab3c6b157 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:53.017028 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c430bc-1384-4345-9981-192ab3c6b157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:53.017299 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c430bc-1384-4345-9981-192ab3c6b157 admin admin] PATH_INFO: `/v3/projects/3b8f95bf07ed425f8f3d225b5b959073/users/0b3f786d2305413c8c0945eddd513879/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:53.035658 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c430bc-1384-4345-9981-192ab3c6b157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8f95bf07ed425f8f3d225b5b959073, user_id=0b3f786d2305413c8c0945eddd513879, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:53.038375 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c430bc-1384-4345-9981-192ab3c6b157 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:53.058585 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1208/2406] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:01:52 2022] PUT /identity/v3/projects/3b8f95bf07ed425f8f3d225b5b959073/users/0b3f786d2305413c8c0945eddd513879/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:53.060126 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f3c6c-c61d-4689-a0f1-fbcd667d13ac admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:53.073922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f3c6c-c61d-4689-a0f1-fbcd667d13ac admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:53.130203 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397ef22-abc4-446c-b7e0-ce44461a3986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:53.131105 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397ef22-abc4-446c-b7e0-ce44461a3986 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:53.131553 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397ef22-abc4-446c-b7e0-ce44461a3986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:53.131860 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397ef22-abc4-446c-b7e0-ce44461a3986 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:53.132815 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397ef22-abc4-446c-b7e0-ce44461a3986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:53.135048 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397ef22-abc4-446c-b7e0-ce44461a3986 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:53.150317 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1199/2407] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:01:53.151553 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c430bc-1384-4345-9981-192ab3c6b157 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:53.166014 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c430bc-1384-4345-9981-192ab3c6b157 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:53.177380 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcd9d6-ae6e-4e11-bb47-b694ef062100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:53.178416 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcd9d6-ae6e-4e11-bb47-b694ef062100 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:53.178753 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcd9d6-ae6e-4e11-bb47-b694ef062100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:53.179087 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcd9d6-ae6e-4e11-bb47-b694ef062100 admin admin] PATH_INFO: `/v3/projects/3b8f95bf07ed425f8f3d225b5b959073/users/0b3f786d2305413c8c0945eddd513879/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:53.181207 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcd9d6-ae6e-4e11-bb47-b694ef062100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8f95bf07ed425f8f3d225b5b959073, user_id=0b3f786d2305413c8c0945eddd513879, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:53.190987 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcd9d6-ae6e-4e11-bb47-b694ef062100 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:53.207239 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1209/2408] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:01:53 2022] PUT /identity/v3/projects/3b8f95bf07ed425f8f3d225b5b959073/users/0b3f786d2305413c8c0945eddd513879/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:01:58.658442 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2a50f-e328-4c9b-a4dd-3a8b6e344a78 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:58.659094 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2a50f-e328-4c9b-a4dd-3a8b6e344a78 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:58.659094 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2a50f-e328-4c9b-a4dd-3a8b6e344a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:58.685223 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-86b2a50f-e328-4c9b-a4dd-3a8b6e344a78 None None] MFA Rules not processed for user `0b3f786d2305413c8c0945eddd513879`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:01:58.686384 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-86b2a50f-e328-4c9b-a4dd-3a8b6e344a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:58.760488 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1200/2409] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:01:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:01:58.767414 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcd9d6-ae6e-4e11-bb47-b694ef062100 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:01:58.769498 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-89fcd9d6-ae6e-4e11-bb47-b694ef062100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:01:58.854679 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcd9d6-ae6e-4e11-bb47-b694ef062100 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:01:58.860657 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1abdb7-730b-447a-bb3d-70e60fb1bace service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:01:58.861309 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1abdb7-730b-447a-bb3d-70e60fb1bace service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:01:58.861685 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1abdb7-730b-447a-bb3d-70e60fb1bace service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:01:58.862005 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1abdb7-730b-447a-bb3d-70e60fb1bace service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:01:58.927956 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1abdb7-730b-447a-bb3d-70e60fb1bace service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:01:58.929379 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1abdb7-730b-447a-bb3d-70e60fb1bace service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:01:58.945124 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1210/2410] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:01:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 21:02:00.209937 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52815d58-2843-486d-ad0f-09280386a066 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:02:00.210808 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52815d58-2843-486d-ad0f-09280386a066 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:02:00.210808 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52815d58-2843-486d-ad0f-09280386a066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:02:00.228997 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-52815d58-2843-486d-ad0f-09280386a066 None None] MFA Rules not processed for user `5cdbe27c1eee4d69941003caebe1c5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:02:00.230249 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-52815d58-2843-486d-ad0f-09280386a066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:02:00.237103 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1201/2411] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:02:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:02:39.377194 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83204a03-ed1e-4a9f-a3d4-e1460642da04 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:02:39.377724 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83204a03-ed1e-4a9f-a3d4-e1460642da04 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:02:39.377724 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83204a03-ed1e-4a9f-a3d4-e1460642da04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:02:39.395948 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-83204a03-ed1e-4a9f-a3d4-e1460642da04 None None] MFA Rules not processed for user `de790a1a69994f7498834ded10480e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:02:39.397132 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-83204a03-ed1e-4a9f-a3d4-e1460642da04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:02:39.456743 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1211/2412] 10.222.0.31 () {58 vars in 967 bytes} [Thu Feb 10 21:02:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:02:39.479468 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52815d58-2843-486d-ad0f-09280386a066 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:02:39.481136 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-52815d58-2843-486d-ad0f-09280386a066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:02:39.559144 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52815d58-2843-486d-ad0f-09280386a066 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:02:39.564564 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280381c-2736-4de3-bfe9-ef0d88888c98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f09689635e54a4e85c0ef0e3539d911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:02:39.565494 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280381c-2736-4de3-bfe9-ef0d88888c98 service swift] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:02:39.565989 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280381c-2736-4de3-bfe9-ef0d88888c98 service swift] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:02:39.566257 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280381c-2736-4de3-bfe9-ef0d88888c98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:02:39.575041 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280381c-2736-4de3-bfe9-ef0d88888c98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:02:39.576638 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280381c-2736-4de3-bfe9-ef0d88888c98 service swift] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:02:39.585454 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1202/2413] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 10 21:02:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 21:02:58.586227 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83204a03-ed1e-4a9f-a3d4-e1460642da04 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:02:58.638591 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83204a03-ed1e-4a9f-a3d4-e1460642da04 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:02:58.642823 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71628704-14a3-4a38-95af-08d6a33c1ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:02:58.643601 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71628704-14a3-4a38-95af-08d6a33c1ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:02:58.643780 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71628704-14a3-4a38-95af-08d6a33c1ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:02:58.644004 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71628704-14a3-4a38-95af-08d6a33c1ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:02:58.646257 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-71628704-14a3-4a38-95af-08d6a33c1ad6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:02:58.659916 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71628704-14a3-4a38-95af-08d6a33c1ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:02:58.661327 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71628704-14a3-4a38-95af-08d6a33c1ad6 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:02:58.671700 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1212/2414] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:02:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:02:59.880431 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280381c-2736-4de3-bfe9-ef0d88888c98 service swift] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:02:59.895020 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280381c-2736-4de3-bfe9-ef0d88888c98 service swift] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:02:59.899663 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef979d15-b120-47e2-83b4-825492c461a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:02:59.900296 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef979d15-b120-47e2-83b4-825492c461a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:02:59.900572 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef979d15-b120-47e2-83b4-825492c461a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:02:59.900837 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef979d15-b120-47e2-83b4-825492c461a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:02:59.903029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ef979d15-b120-47e2-83b4-825492c461a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:02:59.917159 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef979d15-b120-47e2-83b4-825492c461a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:02:59.918630 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef979d15-b120-47e2-83b4-825492c461a6 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:02:59.930138 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1203/2415] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:02:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:03:08.678381 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71628704-14a3-4a38-95af-08d6a33c1ad6 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:03:08.681419 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-71628704-14a3-4a38-95af-08d6a33c1ad6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:03:08.745158 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71628704-14a3-4a38-95af-08d6a33c1ad6 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:03:08.749184 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ad73f-ed31-4030-8afb-5d69387274f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:03:08.749868 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ad73f-ed31-4030-8afb-5d69387274f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:03:08.750146 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ad73f-ed31-4030-8afb-5d69387274f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:03:08.750418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ad73f-ed31-4030-8afb-5d69387274f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:03:08.752544 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-464ad73f-ed31-4030-8afb-5d69387274f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:03:08.823552 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ad73f-ed31-4030-8afb-5d69387274f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:03:08.824931 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ad73f-ed31-4030-8afb-5d69387274f9 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:03:08.834207 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1213/2416] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:03:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:04:00.501849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef979d15-b120-47e2-83b4-825492c461a6 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:04:00.503505 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ef979d15-b120-47e2-83b4-825492c461a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:04:00.517475 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef979d15-b120-47e2-83b4-825492c461a6 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:04:00.524609 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bd168-77cb-4d30-b3e7-61ea5d7630fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:04:00.525255 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bd168-77cb-4d30-b3e7-61ea5d7630fb service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:04:00.525586 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bd168-77cb-4d30-b3e7-61ea5d7630fb service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:04:00.525848 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bd168-77cb-4d30-b3e7-61ea5d7630fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:04:00.527894 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b64bd168-77cb-4d30-b3e7-61ea5d7630fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:04:00.601277 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64bd168-77cb-4d30-b3e7-61ea5d7630fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:04:00.602799 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64bd168-77cb-4d30-b3e7-61ea5d7630fb service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:04:00.612153 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1204/2417] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:04:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:04:06.022401 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ad73f-ed31-4030-8afb-5d69387274f9 service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:04:06.032696 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ad73f-ed31-4030-8afb-5d69387274f9 service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:04:06.037810 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a15de-8b97-4633-b601-4c1d6c6e014c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:04:06.038494 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a15de-8b97-4633-b601-4c1d6c6e014c service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:04:06.038767 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a15de-8b97-4633-b601-4c1d6c6e014c service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:04:06.039034 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a15de-8b97-4633-b601-4c1d6c6e014c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:04:06.041257 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-6c8a15de-8b97-4633-b601-4c1d6c6e014c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:04:06.053057 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a15de-8b97-4633-b601-4c1d6c6e014c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:04:06.054575 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a15de-8b97-4633-b601-4c1d6c6e014c service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:04:06.063265 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1214/2418] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:04:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:04:21.194568 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bd168-77cb-4d30-b3e7-61ea5d7630fb service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:04:21.205813 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bd168-77cb-4d30-b3e7-61ea5d7630fb service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:04:21.211595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef19e43-071f-4633-9b4b-d4661f35f424 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:04:21.212266 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef19e43-071f-4633-9b4b-d4661f35f424 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:04:21.212549 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef19e43-071f-4633-9b4b-d4661f35f424 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:04:21.212819 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef19e43-071f-4633-9b4b-d4661f35f424 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:04:21.219929 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8ef19e43-071f-4633-9b4b-d4661f35f424 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:04:21.235006 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef19e43-071f-4633-9b4b-d4661f35f424 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:04:21.236622 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef19e43-071f-4633-9b4b-d4661f35f424 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:04:21.259457 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1205/2419] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:04:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:04:22.624395 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a15de-8b97-4633-b601-4c1d6c6e014c service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:04:22.637768 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a15de-8b97-4633-b601-4c1d6c6e014c service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:04:22.643303 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acdae8-7b59-405a-a362-a2f14928365d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:04:22.644037 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acdae8-7b59-405a-a362-a2f14928365d service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:04:22.644385 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acdae8-7b59-405a-a362-a2f14928365d service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:04:22.644894 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acdae8-7b59-405a-a362-a2f14928365d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:04:22.646859 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-f9acdae8-7b59-405a-a362-a2f14928365d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:04:22.659028 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9acdae8-7b59-405a-a362-a2f14928365d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:04:22.660591 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9acdae8-7b59-405a-a362-a2f14928365d service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:04:22.674414 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1215/2420] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:04:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:04:26.814547 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef19e43-071f-4633-9b4b-d4661f35f424 service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:04:26.828723 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef19e43-071f-4633-9b4b-d4661f35f424 service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:04:26.837562 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8a8dd-92b6-430a-9da1-d92ef88e89a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:04:26.838196 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8a8dd-92b6-430a-9da1-d92ef88e89a4 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:04:26.838472 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8a8dd-92b6-430a-9da1-d92ef88e89a4 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:04:26.838726 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8a8dd-92b6-430a-9da1-d92ef88e89a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:04:26.840861 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c0c8a8dd-92b6-430a-9da1-d92ef88e89a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:04:26.901038 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8a8dd-92b6-430a-9da1-d92ef88e89a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:04:26.902654 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8a8dd-92b6-430a-9da1-d92ef88e89a4 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:04:26.911792 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1206/2421] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:04:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:04:41.748625 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acdae8-7b59-405a-a362-a2f14928365d service nova] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:04:41.764729 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acdae8-7b59-405a-a362-a2f14928365d service nova] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:04:41.771711 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353c27c-a97c-4bd9-912f-ac3c067445dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:04:41.772358 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353c27c-a97c-4bd9-912f-ac3c067445dd service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:04:41.772629 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353c27c-a97c-4bd9-912f-ac3c067445dd service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:04:41.772896 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353c27c-a97c-4bd9-912f-ac3c067445dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:04:41.774957 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4353c27c-a97c-4bd9-912f-ac3c067445dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:04:41.835443 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353c27c-a97c-4bd9-912f-ac3c067445dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:04:41.837077 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353c27c-a97c-4bd9-912f-ac3c067445dd service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:04:41.846705 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1216/2422] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:04:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:05:32.049332 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8a8dd-92b6-430a-9da1-d92ef88e89a4 service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:05:32.050924 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c0c8a8dd-92b6-430a-9da1-d92ef88e89a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:05:32.063623 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8a8dd-92b6-430a-9da1-d92ef88e89a4 service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:05:32.068198 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac4040-bd41-49e0-99f5-aa1f7e023aee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:05:32.068823 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac4040-bd41-49e0-99f5-aa1f7e023aee service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:05:32.069086 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac4040-bd41-49e0-99f5-aa1f7e023aee service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:05:32.069346 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac4040-bd41-49e0-99f5-aa1f7e023aee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:05:32.071275 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-98ac4040-bd41-49e0-99f5-aa1f7e023aee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:05:32.130629 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac4040-bd41-49e0-99f5-aa1f7e023aee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:05:32.131961 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac4040-bd41-49e0-99f5-aa1f7e023aee service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:05:32.142226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1207/2423] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:05:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:06:12.355308 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353c27c-a97c-4bd9-912f-ac3c067445dd service nova] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:06:12.356965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4353c27c-a97c-4bd9-912f-ac3c067445dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:06:12.424194 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353c27c-a97c-4bd9-912f-ac3c067445dd service nova] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:06:12.430065 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671e52c-d62c-47c2-aaff-35dcfaa92c6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f05eb88abe24af4825259712b497d48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:06:12.430747 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671e52c-d62c-47c2-aaff-35dcfaa92c6b service placement] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:06:12.431105 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671e52c-d62c-47c2-aaff-35dcfaa92c6b service placement] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:06:12.431407 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671e52c-d62c-47c2-aaff-35dcfaa92c6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:06:12.433623 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4671e52c-d62c-47c2-aaff-35dcfaa92c6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:06:12.446667 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671e52c-d62c-47c2-aaff-35dcfaa92c6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:06:12.448241 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671e52c-d62c-47c2-aaff-35dcfaa92c6b service placement] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:06:12.460069 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1217/2424] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:06:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:06:58.707736 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac4040-bd41-49e0-99f5-aa1f7e023aee service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:06:58.717310 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac4040-bd41-49e0-99f5-aa1f7e023aee service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:06:58.722332 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6e6d9-25e0-4813-a23c-320590d85c8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:06:58.722984 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6e6d9-25e0-4813-a23c-320590d85c8d service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:06:58.723261 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6e6d9-25e0-4813-a23c-320590d85c8d service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:06:58.723528 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6e6d9-25e0-4813-a23c-320590d85c8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:06:58.732952 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6e6d9-25e0-4813-a23c-320590d85c8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:06:58.734408 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6e6d9-25e0-4813-a23c-320590d85c8d service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:06:58.743262 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1208/2425] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:06:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:08:01.453975 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671e52c-d62c-47c2-aaff-35dcfaa92c6b service placement] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:08:01.465527 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671e52c-d62c-47c2-aaff-35dcfaa92c6b service placement] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:08:01.469896 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3114397-9fda-4770-b3ea-30e2c8ef7fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:08:01.470564 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3114397-9fda-4770-b3ea-30e2c8ef7fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:08:01.470834 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3114397-9fda-4770-b3ea-30e2c8ef7fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:08:01.471095 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3114397-9fda-4770-b3ea-30e2c8ef7fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:08:01.535031 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3114397-9fda-4770-b3ea-30e2c8ef7fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:08:01.536476 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3114397-9fda-4770-b3ea-30e2c8ef7fb2 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:08:01.546326 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1218/2426] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:08:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:08:08.063907 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6e6d9-25e0-4813-a23c-320590d85c8d service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:08:08.079041 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6e6d9-25e0-4813-a23c-320590d85c8d service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:08:08.083578 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090345cc-3bc1-43ad-bf7e-ff2950c26046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:08:08.084443 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090345cc-3bc1-43ad-bf7e-ff2950c26046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:08:08.084716 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090345cc-3bc1-43ad-bf7e-ff2950c26046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:08:08.084980 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090345cc-3bc1-43ad-bf7e-ff2950c26046 admin admin] PATH_INFO: `/v3/users/5cdbe27c1eee4d69941003caebe1c5aa` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:08:08.087339 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090345cc-3bc1-43ad-bf7e-ff2950c26046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cdbe27c1eee4d69941003caebe1c5aa)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:08:08.089389 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090345cc-3bc1-43ad-bf7e-ff2950c26046 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:08:08.136286 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-090345cc-3bc1-43ad-bf7e-ff2950c26046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cdbe27c1eee4d69941003caebe1c5aa'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:08:08.143161 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-090345cc-3bc1-43ad-bf7e-ff2950c26046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cdbe27c1eee4d69941003caebe1c5aa'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:08:08.155078 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-090345cc-3bc1-43ad-bf7e-ff2950c26046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cdbe27c1eee4d69941003caebe1c5aa'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:08:08.155620 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-090345cc-3bc1-43ad-bf7e-ff2950c26046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cdbe27c1eee4d69941003caebe1c5aa'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:08:08.163500 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-090345cc-3bc1-43ad-bf7e-ff2950c26046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cdbe27c1eee4d69941003caebe1c5aa'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:08:08.169890 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1209/2427] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:08:08 2022] DELETE /identity/v3/users/5cdbe27c1eee4d69941003caebe1c5aa => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:08:08.350246 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3114397-9fda-4770-b3ea-30e2c8ef7fb2 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:08:08.360402 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3114397-9fda-4770-b3ea-30e2c8ef7fb2 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:08:08.416894 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a73e4e-69a9-41d2-8aa9-17de6b9841de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:08:08.417839 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a73e4e-69a9-41d2-8aa9-17de6b9841de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:08:08.418116 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a73e4e-69a9-41d2-8aa9-17de6b9841de admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:08:08.418383 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a73e4e-69a9-41d2-8aa9-17de6b9841de admin admin] PATH_INFO: `/v3/projects/a0f7286c938b451c99606e53827219ee` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:08:08.419736 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a73e4e-69a9-41d2-8aa9-17de6b9841de admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0f7286c938b451c99606e53827219ee)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:08:08.421746 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a73e4e-69a9-41d2-8aa9-17de6b9841de admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:08:08.475199 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-56a73e4e-69a9-41d2-8aa9-17de6b9841de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0f7286c938b451c99606e53827219ee', 'request_id': 'req-56a73e4e-69a9-41d2-8aa9-17de6b9841de'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:08:08.480975 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-56a73e4e-69a9-41d2-8aa9-17de6b9841de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0f7286c938b451c99606e53827219ee', 'request_id': 'req-56a73e4e-69a9-41d2-8aa9-17de6b9841de'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:08:08.487336 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-56a73e4e-69a9-41d2-8aa9-17de6b9841de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0f7286c938b451c99606e53827219ee', 'request_id': 'req-56a73e4e-69a9-41d2-8aa9-17de6b9841de'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:08:08.505103 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-56a73e4e-69a9-41d2-8aa9-17de6b9841de admin admin] The token cache is being invalidate because project a0f7286c938b451c99606e53827219ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:08:08.505430 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-56a73e4e-69a9-41d2-8aa9-17de6b9841de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:08:08.506135 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-56a73e4e-69a9-41d2-8aa9-17de6b9841de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:08:08.507981 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1219/2428] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:08:08 2022] DELETE /identity/v3/projects/a0f7286c938b451c99606e53827219ee => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:08:08.510339 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090345cc-3bc1-43ad-bf7e-ff2950c26046 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:08:08.511597 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a73e4e-69a9-41d2-8aa9-17de6b9841de admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:08:08.511836 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-090345cc-3bc1-43ad-bf7e-ff2950c26046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:08:08.513024 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-56a73e4e-69a9-41d2-8aa9-17de6b9841de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:08:08.585201 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a73e4e-69a9-41d2-8aa9-17de6b9841de admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:08:08.590628 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db72380-7709-4c99-9127-9974e4c10484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:08:08.591799 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db72380-7709-4c99-9127-9974e4c10484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:08:08.591943 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db72380-7709-4c99-9127-9974e4c10484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:08:08.593051 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db72380-7709-4c99-9127-9974e4c10484 admin admin] PATH_INFO: `/v3/users/0b3f786d2305413c8c0945eddd513879` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:08:08.593571 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db72380-7709-4c99-9127-9974e4c10484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b3f786d2305413c8c0945eddd513879)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:08:08.596522 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db72380-7709-4c99-9127-9974e4c10484 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:08:08.602374 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090345cc-3bc1-43ad-bf7e-ff2950c26046 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:08:08.651017 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-4db72380-7709-4c99-9127-9974e4c10484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b3f786d2305413c8c0945eddd513879'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:08:08.657419 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f444cb-037c-401f-a6ef-b6791bd42963 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:08:08.658150 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f444cb-037c-401f-a6ef-b6791bd42963 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:08:08.658429 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f444cb-037c-401f-a6ef-b6791bd42963 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:08:08.658698 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f444cb-037c-401f-a6ef-b6791bd42963 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:08:08.660046 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-4db72380-7709-4c99-9127-9974e4c10484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b3f786d2305413c8c0945eddd513879'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:08:08.660603 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c5f444cb-037c-401f-a6ef-b6791bd42963 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:08:08.674349 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-4db72380-7709-4c99-9127-9974e4c10484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b3f786d2305413c8c0945eddd513879'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:08:08.675499 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-4db72380-7709-4c99-9127-9974e4c10484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b3f786d2305413c8c0945eddd513879'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:08:08.676112 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-4db72380-7709-4c99-9127-9974e4c10484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b3f786d2305413c8c0945eddd513879'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:08:08.691399 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1220/2429] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:08:08 2022] DELETE /identity/v3/users/0b3f786d2305413c8c0945eddd513879 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:08:08.748995 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f444cb-037c-401f-a6ef-b6791bd42963 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:08:08.750565 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f444cb-037c-401f-a6ef-b6791bd42963 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:08:08.769294 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1210/2430] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:08:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:08:08.866565 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db72380-7709-4c99-9127-9974e4c10484 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:08:08.867999 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4db72380-7709-4c99-9127-9974e4c10484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:08:08.931621 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db72380-7709-4c99-9127-9974e4c10484 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:08:08.936968 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3140d-1c1f-4c04-8ab7-9ca81717021a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:08:08.937836 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3140d-1c1f-4c04-8ab7-9ca81717021a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:08:08.938132 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3140d-1c1f-4c04-8ab7-9ca81717021a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:08:08.938398 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3140d-1c1f-4c04-8ab7-9ca81717021a admin admin] PATH_INFO: `/v3/projects/3b8f95bf07ed425f8f3d225b5b959073` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:08:08.939618 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3140d-1c1f-4c04-8ab7-9ca81717021a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b8f95bf07ed425f8f3d225b5b959073)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:08:08.941543 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3140d-1c1f-4c04-8ab7-9ca81717021a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:08:08.992855 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d7d3140d-1c1f-4c04-8ab7-9ca81717021a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b8f95bf07ed425f8f3d225b5b959073', 'request_id': 'req-d7d3140d-1c1f-4c04-8ab7-9ca81717021a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:08:08.998353 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d7d3140d-1c1f-4c04-8ab7-9ca81717021a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b8f95bf07ed425f8f3d225b5b959073', 'request_id': 'req-d7d3140d-1c1f-4c04-8ab7-9ca81717021a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:08:09.004232 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d7d3140d-1c1f-4c04-8ab7-9ca81717021a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b8f95bf07ed425f8f3d225b5b959073', 'request_id': 'req-d7d3140d-1c1f-4c04-8ab7-9ca81717021a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:08:09.018350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d7d3140d-1c1f-4c04-8ab7-9ca81717021a admin admin] The token cache is being invalidate because project 3b8f95bf07ed425f8f3d225b5b959073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:08:09.018630 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d7d3140d-1c1f-4c04-8ab7-9ca81717021a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:08:09.019254 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d7d3140d-1c1f-4c04-8ab7-9ca81717021a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:08:09.020752 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1221/2431] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:08:08 2022] DELETE /identity/v3/projects/3b8f95bf07ed425f8f3d225b5b959073 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:09:00.410436 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f444cb-037c-401f-a6ef-b6791bd42963 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:09:00.413035 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c5f444cb-037c-401f-a6ef-b6791bd42963 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:09:00.493872 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f444cb-037c-401f-a6ef-b6791bd42963 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:09:00.558704 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7856e-6587-4305-94e9-6643b107984d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:09:00.559354 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7856e-6587-4305-94e9-6643b107984d service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:09:00.559967 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7856e-6587-4305-94e9-6643b107984d service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:09:00.560230 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7856e-6587-4305-94e9-6643b107984d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:09:00.562140 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-dba7856e-6587-4305-94e9-6643b107984d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:09:00.653065 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7856e-6587-4305-94e9-6643b107984d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:09:00.654706 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7856e-6587-4305-94e9-6643b107984d service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:09:00.672831 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1211/2432] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:09:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:09:11.948604 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3140d-1c1f-4c04-8ab7-9ca81717021a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:09:11.950226 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d7d3140d-1c1f-4c04-8ab7-9ca81717021a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:09:12.008890 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3140d-1c1f-4c04-8ab7-9ca81717021a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:09:12.013323 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb0515-3254-4a78-b06f-2701b8ea37a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:09:12.014017 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb0515-3254-4a78-b06f-2701b8ea37a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:09:12.014296 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb0515-3254-4a78-b06f-2701b8ea37a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:09:12.014560 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb0515-3254-4a78-b06f-2701b8ea37a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:09:12.016677 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-83cb0515-3254-4a78-b06f-2701b8ea37a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:09:12.027074 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb0515-3254-4a78-b06f-2701b8ea37a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:09:12.029171 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb0515-3254-4a78-b06f-2701b8ea37a4 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:09:12.039423 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1222/2433] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:09:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:09:27.314321 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7856e-6587-4305-94e9-6643b107984d service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:09:27.315998 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-dba7856e-6587-4305-94e9-6643b107984d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:09:27.375475 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7856e-6587-4305-94e9-6643b107984d service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:09:27.379379 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f8c9e-bf39-4129-905b-6d5c5ef49941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:09:27.380007 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f8c9e-bf39-4129-905b-6d5c5ef49941 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:09:27.380287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f8c9e-bf39-4129-905b-6d5c5ef49941 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:09:27.380557 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f8c9e-bf39-4129-905b-6d5c5ef49941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:09:27.382401 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c99f8c9e-bf39-4129-905b-6d5c5ef49941 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:09:27.468504 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f8c9e-bf39-4129-905b-6d5c5ef49941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:09:27.470006 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f8c9e-bf39-4129-905b-6d5c5ef49941 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:09:27.488956 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1212/2434] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:09:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:09:43.198164 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb0515-3254-4a78-b06f-2701b8ea37a4 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:09:43.199877 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-83cb0515-3254-4a78-b06f-2701b8ea37a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:09:43.217338 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb0515-3254-4a78-b06f-2701b8ea37a4 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:09:43.224195 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a425a-b8f1-46c7-9d8d-48069bc7577e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:09:43.224835 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a425a-b8f1-46c7-9d8d-48069bc7577e service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:09:43.225106 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a425a-b8f1-46c7-9d8d-48069bc7577e service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:09:43.225388 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a425a-b8f1-46c7-9d8d-48069bc7577e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:09:43.227286 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-5b6a425a-b8f1-46c7-9d8d-48069bc7577e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:09:43.304582 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a425a-b8f1-46c7-9d8d-48069bc7577e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:09:43.306114 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a425a-b8f1-46c7-9d8d-48069bc7577e service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:09:43.325964 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1223/2435] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:09:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:10:22.597213 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f8c9e-bf39-4129-905b-6d5c5ef49941 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:10:22.607858 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f8c9e-bf39-4129-905b-6d5c5ef49941 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:10:22.614313 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c620dd-c409-43dc-a825-926bebeddad4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:10:22.615877 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c620dd-c409-43dc-a825-926bebeddad4 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:10:22.616518 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c620dd-c409-43dc-a825-926bebeddad4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:10:22.616928 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c620dd-c409-43dc-a825-926bebeddad4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:10:22.620427 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d6c620dd-c409-43dc-a825-926bebeddad4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:10:22.639152 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c620dd-c409-43dc-a825-926bebeddad4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:10:22.640568 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c620dd-c409-43dc-a825-926bebeddad4 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:10:22.651976 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1213/2436] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:10:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:10:31.752689 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a425a-b8f1-46c7-9d8d-48069bc7577e service nova] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:10:31.768348 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a425a-b8f1-46c7-9d8d-48069bc7577e service nova] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:10:31.772892 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065e5d1-9b76-49c8-9886-5f0deb69aa46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:10:31.773586 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065e5d1-9b76-49c8-9886-5f0deb69aa46 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:10:31.773862 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065e5d1-9b76-49c8-9886-5f0deb69aa46 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:10:31.774131 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065e5d1-9b76-49c8-9886-5f0deb69aa46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:10:31.776222 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-0065e5d1-9b76-49c8-9886-5f0deb69aa46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:10:31.866061 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065e5d1-9b76-49c8-9886-5f0deb69aa46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:10:31.867480 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065e5d1-9b76-49c8-9886-5f0deb69aa46 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:10:31.877030 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1224/2437] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:10:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:11:15.248764 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c620dd-c409-43dc-a825-926bebeddad4 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:11:15.250514 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d6c620dd-c409-43dc-a825-926bebeddad4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:11:15.395451 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c620dd-c409-43dc-a825-926bebeddad4 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:11:15.400811 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe498f-3eca-4ae5-9bb2-8a51370315f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f05eb88abe24af4825259712b497d48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:11:15.401564 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe498f-3eca-4ae5-9bb2-8a51370315f2 service placement] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:11:15.401938 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe498f-3eca-4ae5-9bb2-8a51370315f2 service placement] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:11:15.402395 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe498f-3eca-4ae5-9bb2-8a51370315f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:11:15.404562 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2dbe498f-3eca-4ae5-9bb2-8a51370315f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:11:15.415791 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe498f-3eca-4ae5-9bb2-8a51370315f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:11:15.417384 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe498f-3eca-4ae5-9bb2-8a51370315f2 service placement] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:11:15.427968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1214/2438] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:11:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:13:08.458741 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065e5d1-9b76-49c8-9886-5f0deb69aa46 service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:13:08.461289 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-0065e5d1-9b76-49c8-9886-5f0deb69aa46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:13:08.551766 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065e5d1-9b76-49c8-9886-5f0deb69aa46 service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:13:08.558515 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617c5a2-c560-4410-9f07-f7fed04a0ce1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:13:08.559304 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617c5a2-c560-4410-9f07-f7fed04a0ce1 service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:13:08.559584 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617c5a2-c560-4410-9f07-f7fed04a0ce1 service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:13:08.559881 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617c5a2-c560-4410-9f07-f7fed04a0ce1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:13:08.561887 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-e617c5a2-c560-4410-9f07-f7fed04a0ce1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:13:08.616940 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617c5a2-c560-4410-9f07-f7fed04a0ce1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:13:08.618551 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617c5a2-c560-4410-9f07-f7fed04a0ce1 service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:13:08.627244 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1225/2439] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:13:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:14:00.427947 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe498f-3eca-4ae5-9bb2-8a51370315f2 service placement] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:14:00.430524 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2dbe498f-3eca-4ae5-9bb2-8a51370315f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:14:00.465940 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe498f-3eca-4ae5-9bb2-8a51370315f2 service placement] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:14:00.470120 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26779114-4b33-4bba-b216-c952e3d8ba2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:14:00.470769 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26779114-4b33-4bba-b216-c952e3d8ba2f service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:14:00.471041 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26779114-4b33-4bba-b216-c952e3d8ba2f service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:14:00.471311 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26779114-4b33-4bba-b216-c952e3d8ba2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:14:00.480810 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26779114-4b33-4bba-b216-c952e3d8ba2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:14:00.482307 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26779114-4b33-4bba-b216-c952e3d8ba2f service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:14:00.491641 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1215/2440] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:14:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:14:15.936161 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617c5a2-c560-4410-9f07-f7fed04a0ce1 service nova] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:14:15.957068 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617c5a2-c560-4410-9f07-f7fed04a0ce1 service nova] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:14:15.961767 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95884c34-66b3-4258-b569-92611189776c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:14:15.962415 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95884c34-66b3-4258-b569-92611189776c service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:14:15.962696 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95884c34-66b3-4258-b569-92611189776c service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:14:15.962967 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95884c34-66b3-4258-b569-92611189776c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:14:15.970876 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95884c34-66b3-4258-b569-92611189776c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:14:15.972321 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95884c34-66b3-4258-b569-92611189776c service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:14:15.980488 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1226/2441] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:14:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:14:27.171994 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26779114-4b33-4bba-b216-c952e3d8ba2f service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:14:27.186581 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26779114-4b33-4bba-b216-c952e3d8ba2f service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:14:27.193193 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c97f79-3f66-4970-ba55-325aa573ee4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:14:27.193998 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c97f79-3f66-4970-ba55-325aa573ee4a service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:14:27.194272 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c97f79-3f66-4970-ba55-325aa573ee4a service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:14:27.194537 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c97f79-3f66-4970-ba55-325aa573ee4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:14:27.203950 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c97f79-3f66-4970-ba55-325aa573ee4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:14:27.205389 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c97f79-3f66-4970-ba55-325aa573ee4a service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:14:27.214763 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1216/2442] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:14:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:14:43.511612 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95884c34-66b3-4258-b569-92611189776c service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:14:43.525059 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95884c34-66b3-4258-b569-92611189776c service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:14:43.529685 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145a60e-0f47-4813-a1a9-d12e1444c828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:14:43.530535 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145a60e-0f47-4813-a1a9-d12e1444c828 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:14:43.530816 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145a60e-0f47-4813-a1a9-d12e1444c828 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:14:43.531092 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145a60e-0f47-4813-a1a9-d12e1444c828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:14:43.543606 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145a60e-0f47-4813-a1a9-d12e1444c828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:14:43.545035 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145a60e-0f47-4813-a1a9-d12e1444c828 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:14:43.554326 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1227/2443] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:14:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:14:49.100749 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c97f79-3f66-4970-ba55-325aa573ee4a service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:14:49.110316 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c97f79-3f66-4970-ba55-325aa573ee4a service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:14:49.114052 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091d350-7f0b-4d17-b55b-d873beb317f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:14:49.114681 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091d350-7f0b-4d17-b55b-d873beb317f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:14:49.114957 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091d350-7f0b-4d17-b55b-d873beb317f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:14:49.115225 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091d350-7f0b-4d17-b55b-d873beb317f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:14:49.117027 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d091d350-7f0b-4d17-b55b-d873beb317f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:14:49.130322 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091d350-7f0b-4d17-b55b-d873beb317f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:14:49.131718 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091d350-7f0b-4d17-b55b-d873beb317f9 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:14:49.142481 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1217/2444] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:14:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:15:23.686712 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145a60e-0f47-4813-a1a9-d12e1444c828 service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:15:23.701763 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145a60e-0f47-4813-a1a9-d12e1444c828 service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:15:23.708854 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c06feb-c0ea-4884-85e0-eeb1b7660eb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:15:23.710032 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c06feb-c0ea-4884-85e0-eeb1b7660eb6 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:15:23.710396 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c06feb-c0ea-4884-85e0-eeb1b7660eb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:15:23.710736 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c06feb-c0ea-4884-85e0-eeb1b7660eb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:15:23.724038 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c06feb-c0ea-4884-85e0-eeb1b7660eb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:15:23.725508 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c06feb-c0ea-4884-85e0-eeb1b7660eb6 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:15:23.736745 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1228/2445] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:15:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:15:31.948514 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091d350-7f0b-4d17-b55b-d873beb317f9 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:15:31.967065 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091d350-7f0b-4d17-b55b-d873beb317f9 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:15:31.975885 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc7702-ffe0-4ea7-a607-37c10a668f98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:15:31.976544 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc7702-ffe0-4ea7-a607-37c10a668f98 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:15:31.976815 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc7702-ffe0-4ea7-a607-37c10a668f98 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:15:31.977079 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc7702-ffe0-4ea7-a607-37c10a668f98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:15:31.985533 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc7702-ffe0-4ea7-a607-37c10a668f98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:15:31.987108 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc7702-ffe0-4ea7-a607-37c10a668f98 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:15:32.007250 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1218/2446] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:15:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:16:18.914503 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c06feb-c0ea-4884-85e0-eeb1b7660eb6 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:16:18.916019 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-07c06feb-c0ea-4884-85e0-eeb1b7660eb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:16:18.932201 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c06feb-c0ea-4884-85e0-eeb1b7660eb6 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:16:18.938514 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75545d-d926-46d5-adcb-36ffe30099e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f05eb88abe24af4825259712b497d48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:16:18.939147 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75545d-d926-46d5-adcb-36ffe30099e2 service placement] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:16:18.939423 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75545d-d926-46d5-adcb-36ffe30099e2 service placement] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:16:18.941217 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75545d-d926-46d5-adcb-36ffe30099e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:16:18.950857 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75545d-d926-46d5-adcb-36ffe30099e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:16:18.952837 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75545d-d926-46d5-adcb-36ffe30099e2 service placement] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:16:18.963264 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1229/2447] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:16:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:18:07.767787 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc7702-ffe0-4ea7-a607-37c10a668f98 service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:18:07.778393 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc7702-ffe0-4ea7-a607-37c10a668f98 service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:18:07.783086 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b793345-d8d9-4e77-b0d1-2ada746a692a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:18:07.783716 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b793345-d8d9-4e77-b0d1-2ada746a692a service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:18:07.783989 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b793345-d8d9-4e77-b0d1-2ada746a692a service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:18:07.784247 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b793345-d8d9-4e77-b0d1-2ada746a692a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:18:07.793641 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b793345-d8d9-4e77-b0d1-2ada746a692a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:18:07.795067 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b793345-d8d9-4e77-b0d1-2ada746a692a service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:18:07.804658 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1219/2448] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:18:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:18:59.881505 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75545d-d926-46d5-adcb-36ffe30099e2 service placement] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:18:59.894143 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75545d-d926-46d5-adcb-36ffe30099e2 service placement] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:18:59.901081 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91563529-4530-45e1-b8b3-a8825d7a00ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:18:59.901743 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91563529-4530-45e1-b8b3-a8825d7a00ee service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:18:59.902021 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91563529-4530-45e1-b8b3-a8825d7a00ee service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:18:59.902290 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91563529-4530-45e1-b8b3-a8825d7a00ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:18:59.910668 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91563529-4530-45e1-b8b3-a8825d7a00ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:18:59.912275 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91563529-4530-45e1-b8b3-a8825d7a00ee service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:18:59.921473 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1230/2449] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:18:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:19:21.562069 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b793345-d8d9-4e77-b0d1-2ada746a692a service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:19:21.563818 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1b793345-d8d9-4e77-b0d1-2ada746a692a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:19:21.642329 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b793345-d8d9-4e77-b0d1-2ada746a692a service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:19:21.646614 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d949552-78de-4ae5-8de9-a33076c01fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:19:21.647233 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d949552-78de-4ae5-8de9-a33076c01fde service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:19:21.647506 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d949552-78de-4ae5-8de9-a33076c01fde service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:19:21.647767 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d949552-78de-4ae5-8de9-a33076c01fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:19:21.649909 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2d949552-78de-4ae5-8de9-a33076c01fde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:19:21.664025 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d949552-78de-4ae5-8de9-a33076c01fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:19:21.665474 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d949552-78de-4ae5-8de9-a33076c01fde service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:19:21.673513 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1220/2450] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:19:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:19:27.752170 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91563529-4530-45e1-b8b3-a8825d7a00ee service nova] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:19:27.754873 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-91563529-4530-45e1-b8b3-a8825d7a00ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:19:27.818424 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91563529-4530-45e1-b8b3-a8825d7a00ee service nova] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:19:27.822994 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ef438-ee46-40c2-92d7-039a484caac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:19:27.823649 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ef438-ee46-40c2-92d7-039a484caac1 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:19:27.823923 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ef438-ee46-40c2-92d7-039a484caac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:19:27.824188 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ef438-ee46-40c2-92d7-039a484caac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:19:27.826497 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-189ef438-ee46-40c2-92d7-039a484caac1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:19:27.907442 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ef438-ee46-40c2-92d7-039a484caac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:19:27.908787 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ef438-ee46-40c2-92d7-039a484caac1 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:19:27.927666 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1231/2451] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:19:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:19:39.366898 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d949552-78de-4ae5-8de9-a33076c01fde service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:19:39.441798 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d949552-78de-4ae5-8de9-a33076c01fde service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:19:39.447278 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dc40c-040c-4963-befe-7a7642f37322 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:19:39.447927 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dc40c-040c-4963-befe-7a7642f37322 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:19:39.448201 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dc40c-040c-4963-befe-7a7642f37322 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:19:39.448473 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dc40c-040c-4963-befe-7a7642f37322 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:19:39.450367 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8c8dc40c-040c-4963-befe-7a7642f37322 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:19:39.462283 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dc40c-040c-4963-befe-7a7642f37322 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:19:39.463848 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dc40c-040c-4963-befe-7a7642f37322 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:19:39.474029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1221/2452] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:19:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:19:44.297959 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ef438-ee46-40c2-92d7-039a484caac1 service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:19:44.315726 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ef438-ee46-40c2-92d7-039a484caac1 service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:19:44.322387 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c1f59-62d0-4e6d-9b50-a67e020ac52b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:19:44.323024 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c1f59-62d0-4e6d-9b50-a67e020ac52b service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:19:44.323306 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c1f59-62d0-4e6d-9b50-a67e020ac52b service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:19:44.323577 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c1f59-62d0-4e6d-9b50-a67e020ac52b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:19:44.325738 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-bb5c1f59-62d0-4e6d-9b50-a67e020ac52b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:19:44.418534 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c1f59-62d0-4e6d-9b50-a67e020ac52b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:19:44.420136 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c1f59-62d0-4e6d-9b50-a67e020ac52b service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:19:44.439577 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1232/2453] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:19:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:19:49.457530 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dc40c-040c-4963-befe-7a7642f37322 service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:19:49.467586 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dc40c-040c-4963-befe-7a7642f37322 service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:19:49.472127 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ce29c-89e5-4373-965c-2f3d481f93d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:19:49.472765 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ce29c-89e5-4373-965c-2f3d481f93d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:19:49.473064 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ce29c-89e5-4373-965c-2f3d481f93d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:19:49.473298 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ce29c-89e5-4373-965c-2f3d481f93d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:19:49.483957 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ce29c-89e5-4373-965c-2f3d481f93d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:19:49.485438 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ce29c-89e5-4373-965c-2f3d481f93d6 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:19:49.496644 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1222/2454] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:19:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:20:24.548412 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c1f59-62d0-4e6d-9b50-a67e020ac52b service nova] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:20:24.557919 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c1f59-62d0-4e6d-9b50-a67e020ac52b service nova] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:20:24.562248 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244b748-bccb-4a42-8a71-69598ebe23b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:20:24.563413 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244b748-bccb-4a42-8a71-69598ebe23b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:20:24.563851 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244b748-bccb-4a42-8a71-69598ebe23b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:20:24.564124 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244b748-bccb-4a42-8a71-69598ebe23b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:20:24.566201 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d244b748-bccb-4a42-8a71-69598ebe23b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:20:24.580151 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244b748-bccb-4a42-8a71-69598ebe23b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:20:24.581623 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244b748-bccb-4a42-8a71-69598ebe23b7 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:20:24.592436 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1233/2455] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:20:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:21:22.257421 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ce29c-89e5-4373-965c-2f3d481f93d6 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:21:22.259762 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2a1ce29c-89e5-4373-965c-2f3d481f93d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:21:22.376690 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ce29c-89e5-4373-965c-2f3d481f93d6 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:21:22.383191 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b205ed-a92e-4d67-9b79-b99cefe34d5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f05eb88abe24af4825259712b497d48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:21:22.383846 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b205ed-a92e-4d67-9b79-b99cefe34d5c service placement] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:21:22.384128 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b205ed-a92e-4d67-9b79-b99cefe34d5c service placement] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:21:22.384400 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b205ed-a92e-4d67-9b79-b99cefe34d5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:21:22.386374 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-74b205ed-a92e-4d67-9b79-b99cefe34d5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:21:22.399048 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b205ed-a92e-4d67-9b79-b99cefe34d5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:21:22.400639 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b205ed-a92e-4d67-9b79-b99cefe34d5c service placement] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:21:22.411268 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1223/2456] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:21:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:21:39.434748 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244b748-bccb-4a42-8a71-69598ebe23b7 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:21:39.446486 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244b748-bccb-4a42-8a71-69598ebe23b7 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:21:39.451921 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e072a6-7573-4a1c-b22c-1f82a7b21cd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:21:39.452648 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e072a6-7573-4a1c-b22c-1f82a7b21cd4 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:21:39.452969 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e072a6-7573-4a1c-b22c-1f82a7b21cd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:21:39.453282 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e072a6-7573-4a1c-b22c-1f82a7b21cd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:21:39.455748 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b4e072a6-7573-4a1c-b22c-1f82a7b21cd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:21:39.536550 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e072a6-7573-4a1c-b22c-1f82a7b21cd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:21:39.538021 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e072a6-7573-4a1c-b22c-1f82a7b21cd4 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:21:39.549539 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1234/2457] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:21:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 21:22:05.694323 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae77e62-edf6-4774-aa83-b050364f384c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:22:05.694945 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae77e62-edf6-4774-aa83-b050364f384c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:22:05.694945 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae77e62-edf6-4774-aa83-b050364f384c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:22:05.744666 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-dae77e62-edf6-4774-aa83-b050364f384c None None] MFA Rules not processed for user `54f6015a565b4a5eb74ec571f8774bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:22:05.745960 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-dae77e62-edf6-4774-aa83-b050364f384c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:22:05.813255 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1224/2458] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:22:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:22:06.161301 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e072a6-7573-4a1c-b22c-1f82a7b21cd4 service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:22:06.171125 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e072a6-7573-4a1c-b22c-1f82a7b21cd4 service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:22:06.175187 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f749a9-a2dc-4ed3-bfeb-7e959646d6df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:22:06.175934 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f749a9-a2dc-4ed3-bfeb-7e959646d6df service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:22:06.176293 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f749a9-a2dc-4ed3-bfeb-7e959646d6df service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:22:06.176630 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f749a9-a2dc-4ed3-bfeb-7e959646d6df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:22:06.178586 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-83f749a9-a2dc-4ed3-bfeb-7e959646d6df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:22:06.191436 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f749a9-a2dc-4ed3-bfeb-7e959646d6df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:22:06.192958 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f749a9-a2dc-4ed3-bfeb-7e959646d6df service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:22:06.201050 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1235/2459] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:22:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:22:08.613946 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae77e62-edf6-4774-aa83-b050364f384c None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:22:08.628872 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae77e62-edf6-4774-aa83-b050364f384c None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:22:08.634597 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bd277-0018-4a5b-9679-61b9bd8efe33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f05eb88abe24af4825259712b497d48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:22:08.635244 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bd277-0018-4a5b-9679-61b9bd8efe33 service placement] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:22:08.635519 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bd277-0018-4a5b-9679-61b9bd8efe33 service placement] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:22:08.635785 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bd277-0018-4a5b-9679-61b9bd8efe33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:22:08.637672 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9e6bd277-0018-4a5b-9679-61b9bd8efe33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:22:08.649379 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bd277-0018-4a5b-9679-61b9bd8efe33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:22:08.650970 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bd277-0018-4a5b-9679-61b9bd8efe33 service placement] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:22:08.660539 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1225/2460] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:22:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:22:20.259578 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f749a9-a2dc-4ed3-bfeb-7e959646d6df service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:22:20.275079 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f749a9-a2dc-4ed3-bfeb-7e959646d6df service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:22:20.281376 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4b1ea-cf02-450a-910f-36239dc8c21d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:22:20.282046 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4b1ea-cf02-450a-910f-36239dc8c21d service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:22:20.282401 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4b1ea-cf02-450a-910f-36239dc8c21d service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:22:20.282673 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4b1ea-cf02-450a-910f-36239dc8c21d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:22:20.284641 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-11f4b1ea-cf02-450a-910f-36239dc8c21d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:22:20.298026 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4b1ea-cf02-450a-910f-36239dc8c21d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:22:20.299609 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4b1ea-cf02-450a-910f-36239dc8c21d service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:22:20.310977 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1236/2461] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:22:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:22:22.377009 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7cb11-39f6-41d5-9fdd-ce39428fcbfb None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:22:22.377538 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7cb11-39f6-41d5-9fdd-ce39428fcbfb None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:22:22.377538 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7cb11-39f6-41d5-9fdd-ce39428fcbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:22:22.436676 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-8df7cb11-39f6-41d5-9fdd-ce39428fcbfb None None] MFA Rules not processed for user `de790a1a69994f7498834ded10480e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:22:22.437874 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8df7cb11-39f6-41d5-9fdd-ce39428fcbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:22:22.504520 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1226/2462] 10.222.0.31 () {58 vars in 967 bytes} [Thu Feb 10 21:22:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:22:22.554102 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4b1ea-cf02-450a-910f-36239dc8c21d service nova] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:22:22.555802 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-11f4b1ea-cf02-450a-910f-36239dc8c21d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:22:22.649776 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4b1ea-cf02-450a-910f-36239dc8c21d service nova] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:22:22.654887 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65741c-4be1-4b86-9eaa-12213c0117df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f09689635e54a4e85c0ef0e3539d911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:22:22.655529 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65741c-4be1-4b86-9eaa-12213c0117df service swift] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:22:22.655808 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65741c-4be1-4b86-9eaa-12213c0117df service swift] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:22:22.656059 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65741c-4be1-4b86-9eaa-12213c0117df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:22:22.664078 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65741c-4be1-4b86-9eaa-12213c0117df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:22:22.665777 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65741c-4be1-4b86-9eaa-12213c0117df service swift] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:22:22.673567 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1237/2463] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 10 21:22:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 21:22:23.215651 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7cb11-39f6-41d5-9fdd-ce39428fcbfb None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:22:23.226501 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7cb11-39f6-41d5-9fdd-ce39428fcbfb None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:22:23.230450 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3f8ad-3400-48af-8a8d-ad8c3cd02039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:22:23.232192 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3f8ad-3400-48af-8a8d-ad8c3cd02039 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:22:23.232704 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3f8ad-3400-48af-8a8d-ad8c3cd02039 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:22:23.233332 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3f8ad-3400-48af-8a8d-ad8c3cd02039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:22:23.235494 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0cc3f8ad-3400-48af-8a8d-ad8c3cd02039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:22:23.323077 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3f8ad-3400-48af-8a8d-ad8c3cd02039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:22:23.324930 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3f8ad-3400-48af-8a8d-ad8c3cd02039 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:22:23.343378 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1227/2464] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:22:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:22:24.486645 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65741c-4be1-4b86-9eaa-12213c0117df service swift] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:22:24.488365 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ff65741c-4be1-4b86-9eaa-12213c0117df service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:22:24.513288 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65741c-4be1-4b86-9eaa-12213c0117df service swift] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:22:24.534403 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73ee70-aac0-42ee-89e8-886a96434e01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:22:24.536324 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73ee70-aac0-42ee-89e8-886a96434e01 service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:22:24.538632 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73ee70-aac0-42ee-89e8-886a96434e01 service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:22:24.539190 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73ee70-aac0-42ee-89e8-886a96434e01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:22:24.545393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-2e73ee70-aac0-42ee-89e8-886a96434e01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:22:24.564758 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73ee70-aac0-42ee-89e8-886a96434e01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:22:24.566807 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73ee70-aac0-42ee-89e8-886a96434e01 service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:22:24.597590 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1238/2465] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:22:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:23:07.891090 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3f8ad-3400-48af-8a8d-ad8c3cd02039 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:23:07.905097 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3f8ad-3400-48af-8a8d-ad8c3cd02039 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:23:07.911891 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99290f2-231a-4089-aafc-a0a12a1b477b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:23:07.912812 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99290f2-231a-4089-aafc-a0a12a1b477b service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:23:07.913176 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99290f2-231a-4089-aafc-a0a12a1b477b service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:23:07.913552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99290f2-231a-4089-aafc-a0a12a1b477b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:23:07.925474 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99290f2-231a-4089-aafc-a0a12a1b477b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:23:07.926891 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99290f2-231a-4089-aafc-a0a12a1b477b service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:23:07.954908 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1228/2466] 10.222.0.31 () {60 vars in 1396 bytes} [Thu Feb 10 21:23:07 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3244 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:24:25.587782 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73ee70-aac0-42ee-89e8-886a96434e01 service nova] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:24:25.625010 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73ee70-aac0-42ee-89e8-886a96434e01 service nova] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:24:25.629644 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1e543-5db8-4ace-a8c6-c19100b34bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:24:25.630279 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1e543-5db8-4ace-a8c6-c19100b34bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:24:25.630561 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1e543-5db8-4ace-a8c6-c19100b34bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:24:25.630825 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1e543-5db8-4ace-a8c6-c19100b34bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:24:25.638506 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1e543-5db8-4ace-a8c6-c19100b34bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:24:25.639924 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1e543-5db8-4ace-a8c6-c19100b34bd8 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:24:25.647919 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1239/2467] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:24:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:24:27.958668 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99290f2-231a-4089-aafc-a0a12a1b477b service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:24:28.015090 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99290f2-231a-4089-aafc-a0a12a1b477b service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:24:28.021861 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3cfbb-dd8e-4869-b7e7-f46c719c02e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:24:28.022504 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3cfbb-dd8e-4869-b7e7-f46c719c02e4 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:24:28.022776 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3cfbb-dd8e-4869-b7e7-f46c719c02e4 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:24:28.023043 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3cfbb-dd8e-4869-b7e7-f46c719c02e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:24:28.031289 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3cfbb-dd8e-4869-b7e7-f46c719c02e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:24:28.032858 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3cfbb-dd8e-4869-b7e7-f46c719c02e4 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:24:28.041901 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1229/2468] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:24:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:24:31.567834 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1e543-5db8-4ace-a8c6-c19100b34bd8 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:24:31.569581 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-a5d1e543-5db8-4ace-a8c6-c19100b34bd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:24:31.615954 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1e543-5db8-4ace-a8c6-c19100b34bd8 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:24:31.622899 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22764c02-38f0-4367-b35b-8037abc3ae74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:24:31.623892 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22764c02-38f0-4367-b35b-8037abc3ae74 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:24:31.624334 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22764c02-38f0-4367-b35b-8037abc3ae74 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:24:31.624773 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22764c02-38f0-4367-b35b-8037abc3ae74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:24:31.628170 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-22764c02-38f0-4367-b35b-8037abc3ae74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:24:31.645280 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22764c02-38f0-4367-b35b-8037abc3ae74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:24:31.646754 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22764c02-38f0-4367-b35b-8037abc3ae74 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:24:31.656438 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1240/2469] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:24:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:24:49.012368 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3cfbb-dd8e-4869-b7e7-f46c719c02e4 service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:24:49.021986 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3cfbb-dd8e-4869-b7e7-f46c719c02e4 service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:24:49.025840 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cacec8-7518-4c6a-b8e6-e5db838e17a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:24:49.026599 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cacec8-7518-4c6a-b8e6-e5db838e17a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:24:49.026974 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cacec8-7518-4c6a-b8e6-e5db838e17a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:24:49.027311 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cacec8-7518-4c6a-b8e6-e5db838e17a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:24:49.038677 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cacec8-7518-4c6a-b8e6-e5db838e17a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:24:49.040356 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cacec8-7518-4c6a-b8e6-e5db838e17a7 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:24:49.051631 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1230/2470] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:24:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:25:24.540740 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22764c02-38f0-4367-b35b-8037abc3ae74 service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:25:24.552080 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22764c02-38f0-4367-b35b-8037abc3ae74 service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:25:24.555236 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460cd0d-66ce-4418-808e-296ddabd361a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:25:24.555945 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460cd0d-66ce-4418-808e-296ddabd361a service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:25:24.556225 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460cd0d-66ce-4418-808e-296ddabd361a service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:25:24.556493 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460cd0d-66ce-4418-808e-296ddabd361a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:25:24.567793 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460cd0d-66ce-4418-808e-296ddabd361a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:25:24.569307 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460cd0d-66ce-4418-808e-296ddabd361a service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:25:24.579989 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1241/2471] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:25:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:26:26.241954 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cacec8-7518-4c6a-b8e6-e5db838e17a7 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:26:26.243701 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-05cacec8-7518-4c6a-b8e6-e5db838e17a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:26:26.258779 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cacec8-7518-4c6a-b8e6-e5db838e17a7 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:26:26.264591 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6264e1f-9ad5-4f09-80ef-c8bc0e440211 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f05eb88abe24af4825259712b497d48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:26:26.265220 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6264e1f-9ad5-4f09-80ef-c8bc0e440211 service placement] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:26:26.265531 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6264e1f-9ad5-4f09-80ef-c8bc0e440211 service placement] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:26:26.265801 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6264e1f-9ad5-4f09-80ef-c8bc0e440211 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:26:26.274670 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6264e1f-9ad5-4f09-80ef-c8bc0e440211 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:26:26.276217 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6264e1f-9ad5-4f09-80ef-c8bc0e440211 service placement] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:26:26.285882 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1231/2472] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:26:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:27:41.956281 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057a047-5104-47a2-937f-4885c6fc0c0e None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:27:41.956832 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057a047-5104-47a2-937f-4885c6fc0c0e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:27:41.956832 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057a047-5104-47a2-937f-4885c6fc0c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:27:41.994870 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-8057a047-5104-47a2-937f-4885c6fc0c0e None None] MFA Rules not processed for user `d6a6f1ee4ac24e0481c4ee1bf8ddf897`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:27:41.996058 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-8057a047-5104-47a2-937f-4885c6fc0c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:27:42.067191 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1242/2473] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:27:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 21:27:42.390024 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6264e1f-9ad5-4f09-80ef-c8bc0e440211 service placement] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:27:42.400076 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6264e1f-9ad5-4f09-80ef-c8bc0e440211 service placement] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:27:42.404682 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cd3e9-b99e-40ec-872c-2c43f549ca98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:27:42.405317 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cd3e9-b99e-40ec-872c-2c43f549ca98 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:27:42.405626 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cd3e9-b99e-40ec-872c-2c43f549ca98 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:27:42.405893 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cd3e9-b99e-40ec-872c-2c43f549ca98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:27:42.408094 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d83cd3e9-b99e-40ec-872c-2c43f549ca98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:27:42.418262 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cd3e9-b99e-40ec-872c-2c43f549ca98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:27:42.419680 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cd3e9-b99e-40ec-872c-2c43f549ca98 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:27:42.427953 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1232/2474] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:27:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:27:42.772885 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057a047-5104-47a2-937f-4885c6fc0c0e None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:27:42.784726 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057a047-5104-47a2-937f-4885c6fc0c0e None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:27:42.789788 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce6b08-015d-4ccd-bc99-21e8acb90616 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f05eb88abe24af4825259712b497d48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:27:42.790424 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce6b08-015d-4ccd-bc99-21e8acb90616 service placement] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:27:42.790697 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce6b08-015d-4ccd-bc99-21e8acb90616 service placement] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:27:42.790963 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce6b08-015d-4ccd-bc99-21e8acb90616 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:27:42.800185 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce6b08-015d-4ccd-bc99-21e8acb90616 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:27:42.801875 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce6b08-015d-4ccd-bc99-21e8acb90616 service placement] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:27:42.811844 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1243/2475] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:27:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:27:45.473892 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cd3e9-b99e-40ec-872c-2c43f549ca98 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:27:45.508120 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cd3e9-b99e-40ec-872c-2c43f549ca98 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:27:45.515348 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb069ac-eac5-4784-bd28-d766bc0bbed9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:27:45.516171 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb069ac-eac5-4784-bd28-d766bc0bbed9 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:27:45.516555 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb069ac-eac5-4784-bd28-d766bc0bbed9 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:27:45.516921 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb069ac-eac5-4784-bd28-d766bc0bbed9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:27:45.527860 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb069ac-eac5-4784-bd28-d766bc0bbed9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:27:45.530401 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb069ac-eac5-4784-bd28-d766bc0bbed9 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:27:45.547962 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1233/2476] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:27:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:27:51.541381 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce6b08-015d-4ccd-bc99-21e8acb90616 service placement] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:27:51.555730 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce6b08-015d-4ccd-bc99-21e8acb90616 service placement] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:27:51.561411 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184a972-0b33-494a-8976-acbcb59b3100 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:27:51.562042 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184a972-0b33-494a-8976-acbcb59b3100 service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:27:51.562328 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184a972-0b33-494a-8976-acbcb59b3100 service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:27:51.562606 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184a972-0b33-494a-8976-acbcb59b3100 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:27:51.572349 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184a972-0b33-494a-8976-acbcb59b3100 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:27:51.573979 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184a972-0b33-494a-8976-acbcb59b3100 service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:27:51.584429 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1244/2477] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:27:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:28:31.960907 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb069ac-eac5-4784-bd28-d766bc0bbed9 service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:28:31.971115 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb069ac-eac5-4784-bd28-d766bc0bbed9 service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:28:31.975673 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f60437-8c94-4804-862c-ae54d994fd96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:28:31.976305 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f60437-8c94-4804-862c-ae54d994fd96 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:28:31.976579 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f60437-8c94-4804-862c-ae54d994fd96 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:28:31.976884 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f60437-8c94-4804-862c-ae54d994fd96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:28:31.985586 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f60437-8c94-4804-862c-ae54d994fd96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:28:31.986992 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f60437-8c94-4804-862c-ae54d994fd96 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:28:32.005513 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1234/2478] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:28:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:28:54.833789 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184a972-0b33-494a-8976-acbcb59b3100 service nova] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:28:54.845332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184a972-0b33-494a-8976-acbcb59b3100 service nova] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:28:54.852472 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb4ff0-135f-41b8-971b-81357dd21882 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:28:54.853216 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb4ff0-135f-41b8-971b-81357dd21882 service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:28:54.853537 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb4ff0-135f-41b8-971b-81357dd21882 service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:28:54.853808 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb4ff0-135f-41b8-971b-81357dd21882 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:28:54.855908 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-08bb4ff0-135f-41b8-971b-81357dd21882 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:28:54.866654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb4ff0-135f-41b8-971b-81357dd21882 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:28:54.868255 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb4ff0-135f-41b8-971b-81357dd21882 service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:28:54.877336 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1245/2479] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:28:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:29:31.943176 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f60437-8c94-4804-862c-ae54d994fd96 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:29:31.944858 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-42f60437-8c94-4804-862c-ae54d994fd96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:29:32.023549 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f60437-8c94-4804-862c-ae54d994fd96 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:29:32.030053 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e05f1-8b7e-481e-a9a3-cfb9b1813c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:29:32.031051 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e05f1-8b7e-481e-a9a3-cfb9b1813c11 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:29:32.031321 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e05f1-8b7e-481e-a9a3-cfb9b1813c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:29:32.031586 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e05f1-8b7e-481e-a9a3-cfb9b1813c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:29:32.033794 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1c6e05f1-8b7e-481e-a9a3-cfb9b1813c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:29:32.044347 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e05f1-8b7e-481e-a9a3-cfb9b1813c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:29:32.045804 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e05f1-8b7e-481e-a9a3-cfb9b1813c11 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:29:32.053908 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1235/2480] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:29:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:30:32.178900 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb4ff0-135f-41b8-971b-81357dd21882 service nova] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:30:32.240070 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb4ff0-135f-41b8-971b-81357dd21882 service nova] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:30:32.251125 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f479249-2ab1-41a5-adaf-b21e5ebf8a7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:30:32.251125 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f479249-2ab1-41a5-adaf-b21e5ebf8a7c service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:30:32.251125 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f479249-2ab1-41a5-adaf-b21e5ebf8a7c service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:30:32.251125 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f479249-2ab1-41a5-adaf-b21e5ebf8a7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:30:32.252126 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4f479249-2ab1-41a5-adaf-b21e5ebf8a7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:30:32.336596 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f479249-2ab1-41a5-adaf-b21e5ebf8a7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:30:32.338061 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f479249-2ab1-41a5-adaf-b21e5ebf8a7c service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:30:32.356498 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1246/2481] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:30:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:30:32.519370 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e05f1-8b7e-481e-a9a3-cfb9b1813c11 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:30:32.534188 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e05f1-8b7e-481e-a9a3-cfb9b1813c11 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:30:32.539919 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34561ef1-28bb-4c8a-9c64-bdde50ca4923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:30:32.541425 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34561ef1-28bb-4c8a-9c64-bdde50ca4923 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:30:32.541425 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34561ef1-28bb-4c8a-9c64-bdde50ca4923 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:30:32.541425 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34561ef1-28bb-4c8a-9c64-bdde50ca4923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:30:32.556862 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34561ef1-28bb-4c8a-9c64-bdde50ca4923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:30:32.558584 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34561ef1-28bb-4c8a-9c64-bdde50ca4923 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:30:32.570000 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1236/2482] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:30:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:31:33.263572 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f479249-2ab1-41a5-adaf-b21e5ebf8a7c service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:31:33.265284 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4f479249-2ab1-41a5-adaf-b21e5ebf8a7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:31:33.375048 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f479249-2ab1-41a5-adaf-b21e5ebf8a7c service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:31:33.380814 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b9540-88fa-4840-83c0-fd6a2ae139a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f05eb88abe24af4825259712b497d48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:31:33.381472 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b9540-88fa-4840-83c0-fd6a2ae139a7 service placement] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:31:33.381747 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b9540-88fa-4840-83c0-fd6a2ae139a7 service placement] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:31:33.382016 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b9540-88fa-4840-83c0-fd6a2ae139a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:31:33.383907 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b68b9540-88fa-4840-83c0-fd6a2ae139a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:31:33.395209 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b9540-88fa-4840-83c0-fd6a2ae139a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:31:33.396765 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b9540-88fa-4840-83c0-fd6a2ae139a7 service placement] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:31:33.406305 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1247/2483] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:31:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:32:42.732591 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34561ef1-28bb-4c8a-9c64-bdde50ca4923 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:42.746839 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34561ef1-28bb-4c8a-9c64-bdde50ca4923 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:42.752333 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8130c-d5e1-4795-b4f4-4c0002b38e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:42.753324 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8130c-d5e1-4795-b4f4-4c0002b38e98 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:42.753707 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8130c-d5e1-4795-b4f4-4c0002b38e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:42.754481 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8130c-d5e1-4795-b4f4-4c0002b38e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:42.756566 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d3d8130c-d5e1-4795-b4f4-4c0002b38e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:42.844402 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8130c-d5e1-4795-b4f4-4c0002b38e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:42.845911 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8130c-d5e1-4795-b4f4-4c0002b38e98 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:42.857218 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1237/2484] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:32:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:32:43.032608 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b9540-88fa-4840-83c0-fd6a2ae139a7 service placement] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:43.034359 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b68b9540-88fa-4840-83c0-fd6a2ae139a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:43.046263 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b9540-88fa-4840-83c0-fd6a2ae139a7 service placement] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:43.050068 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e254c6-23bf-4f1a-bed0-098f60138c70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:43.051047 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e254c6-23bf-4f1a-bed0-098f60138c70 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:43.051455 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e254c6-23bf-4f1a-bed0-098f60138c70 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:43.051819 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e254c6-23bf-4f1a-bed0-098f60138c70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:43.054353 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-17e254c6-23bf-4f1a-bed0-098f60138c70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:43.136356 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e254c6-23bf-4f1a-bed0-098f60138c70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:43.137831 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e254c6-23bf-4f1a-bed0-098f60138c70 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:43.157051 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1248/2485] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:32:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:32:43.158473 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8130c-d5e1-4795-b4f4-4c0002b38e98 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:43.159924 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d3d8130c-d5e1-4795-b4f4-4c0002b38e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:43.241309 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8130c-d5e1-4795-b4f4-4c0002b38e98 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:43.245755 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627fc21-1359-4ca3-b9b0-7a2444cd5400 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '256860d94eb142c6b2175ae89f977e4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:43.246413 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627fc21-1359-4ca3-b9b0-7a2444cd5400 service glance] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:43.246690 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627fc21-1359-4ca3-b9b0-7a2444cd5400 service glance] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:43.246996 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627fc21-1359-4ca3-b9b0-7a2444cd5400 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:43.248933 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5627fc21-1359-4ca3-b9b0-7a2444cd5400 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:43.260420 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-5627fc21-1359-4ca3-b9b0-7a2444cd5400 service glance] Could not find project: a0f7286c938b451c99606e53827219ee.: keystone.exception.ProjectNotFound: Could not find project: a0f7286c938b451c99606e53827219ee. Feb 10 21:32:43.261660 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1238/2486] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:32:43 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 10 21:32:44.042749 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e254c6-23bf-4f1a-bed0-098f60138c70 service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:44.052661 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e254c6-23bf-4f1a-bed0-098f60138c70 service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:44.057105 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c34aea-2953-4d32-9aac-9b761eb2b650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:44.057868 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c34aea-2953-4d32-9aac-9b761eb2b650 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:44.058214 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c34aea-2953-4d32-9aac-9b761eb2b650 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:44.058851 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c34aea-2953-4d32-9aac-9b761eb2b650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:44.061191 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-71c34aea-2953-4d32-9aac-9b761eb2b650 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:44.075332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c34aea-2953-4d32-9aac-9b761eb2b650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:44.076754 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c34aea-2953-4d32-9aac-9b761eb2b650 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:44.088044 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1249/2487] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:32:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:32:46.798939 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627fc21-1359-4ca3-b9b0-7a2444cd5400 service glance] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:46.800644 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5627fc21-1359-4ca3-b9b0-7a2444cd5400 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:46.818850 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627fc21-1359-4ca3-b9b0-7a2444cd5400 service glance] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:46.826082 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7851d6-c5e1-4292-8ac1-99c466cadfa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:46.826728 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7851d6-c5e1-4292-8ac1-99c466cadfa1 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:46.827007 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7851d6-c5e1-4292-8ac1-99c466cadfa1 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:46.827278 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7851d6-c5e1-4292-8ac1-99c466cadfa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:46.829308 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9e7851d6-c5e1-4292-8ac1-99c466cadfa1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:46.843698 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7851d6-c5e1-4292-8ac1-99c466cadfa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:46.856442 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7851d6-c5e1-4292-8ac1-99c466cadfa1 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:46.885033 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1239/2488] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:32:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:32:48.226206 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c34aea-2953-4d32-9aac-9b761eb2b650 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:48.235027 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c34aea-2953-4d32-9aac-9b761eb2b650 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:48.239748 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ec64b-8271-452d-8710-ff927bd3dbd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:48.240296 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ec64b-8271-452d-8710-ff927bd3dbd4 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:48.240590 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ec64b-8271-452d-8710-ff927bd3dbd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:48.240829 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ec64b-8271-452d-8710-ff927bd3dbd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:48.242790 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b20ec64b-8271-452d-8710-ff927bd3dbd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:48.329993 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ec64b-8271-452d-8710-ff927bd3dbd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:48.331745 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ec64b-8271-452d-8710-ff927bd3dbd4 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:48.350344 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1250/2489] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:32:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:32:48.875985 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7851d6-c5e1-4292-8ac1-99c466cadfa1 service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:48.877571 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9e7851d6-c5e1-4292-8ac1-99c466cadfa1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:48.892028 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7851d6-c5e1-4292-8ac1-99c466cadfa1 service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:48.897167 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ad93e-4f2c-4677-8573-c67657374be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:48.898058 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ad93e-4f2c-4677-8573-c67657374be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:48.898350 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ad93e-4f2c-4677-8573-c67657374be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:48.898643 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ad93e-4f2c-4677-8573-c67657374be5 admin admin] PATH_INFO: `/v3/users/13621ec744b5471893e19189f67e77eb` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:48.912325 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ad93e-4f2c-4677-8573-c67657374be5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13621ec744b5471893e19189f67e77eb)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:48.914306 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ad93e-4f2c-4677-8573-c67657374be5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:48.964560 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-863ad93e-4f2c-4677-8573-c67657374be5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13621ec744b5471893e19189f67e77eb'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:32:48.973786 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-863ad93e-4f2c-4677-8573-c67657374be5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13621ec744b5471893e19189f67e77eb'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:32:48.987752 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-863ad93e-4f2c-4677-8573-c67657374be5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13621ec744b5471893e19189f67e77eb'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:32:48.990596 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-863ad93e-4f2c-4677-8573-c67657374be5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13621ec744b5471893e19189f67e77eb'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:32:48.998937 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-863ad93e-4f2c-4677-8573-c67657374be5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13621ec744b5471893e19189f67e77eb'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:32:49.005116 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1240/2490] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:32:48 2022] DELETE /identity/v3/users/13621ec744b5471893e19189f67e77eb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:32:49.173099 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ec64b-8271-452d-8710-ff927bd3dbd4 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:49.182629 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ec64b-8271-452d-8710-ff927bd3dbd4 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:49.239224 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d1c92-8afc-403a-940f-48c28191b337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:49.240083 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d1c92-8afc-403a-940f-48c28191b337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:49.240358 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d1c92-8afc-403a-940f-48c28191b337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:49.240628 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d1c92-8afc-403a-940f-48c28191b337 admin admin] PATH_INFO: `/v3/projects/37a3444e46804fe1ae16e69d4af79680` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:49.250551 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d1c92-8afc-403a-940f-48c28191b337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37a3444e46804fe1ae16e69d4af79680)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:49.252445 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d1c92-8afc-403a-940f-48c28191b337 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:49.298432 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-980d1c92-8afc-403a-940f-48c28191b337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37a3444e46804fe1ae16e69d4af79680', 'request_id': 'req-980d1c92-8afc-403a-940f-48c28191b337'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:32:49.303941 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-980d1c92-8afc-403a-940f-48c28191b337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37a3444e46804fe1ae16e69d4af79680', 'request_id': 'req-980d1c92-8afc-403a-940f-48c28191b337'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:32:49.311082 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-980d1c92-8afc-403a-940f-48c28191b337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37a3444e46804fe1ae16e69d4af79680', 'request_id': 'req-980d1c92-8afc-403a-940f-48c28191b337'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:32:49.325393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-980d1c92-8afc-403a-940f-48c28191b337 admin admin] The token cache is being invalidate because project 37a3444e46804fe1ae16e69d4af79680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:32:49.325786 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-980d1c92-8afc-403a-940f-48c28191b337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:32:49.326311 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-980d1c92-8afc-403a-940f-48c28191b337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:32:49.327849 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1251/2491] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:32:49 2022] DELETE /identity/v3/projects/37a3444e46804fe1ae16e69d4af79680 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:32:49.334386 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44f7be-c8b1-40ba-bd98-665e3251608f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:49.334672 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44f7be-c8b1-40ba-bd98-665e3251608f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:49.334943 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44f7be-c8b1-40ba-bd98-665e3251608f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:49.392315 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7f44f7be-c8b1-40ba-bd98-665e3251608f None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:32:49.393629 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7f44f7be-c8b1-40ba-bd98-665e3251608f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:49.456823 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1241/2492] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:32:49.465013 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399f417-0329-4469-956d-eced4df58a6e None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:49.465293 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399f417-0329-4469-956d-eced4df58a6e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:49.465595 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399f417-0329-4469-956d-eced4df58a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:49.487230 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-c399f417-0329-4469-956d-eced4df58a6e None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:32:49.488435 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-c399f417-0329-4469-956d-eced4df58a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:49.497274 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1252/2493] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:32:49.501758 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44f7be-c8b1-40ba-bd98-665e3251608f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:49.511950 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44f7be-c8b1-40ba-bd98-665e3251608f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:49.516776 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42e035-0c82-4d1b-8aac-8d4ace69d542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:49.517467 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42e035-0c82-4d1b-8aac-8d4ace69d542 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:49.517745 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42e035-0c82-4d1b-8aac-8d4ace69d542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:49.518016 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42e035-0c82-4d1b-8aac-8d4ace69d542 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:49.518746 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42e035-0c82-4d1b-8aac-8d4ace69d542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:32:49.519048 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42e035-0c82-4d1b-8aac-8d4ace69d542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:49.520636 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42e035-0c82-4d1b-8aac-8d4ace69d542 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:49.536026 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1242/2494] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:32:49.537217 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399f417-0329-4469-956d-eced4df58a6e None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:49.546664 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399f417-0329-4469-956d-eced4df58a6e None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:49.551989 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffafd55-f2e4-4c86-9985-4d3237e14242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:49.552645 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffafd55-f2e4-4c86-9985-4d3237e14242 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:49.552917 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffafd55-f2e4-4c86-9985-4d3237e14242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:49.553334 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffafd55-f2e4-4c86-9985-4d3237e14242 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:49.554060 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffafd55-f2e4-4c86-9985-4d3237e14242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:49.555978 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffafd55-f2e4-4c86-9985-4d3237e14242 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:49.594590 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1253/2495] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:32:49 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:32:49.596139 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42e035-0c82-4d1b-8aac-8d4ace69d542 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:49.606154 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42e035-0c82-4d1b-8aac-8d4ace69d542 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:49.658843 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003c354-2cc4-4ee4-8307-d7663a8fe4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:49.659504 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003c354-2cc4-4ee4-8307-d7663a8fe4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:49.659778 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003c354-2cc4-4ee4-8307-d7663a8fe4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:49.660100 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003c354-2cc4-4ee4-8307-d7663a8fe4f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:49.660867 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003c354-2cc4-4ee4-8307-d7663a8fe4f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:49.662878 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003c354-2cc4-4ee4-8307-d7663a8fe4f5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:49.685122 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1243/2496] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:32:49 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 21:32:49.689447 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffafd55-f2e4-4c86-9985-4d3237e14242 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:49.700059 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffafd55-f2e4-4c86-9985-4d3237e14242 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:49.705151 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d89dc8-44cc-4e97-a825-32ea58232e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:49.705832 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d89dc8-44cc-4e97-a825-32ea58232e4c admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:49.706105 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d89dc8-44cc-4e97-a825-32ea58232e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:49.706369 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d89dc8-44cc-4e97-a825-32ea58232e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:49.707173 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d89dc8-44cc-4e97-a825-32ea58232e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:49.708706 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d89dc8-44cc-4e97-a825-32ea58232e4c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:49.718821 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1254/2497] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:32:49.723192 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003c354-2cc4-4ee4-8307-d7663a8fe4f5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:49.733395 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003c354-2cc4-4ee4-8307-d7663a8fe4f5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:49.738499 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f871a-fc93-46fc-aa55-44bf69c13ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:49.739144 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f871a-fc93-46fc-aa55-44bf69c13ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:49.739395 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f871a-fc93-46fc-aa55-44bf69c13ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:49.739667 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f871a-fc93-46fc-aa55-44bf69c13ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:49.740394 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f871a-fc93-46fc-aa55-44bf69c13ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:49.742005 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f871a-fc93-46fc-aa55-44bf69c13ed5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:49.751974 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1244/2498] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:32:49.756632 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d89dc8-44cc-4e97-a825-32ea58232e4c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:49.766840 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d89dc8-44cc-4e97-a825-32ea58232e4c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:49.772381 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ee2b0-182d-454d-9a2d-ea61c514d2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:49.773269 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ee2b0-182d-454d-9a2d-ea61c514d2de admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:49.773582 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ee2b0-182d-454d-9a2d-ea61c514d2de admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:49.773852 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ee2b0-182d-454d-9a2d-ea61c514d2de admin admin] PATH_INFO: `/v3/projects/575836d33ef84cb9a778bfd168a1f37f/users/4f847dd93a4348038e39859597386d15/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:49.790014 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ee2b0-182d-454d-9a2d-ea61c514d2de admin admin] RBAC: Authorizing `identity:create_grant(project_id=575836d33ef84cb9a778bfd168a1f37f, user_id=4f847dd93a4348038e39859597386d15, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:49.792636 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ee2b0-182d-454d-9a2d-ea61c514d2de admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:49.807467 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1255/2499] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:32:49 2022] PUT /identity/v3/projects/575836d33ef84cb9a778bfd168a1f37f/users/4f847dd93a4348038e39859597386d15/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:32:49.813010 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62442344-a564-4df6-a33a-5ce1ce78aef1 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:49.813313 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62442344-a564-4df6-a33a-5ce1ce78aef1 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:49.813588 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62442344-a564-4df6-a33a-5ce1ce78aef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:49.831194 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-62442344-a564-4df6-a33a-5ce1ce78aef1 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:32:49.832471 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-62442344-a564-4df6-a33a-5ce1ce78aef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:49.895147 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1245/2500] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:32:49.905093 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ee2b0-182d-454d-9a2d-ea61c514d2de admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:49.907132 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-575ee2b0-182d-454d-9a2d-ea61c514d2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:49.967148 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ee2b0-182d-454d-9a2d-ea61c514d2de admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:49.973919 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718555b7-3437-4b63-b2ad-873f60f8baa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:49.974806 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718555b7-3437-4b63-b2ad-873f60f8baa7 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:49.975185 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718555b7-3437-4b63-b2ad-873f60f8baa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:49.975514 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718555b7-3437-4b63-b2ad-873f60f8baa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:49.990109 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718555b7-3437-4b63-b2ad-873f60f8baa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:49.991538 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718555b7-3437-4b63-b2ad-873f60f8baa7 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:50.001018 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1256/2501] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:32:52.003234 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62442344-a564-4df6-a33a-5ce1ce78aef1 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:52.004935 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-62442344-a564-4df6-a33a-5ce1ce78aef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:52.018417 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62442344-a564-4df6-a33a-5ce1ce78aef1 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:52.024093 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6a1ba-9d14-4d39-967f-fbe407629539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:52.024901 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6a1ba-9d14-4d39-967f-fbe407629539 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:52.025299 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6a1ba-9d14-4d39-967f-fbe407629539 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:52.025646 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6a1ba-9d14-4d39-967f-fbe407629539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:52.028047 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-05b6a1ba-9d14-4d39-967f-fbe407629539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:52.043254 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6a1ba-9d14-4d39-967f-fbe407629539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:52.044849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6a1ba-9d14-4d39-967f-fbe407629539 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:52.056674 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1246/2502] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:32:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:32:52.625680 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718555b7-3437-4b63-b2ad-873f60f8baa7 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:52.627159 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-718555b7-3437-4b63-b2ad-873f60f8baa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:52.649274 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718555b7-3437-4b63-b2ad-873f60f8baa7 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:52.661396 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6ca83-3b6e-49b1-9fe6-14787b73ba31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:52.662626 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6ca83-3b6e-49b1-9fe6-14787b73ba31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:52.663166 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6ca83-3b6e-49b1-9fe6-14787b73ba31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:52.663813 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6ca83-3b6e-49b1-9fe6-14787b73ba31 admin admin] PATH_INFO: `/v3/users/1777d21da1ed4a3dbabb518172121e31` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:52.665449 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6ca83-3b6e-49b1-9fe6-14787b73ba31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1777d21da1ed4a3dbabb518172121e31)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:52.667880 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6ca83-3b6e-49b1-9fe6-14787b73ba31 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:52.738343 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-79d6ca83-3b6e-49b1-9fe6-14787b73ba31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1777d21da1ed4a3dbabb518172121e31'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:32:52.750701 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-79d6ca83-3b6e-49b1-9fe6-14787b73ba31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1777d21da1ed4a3dbabb518172121e31'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:32:52.766922 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-79d6ca83-3b6e-49b1-9fe6-14787b73ba31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1777d21da1ed4a3dbabb518172121e31'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:32:52.767973 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-79d6ca83-3b6e-49b1-9fe6-14787b73ba31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1777d21da1ed4a3dbabb518172121e31'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:32:52.768739 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-79d6ca83-3b6e-49b1-9fe6-14787b73ba31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1777d21da1ed4a3dbabb518172121e31'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:32:52.794051 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1257/2503] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:32:52 2022] DELETE /identity/v3/users/1777d21da1ed4a3dbabb518172121e31 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:32:53.006556 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6a1ba-9d14-4d39-967f-fbe407629539 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:53.018527 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6a1ba-9d14-4d39-967f-fbe407629539 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:53.088452 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b94f6f-5023-4599-afce-f1ec4e8afe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:53.089614 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b94f6f-5023-4599-afce-f1ec4e8afe19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:53.090106 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b94f6f-5023-4599-afce-f1ec4e8afe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:53.090572 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b94f6f-5023-4599-afce-f1ec4e8afe19 admin admin] PATH_INFO: `/v3/projects/027599574d6247a880c89d76edd9958a` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:53.091884 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b94f6f-5023-4599-afce-f1ec4e8afe19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=027599574d6247a880c89d76edd9958a)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:53.093898 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b94f6f-5023-4599-afce-f1ec4e8afe19 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:53.152819 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b1b94f6f-5023-4599-afce-f1ec4e8afe19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '027599574d6247a880c89d76edd9958a', 'request_id': 'req-b1b94f6f-5023-4599-afce-f1ec4e8afe19'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:32:53.158952 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b1b94f6f-5023-4599-afce-f1ec4e8afe19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '027599574d6247a880c89d76edd9958a', 'request_id': 'req-b1b94f6f-5023-4599-afce-f1ec4e8afe19'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:32:53.165125 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b1b94f6f-5023-4599-afce-f1ec4e8afe19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '027599574d6247a880c89d76edd9958a', 'request_id': 'req-b1b94f6f-5023-4599-afce-f1ec4e8afe19'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:32:53.180071 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b1b94f6f-5023-4599-afce-f1ec4e8afe19 admin admin] The token cache is being invalidate because project 027599574d6247a880c89d76edd9958a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:32:53.180374 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b1b94f6f-5023-4599-afce-f1ec4e8afe19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:32:53.180999 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b1b94f6f-5023-4599-afce-f1ec4e8afe19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:32:53.182717 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1247/2504] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:32:53 2022] DELETE /identity/v3/projects/027599574d6247a880c89d76edd9958a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 21:32:53.188889 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28770c6e-00ab-4ebd-88c1-e6117f790e22 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:53.189173 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28770c6e-00ab-4ebd-88c1-e6117f790e22 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:53.189475 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28770c6e-00ab-4ebd-88c1-e6117f790e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:53.208604 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-28770c6e-00ab-4ebd-88c1-e6117f790e22 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:32:53.209872 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-28770c6e-00ab-4ebd-88c1-e6117f790e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:53.326157 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1258/2505] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:32:53.334552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e31958-140b-47a7-a9c7-3c7efe233282 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:53.335114 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e31958-140b-47a7-a9c7-3c7efe233282 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:53.335567 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e31958-140b-47a7-a9c7-3c7efe233282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:53.354759 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-d5e31958-140b-47a7-a9c7-3c7efe233282 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:32:53.356203 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d5e31958-140b-47a7-a9c7-3c7efe233282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:53.365872 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1248/2506] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:32:53.370258 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28770c6e-00ab-4ebd-88c1-e6117f790e22 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:53.381275 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28770c6e-00ab-4ebd-88c1-e6117f790e22 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:53.390799 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11238b5-8c30-4d6f-be26-2c9ecee4221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:53.391416 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11238b5-8c30-4d6f-be26-2c9ecee4221b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:53.391689 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11238b5-8c30-4d6f-be26-2c9ecee4221b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:53.392024 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11238b5-8c30-4d6f-be26-2c9ecee4221b admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:53.392766 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11238b5-8c30-4d6f-be26-2c9ecee4221b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:32:53.393065 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11238b5-8c30-4d6f-be26-2c9ecee4221b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:53.395131 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11238b5-8c30-4d6f-be26-2c9ecee4221b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:53.409260 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1259/2507] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 21:32:53.413254 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e31958-140b-47a7-a9c7-3c7efe233282 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:53.424008 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e31958-140b-47a7-a9c7-3c7efe233282 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:53.428904 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f464e-028b-4f24-aa74-a79f9b57e49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:53.429716 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f464e-028b-4f24-aa74-a79f9b57e49f admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:53.430088 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f464e-028b-4f24-aa74-a79f9b57e49f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:53.430582 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f464e-028b-4f24-aa74-a79f9b57e49f admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:53.431649 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f464e-028b-4f24-aa74-a79f9b57e49f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:53.434369 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f464e-028b-4f24-aa74-a79f9b57e49f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:53.464284 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1249/2508] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:32:53 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 21:32:53.468443 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11238b5-8c30-4d6f-be26-2c9ecee4221b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:53.480895 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11238b5-8c30-4d6f-be26-2c9ecee4221b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:53.575918 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cd1d6-7b0a-4d82-81be-647a449a4075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:53.577343 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cd1d6-7b0a-4d82-81be-647a449a4075 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:53.577887 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cd1d6-7b0a-4d82-81be-647a449a4075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:53.578332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cd1d6-7b0a-4d82-81be-647a449a4075 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:53.580053 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cd1d6-7b0a-4d82-81be-647a449a4075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:53.584061 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cd1d6-7b0a-4d82-81be-647a449a4075 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:53.613677 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1260/2509] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:32:53 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:32:53.614979 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f464e-028b-4f24-aa74-a79f9b57e49f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:53.628177 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f464e-028b-4f24-aa74-a79f9b57e49f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:53.634011 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae3614-330f-45b7-8566-33e4a97ac7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:53.635114 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae3614-330f-45b7-8566-33e4a97ac7bd admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:53.635711 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae3614-330f-45b7-8566-33e4a97ac7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:53.636166 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae3614-330f-45b7-8566-33e4a97ac7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:53.637254 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae3614-330f-45b7-8566-33e4a97ac7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:53.640286 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae3614-330f-45b7-8566-33e4a97ac7bd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:53.654744 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1250/2510] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:32:53.658971 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cd1d6-7b0a-4d82-81be-647a449a4075 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:53.670059 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cd1d6-7b0a-4d82-81be-647a449a4075 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:53.675175 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180a2c4-9528-424e-a4ee-fabe8567c646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:53.676181 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180a2c4-9528-424e-a4ee-fabe8567c646 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:53.676737 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180a2c4-9528-424e-a4ee-fabe8567c646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:53.677176 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180a2c4-9528-424e-a4ee-fabe8567c646 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:53.677962 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180a2c4-9528-424e-a4ee-fabe8567c646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:53.679931 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180a2c4-9528-424e-a4ee-fabe8567c646 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:53.692677 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1261/2511] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 21:32:53.696527 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae3614-330f-45b7-8566-33e4a97ac7bd admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:53.706998 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae3614-330f-45b7-8566-33e4a97ac7bd admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:53.712234 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d70a88-af63-41ff-8775-fe16a31328d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:53.713384 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d70a88-af63-41ff-8775-fe16a31328d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:53.713634 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d70a88-af63-41ff-8775-fe16a31328d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:53.714072 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d70a88-af63-41ff-8775-fe16a31328d4 admin admin] PATH_INFO: `/v3/projects/18f83e5b7cff40cf9e1639699d2b3181/users/3fb7aa8a4448409d82c94cceadd3f012/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:53.731084 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d70a88-af63-41ff-8775-fe16a31328d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f83e5b7cff40cf9e1639699d2b3181, user_id=3fb7aa8a4448409d82c94cceadd3f012, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:53.733944 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d70a88-af63-41ff-8775-fe16a31328d4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:53.750653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1251/2512] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:32:53 2022] PUT /identity/v3/projects/18f83e5b7cff40cf9e1639699d2b3181/users/3fb7aa8a4448409d82c94cceadd3f012/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:32:53.762550 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901d308-d05e-4b6a-a58b-5773d5a6c4d6 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:53.763306 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901d308-d05e-4b6a-a58b-5773d5a6c4d6 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:53.763952 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901d308-d05e-4b6a-a58b-5773d5a6c4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:53.797612 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-c901d308-d05e-4b6a-a58b-5773d5a6c4d6 None None] MFA Rules not processed for user `3fb7aa8a4448409d82c94cceadd3f012`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:32:53.799041 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-c901d308-d05e-4b6a-a58b-5773d5a6c4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:53.869666 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1262/2513] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:32:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:32:53.875431 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d70a88-af63-41ff-8775-fe16a31328d4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:53.963991 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d70a88-af63-41ff-8775-fe16a31328d4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:53.971258 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8701080-694b-4d57-9fb2-c6a655cae1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:53.972219 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8701080-694b-4d57-9fb2-c6a655cae1ad admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:53.972595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8701080-694b-4d57-9fb2-c6a655cae1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:53.973006 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8701080-694b-4d57-9fb2-c6a655cae1ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:53.975017 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8701080-694b-4d57-9fb2-c6a655cae1ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:53.980725 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8701080-694b-4d57-9fb2-c6a655cae1ad admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:54.014211 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1252/2514] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:32:53 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 21:32:54.017896 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901d308-d05e-4b6a-a58b-5773d5a6c4d6 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:54.034119 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901d308-d05e-4b6a-a58b-5773d5a6c4d6 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:54.115381 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7786d0-c9ac-40c5-a1a1-b236a1f01c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:54.116110 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7786d0-c9ac-40c5-a1a1-b236a1f01c4c admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:54.116482 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7786d0-c9ac-40c5-a1a1-b236a1f01c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:54.116852 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7786d0-c9ac-40c5-a1a1-b236a1f01c4c admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:54.117695 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7786d0-c9ac-40c5-a1a1-b236a1f01c4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:54.119924 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7786d0-c9ac-40c5-a1a1-b236a1f01c4c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:54.146160 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1263/2515] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:32:54 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:32:54.149875 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8701080-694b-4d57-9fb2-c6a655cae1ad admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:54.160295 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8701080-694b-4d57-9fb2-c6a655cae1ad admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:54.165542 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b659a-6c37-4c8f-a173-eebc794b654e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:54.166290 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b659a-6c37-4c8f-a173-eebc794b654e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:54.166628 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b659a-6c37-4c8f-a173-eebc794b654e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:54.166957 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b659a-6c37-4c8f-a173-eebc794b654e admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:54.167759 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b659a-6c37-4c8f-a173-eebc794b654e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:54.169463 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b659a-6c37-4c8f-a173-eebc794b654e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:54.181058 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1253/2516] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:32:54.185815 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7786d0-c9ac-40c5-a1a1-b236a1f01c4c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:54.195804 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7786d0-c9ac-40c5-a1a1-b236a1f01c4c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:54.200613 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bca406-d5f3-4a5d-a68a-0bb576ff7a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:54.201623 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bca406-d5f3-4a5d-a68a-0bb576ff7a8c admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:54.201970 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bca406-d5f3-4a5d-a68a-0bb576ff7a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:54.202300 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bca406-d5f3-4a5d-a68a-0bb576ff7a8c admin admin] PATH_INFO: `/v3/projects/cd0df002812542d8a87034125ec00d87/users/e8bed66449ea4bbc81a482ebcdd5e127/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:54.220740 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bca406-d5f3-4a5d-a68a-0bb576ff7a8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0df002812542d8a87034125ec00d87, user_id=e8bed66449ea4bbc81a482ebcdd5e127, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:54.223649 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bca406-d5f3-4a5d-a68a-0bb576ff7a8c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:54.243644 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1264/2517] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:32:54 2022] PUT /identity/v3/projects/cd0df002812542d8a87034125ec00d87/users/e8bed66449ea4bbc81a482ebcdd5e127/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:32:54.247931 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b659a-6c37-4c8f-a173-eebc794b654e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:54.262142 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b659a-6c37-4c8f-a173-eebc794b654e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:54.354207 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822b6ef-30ce-4d2e-83c7-b16f4f2984cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:54.355026 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822b6ef-30ce-4d2e-83c7-b16f4f2984cb admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:54.355389 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822b6ef-30ce-4d2e-83c7-b16f4f2984cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:54.355800 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822b6ef-30ce-4d2e-83c7-b16f4f2984cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:54.356652 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822b6ef-30ce-4d2e-83c7-b16f4f2984cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:54.363643 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822b6ef-30ce-4d2e-83c7-b16f4f2984cb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:54.398355 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1254/2518] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:32:54.402159 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bca406-d5f3-4a5d-a68a-0bb576ff7a8c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:54.415168 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bca406-d5f3-4a5d-a68a-0bb576ff7a8c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:54.422945 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcaa148-3ba4-4a49-bd4f-a1adaefec40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:54.424710 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaa148-3ba4-4a49-bd4f-a1adaefec40f admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:54.424982 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaa148-3ba4-4a49-bd4f-a1adaefec40f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:54.425290 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaa148-3ba4-4a49-bd4f-a1adaefec40f admin admin] PATH_INFO: `/v3/projects/cd0df002812542d8a87034125ec00d87/users/e8bed66449ea4bbc81a482ebcdd5e127/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:54.427431 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcaa148-3ba4-4a49-bd4f-a1adaefec40f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0df002812542d8a87034125ec00d87, user_id=e8bed66449ea4bbc81a482ebcdd5e127, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:54.435315 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcaa148-3ba4-4a49-bd4f-a1adaefec40f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:54.447727 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1265/2519] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:32:54 2022] PUT /identity/v3/projects/cd0df002812542d8a87034125ec00d87/users/e8bed66449ea4bbc81a482ebcdd5e127/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 21:32:54.458039 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14d61c-6ae1-4942-aaf3-da7e1bac87bb None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:54.458414 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14d61c-6ae1-4942-aaf3-da7e1bac87bb None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:54.458760 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14d61c-6ae1-4942-aaf3-da7e1bac87bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:54.496025 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-9b14d61c-6ae1-4942-aaf3-da7e1bac87bb None None] MFA Rules not processed for user `e8bed66449ea4bbc81a482ebcdd5e127`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:32:54.497762 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9b14d61c-6ae1-4942-aaf3-da7e1bac87bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:54.596793 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1255/2520] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:32:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:32:54.607586 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcaa148-3ba4-4a49-bd4f-a1adaefec40f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:54.609496 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-edcaa148-3ba4-4a49-bd4f-a1adaefec40f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:54.688249 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcaa148-3ba4-4a49-bd4f-a1adaefec40f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:54.694123 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee7856-4a7d-405f-8195-d84c8392149c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:54.695598 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee7856-4a7d-405f-8195-d84c8392149c service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:54.696199 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee7856-4a7d-405f-8195-d84c8392149c service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:54.696472 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee7856-4a7d-405f-8195-d84c8392149c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:54.706370 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee7856-4a7d-405f-8195-d84c8392149c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:54.708119 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee7856-4a7d-405f-8195-d84c8392149c service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:54.718771 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1266/2521] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:32:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:32:54.752723 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd1848-a1a4-4ae8-8c16-28d053e26953 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:54.753047 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd1848-a1a4-4ae8-8c16-28d053e26953 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:54.753280 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd1848-a1a4-4ae8-8c16-28d053e26953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:54.791873 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-cacd1848-a1a4-4ae8-8c16-28d053e26953 None None] MFA Rules not processed for user `4f847dd93a4348038e39859597386d15`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:32:54.794206 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-cacd1848-a1a4-4ae8-8c16-28d053e26953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:54.810640 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee7856-4a7d-405f-8195-d84c8392149c service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:54.820079 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee7856-4a7d-405f-8195-d84c8392149c service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:54.824577 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f718ed-9fe0-46ca-ae18-3e89def8ab2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:54.825589 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f718ed-9fe0-46ca-ae18-3e89def8ab2b service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:54.826056 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f718ed-9fe0-46ca-ae18-3e89def8ab2b service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:54.826500 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f718ed-9fe0-46ca-ae18-3e89def8ab2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:54.875483 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1256/2522] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:32:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:32:54.879564 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd1848-a1a4-4ae8-8c16-28d053e26953 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:54.881281 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-cacd1848-a1a4-4ae8-8c16-28d053e26953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:32:54.896493 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f718ed-9fe0-46ca-ae18-3e89def8ab2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:54.898119 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f718ed-9fe0-46ca-ae18-3e89def8ab2b service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:54.908545 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1267/2523] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:32:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 21:32:54.961912 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd1848-a1a4-4ae8-8c16-28d053e26953 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:54.967812 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82e0c0-3a20-4a05-9679-373fdc9ca196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:54.969108 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82e0c0-3a20-4a05-9679-373fdc9ca196 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:54.969694 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82e0c0-3a20-4a05-9679-373fdc9ca196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:54.969992 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82e0c0-3a20-4a05-9679-373fdc9ca196 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:54.971067 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82e0c0-3a20-4a05-9679-373fdc9ca196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:54.973629 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82e0c0-3a20-4a05-9679-373fdc9ca196 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:55.005396 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1257/2524] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:32:54 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:32:55.008098 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f718ed-9fe0-46ca-ae18-3e89def8ab2b service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:55.031177 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f718ed-9fe0-46ca-ae18-3e89def8ab2b service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:55.095278 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe2f2f-0385-4761-b54f-5d305ec849d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:55.096037 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe2f2f-0385-4761-b54f-5d305ec849d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:55.096444 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe2f2f-0385-4761-b54f-5d305ec849d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:55.096816 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe2f2f-0385-4761-b54f-5d305ec849d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:55.097670 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe2f2f-0385-4761-b54f-5d305ec849d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:55.099711 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe2f2f-0385-4761-b54f-5d305ec849d9 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:55.120864 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1268/2525] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:32:55 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:32:55.125000 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82e0c0-3a20-4a05-9679-373fdc9ca196 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:55.135319 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82e0c0-3a20-4a05-9679-373fdc9ca196 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:55.140038 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de798317-843c-4fcf-9e04-659c47798bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:55.140706 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de798317-843c-4fcf-9e04-659c47798bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:55.140980 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de798317-843c-4fcf-9e04-659c47798bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:55.141243 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de798317-843c-4fcf-9e04-659c47798bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:55.141999 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de798317-843c-4fcf-9e04-659c47798bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:55.143595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de798317-843c-4fcf-9e04-659c47798bc0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:55.154206 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1258/2526] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:32:55.158275 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe2f2f-0385-4761-b54f-5d305ec849d9 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:55.168729 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe2f2f-0385-4761-b54f-5d305ec849d9 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:55.174013 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e51be-23ff-469c-9ba7-2f376245fe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:55.174831 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e51be-23ff-469c-9ba7-2f376245fe54 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:55.175103 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e51be-23ff-469c-9ba7-2f376245fe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:55.175423 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e51be-23ff-469c-9ba7-2f376245fe54 admin admin] PATH_INFO: `/v3/projects/fb95747cf2764da5aada624ec2f28f4a/users/06206874bac54c56b20e333a71f5d998/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:55.191338 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e51be-23ff-469c-9ba7-2f376245fe54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb95747cf2764da5aada624ec2f28f4a, user_id=06206874bac54c56b20e333a71f5d998, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:55.194005 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e51be-23ff-469c-9ba7-2f376245fe54 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:55.207784 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1269/2527] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:32:55 2022] PUT /identity/v3/projects/fb95747cf2764da5aada624ec2f28f4a/users/06206874bac54c56b20e333a71f5d998/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:32:55.211754 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de798317-843c-4fcf-9e04-659c47798bc0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:55.221678 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de798317-843c-4fcf-9e04-659c47798bc0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:55.280525 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35be56d-85a8-4847-9a36-2b797f0a17ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:55.281217 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35be56d-85a8-4847-9a36-2b797f0a17ef admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:55.281524 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35be56d-85a8-4847-9a36-2b797f0a17ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:55.281792 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35be56d-85a8-4847-9a36-2b797f0a17ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:55.282531 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35be56d-85a8-4847-9a36-2b797f0a17ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:55.284126 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35be56d-85a8-4847-9a36-2b797f0a17ef admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:55.294447 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1259/2528] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 21:32:55.298728 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e51be-23ff-469c-9ba7-2f376245fe54 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:32:55.309777 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e51be-23ff-469c-9ba7-2f376245fe54 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:32:55.314680 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f070a-ae5a-4684-b779-c7a67d0ca534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:32:55.315560 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f070a-ae5a-4684-b779-c7a67d0ca534 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:32:55.315834 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f070a-ae5a-4684-b779-c7a67d0ca534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:32:55.316101 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f070a-ae5a-4684-b779-c7a67d0ca534 admin admin] PATH_INFO: `/v3/projects/fb95747cf2764da5aada624ec2f28f4a/users/06206874bac54c56b20e333a71f5d998/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:32:55.318098 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f070a-ae5a-4684-b779-c7a67d0ca534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb95747cf2764da5aada624ec2f28f4a, user_id=06206874bac54c56b20e333a71f5d998, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:32:55.320747 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f070a-ae5a-4684-b779-c7a67d0ca534 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:32:55.331030 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1270/2529] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:32:55 2022] PUT /identity/v3/projects/fb95747cf2764da5aada624ec2f28f4a/users/06206874bac54c56b20e333a71f5d998/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:33:00.076011 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8c6dc-a492-4765-9e1a-705652bcc9ea None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:00.076569 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8c6dc-a492-4765-9e1a-705652bcc9ea None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:00.076569 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8c6dc-a492-4765-9e1a-705652bcc9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:00.107846 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-68f8c6dc-a492-4765-9e1a-705652bcc9ea None None] MFA Rules not processed for user `06206874bac54c56b20e333a71f5d998`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:33:00.109066 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-68f8c6dc-a492-4765-9e1a-705652bcc9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:00.183480 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1260/2530] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:33:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:33:00.195880 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f070a-ae5a-4684-b779-c7a67d0ca534 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:00.197515 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-0a8f070a-ae5a-4684-b779-c7a67d0ca534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:00.274250 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f070a-ae5a-4684-b779-c7a67d0ca534 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:00.279787 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04db8f-6b5a-45da-a052-afd7b20a2104 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:00.280477 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04db8f-6b5a-45da-a052-afd7b20a2104 service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:00.280759 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04db8f-6b5a-45da-a052-afd7b20a2104 service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:00.281033 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04db8f-6b5a-45da-a052-afd7b20a2104 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:00.336689 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04db8f-6b5a-45da-a052-afd7b20a2104 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:00.338354 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04db8f-6b5a-45da-a052-afd7b20a2104 service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:00.349543 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1271/2531] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:33:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:33:34.641155 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6c591-b2a3-456a-978b-c3dc391cd3f7 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:34.641642 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6c591-b2a3-456a-978b-c3dc391cd3f7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:34.641748 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6c591-b2a3-456a-978b-c3dc391cd3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:34.660723 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-f7e6c591-b2a3-456a-978b-c3dc391cd3f7 None None] MFA Rules not processed for user `4f847dd93a4348038e39859597386d15`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:33:34.661955 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f7e6c591-b2a3-456a-978b-c3dc391cd3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:34.670029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1261/2532] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:33:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:33:34.993762 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04db8f-6b5a-45da-a052-afd7b20a2104 service nova] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:34.995344 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-8f04db8f-6b5a-45da-a052-afd7b20a2104 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:35.055056 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04db8f-6b5a-45da-a052-afd7b20a2104 service nova] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:35.059735 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4b1d7-9343-4e5e-a74c-b7d7ed2d25f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:35.060388 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4b1d7-9343-4e5e-a74c-b7d7ed2d25f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:35.060667 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4b1d7-9343-4e5e-a74c-b7d7ed2d25f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:35.060938 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4b1d7-9343-4e5e-a74c-b7d7ed2d25f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:35.062806 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-0eb4b1d7-9343-4e5e-a74c-b7d7ed2d25f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:35.073853 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4b1d7-9343-4e5e-a74c-b7d7ed2d25f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:35.075287 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4b1d7-9343-4e5e-a74c-b7d7ed2d25f2 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:35.083868 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1272/2533] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:33:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:33:35.526894 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6c591-b2a3-456a-978b-c3dc391cd3f7 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:35.528405 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f7e6c591-b2a3-456a-978b-c3dc391cd3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:35.614656 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6c591-b2a3-456a-978b-c3dc391cd3f7 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:35.620019 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08d99c-ffd8-478b-8491-77bb631ff76f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f05eb88abe24af4825259712b497d48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:35.620666 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08d99c-ffd8-478b-8491-77bb631ff76f service placement] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:35.620941 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08d99c-ffd8-478b-8491-77bb631ff76f service placement] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:35.621204 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08d99c-ffd8-478b-8491-77bb631ff76f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:35.623344 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ec08d99c-ffd8-478b-8491-77bb631ff76f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:35.635265 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08d99c-ffd8-478b-8491-77bb631ff76f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:35.636883 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08d99c-ffd8-478b-8491-77bb631ff76f service placement] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:35.646965 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1262/2534] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:33:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:33:45.881826 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4b1d7-9343-4e5e-a74c-b7d7ed2d25f2 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:45.947097 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4b1d7-9343-4e5e-a74c-b7d7ed2d25f2 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:45.951913 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d56ea-02de-48b7-89af-ca64257a9086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:45.952768 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d56ea-02de-48b7-89af-ca64257a9086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:45.953040 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d56ea-02de-48b7-89af-ca64257a9086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:45.953304 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d56ea-02de-48b7-89af-ca64257a9086 admin admin] PATH_INFO: `/v3/users/3fb7aa8a4448409d82c94cceadd3f012` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:45.954532 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d56ea-02de-48b7-89af-ca64257a9086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb7aa8a4448409d82c94cceadd3f012)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:45.956415 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d56ea-02de-48b7-89af-ca64257a9086 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:46.003920 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-679d56ea-02de-48b7-89af-ca64257a9086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb7aa8a4448409d82c94cceadd3f012'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:46.011209 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-679d56ea-02de-48b7-89af-ca64257a9086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb7aa8a4448409d82c94cceadd3f012'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:46.029549 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-679d56ea-02de-48b7-89af-ca64257a9086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb7aa8a4448409d82c94cceadd3f012'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:46.030257 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-679d56ea-02de-48b7-89af-ca64257a9086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb7aa8a4448409d82c94cceadd3f012'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:46.030953 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-679d56ea-02de-48b7-89af-ca64257a9086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb7aa8a4448409d82c94cceadd3f012'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:46.045542 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1273/2535] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:33:45 2022] DELETE /identity/v3/users/3fb7aa8a4448409d82c94cceadd3f012 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:33:46.050173 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf643136-10db-42c0-b8df-501aadedbcfd None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:46.050722 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf643136-10db-42c0-b8df-501aadedbcfd None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:46.050722 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf643136-10db-42c0-b8df-501aadedbcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:46.069271 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-cf643136-10db-42c0-b8df-501aadedbcfd None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:33:46.070729 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-cf643136-10db-42c0-b8df-501aadedbcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:46.129798 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1263/2536] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:33:46.139616 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d56ea-02de-48b7-89af-ca64257a9086 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:46.140920 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-679d56ea-02de-48b7-89af-ca64257a9086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:46.197981 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d56ea-02de-48b7-89af-ca64257a9086 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:46.201545 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d77d52-7492-47a6-97d2-91acf1830e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:46.202185 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d77d52-7492-47a6-97d2-91acf1830e03 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:46.202457 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d77d52-7492-47a6-97d2-91acf1830e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:46.202745 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d77d52-7492-47a6-97d2-91acf1830e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:46.211449 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d77d52-7492-47a6-97d2-91acf1830e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:46.212909 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d77d52-7492-47a6-97d2-91acf1830e03 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:46.222526 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1274/2537] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:33:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:33:46.496364 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf643136-10db-42c0-b8df-501aadedbcfd None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:46.498314 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-cf643136-10db-42c0-b8df-501aadedbcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:46.518644 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf643136-10db-42c0-b8df-501aadedbcfd None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:46.531765 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc9944-bf17-491d-9b51-0c6d8695a28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:46.532645 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc9944-bf17-491d-9b51-0c6d8695a28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:46.532922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc9944-bf17-491d-9b51-0c6d8695a28d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:46.533214 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc9944-bf17-491d-9b51-0c6d8695a28d admin admin] PATH_INFO: `/v3/projects/18f83e5b7cff40cf9e1639699d2b3181` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:46.534521 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc9944-bf17-491d-9b51-0c6d8695a28d admin admin] RBAC: Authorizing `identity:delete_project(project_id=18f83e5b7cff40cf9e1639699d2b3181)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:46.536410 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc9944-bf17-491d-9b51-0c6d8695a28d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:46.591111 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-5afc9944-bf17-491d-9b51-0c6d8695a28d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f83e5b7cff40cf9e1639699d2b3181', 'request_id': 'req-5afc9944-bf17-491d-9b51-0c6d8695a28d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:46.596318 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-5afc9944-bf17-491d-9b51-0c6d8695a28d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f83e5b7cff40cf9e1639699d2b3181', 'request_id': 'req-5afc9944-bf17-491d-9b51-0c6d8695a28d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:46.602625 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-5afc9944-bf17-491d-9b51-0c6d8695a28d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f83e5b7cff40cf9e1639699d2b3181', 'request_id': 'req-5afc9944-bf17-491d-9b51-0c6d8695a28d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:46.617088 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-5afc9944-bf17-491d-9b51-0c6d8695a28d admin admin] The token cache is being invalidate because project 18f83e5b7cff40cf9e1639699d2b3181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:33:46.617300 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-5afc9944-bf17-491d-9b51-0c6d8695a28d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:46.617927 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-5afc9944-bf17-491d-9b51-0c6d8695a28d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:46.619487 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1264/2538] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:33:46 2022] DELETE /identity/v3/projects/18f83e5b7cff40cf9e1639699d2b3181 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:33:46.623798 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d77d52-7492-47a6-97d2-91acf1830e03 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:46.633708 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d77d52-7492-47a6-97d2-91acf1830e03 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:46.690022 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b3aa0-d1f6-45d6-8260-0e811ef055f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:46.690926 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b3aa0-d1f6-45d6-8260-0e811ef055f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:46.691203 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b3aa0-d1f6-45d6-8260-0e811ef055f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:46.691476 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b3aa0-d1f6-45d6-8260-0e811ef055f1 admin admin] PATH_INFO: `/v3/users/e8bed66449ea4bbc81a482ebcdd5e127` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:46.692718 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b3aa0-d1f6-45d6-8260-0e811ef055f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8bed66449ea4bbc81a482ebcdd5e127)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:46.694683 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b3aa0-d1f6-45d6-8260-0e811ef055f1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:46.745102 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-076b3aa0-d1f6-45d6-8260-0e811ef055f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8bed66449ea4bbc81a482ebcdd5e127'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:46.753006 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-076b3aa0-d1f6-45d6-8260-0e811ef055f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8bed66449ea4bbc81a482ebcdd5e127'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:46.767141 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-076b3aa0-d1f6-45d6-8260-0e811ef055f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8bed66449ea4bbc81a482ebcdd5e127'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:46.767929 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-076b3aa0-d1f6-45d6-8260-0e811ef055f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8bed66449ea4bbc81a482ebcdd5e127'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:46.768627 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-076b3aa0-d1f6-45d6-8260-0e811ef055f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8bed66449ea4bbc81a482ebcdd5e127'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:46.787238 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1275/2539] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:33:46 2022] DELETE /identity/v3/users/e8bed66449ea4bbc81a482ebcdd5e127 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:33:47.065886 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc9944-bf17-491d-9b51-0c6d8695a28d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:47.067861 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5afc9944-bf17-491d-9b51-0c6d8695a28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:47.081426 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc9944-bf17-491d-9b51-0c6d8695a28d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:47.136115 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde42f4-1700-4e84-922d-962d7fe8aed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:47.137088 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde42f4-1700-4e84-922d-962d7fe8aed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:47.137391 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde42f4-1700-4e84-922d-962d7fe8aed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:47.137671 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde42f4-1700-4e84-922d-962d7fe8aed2 admin admin] PATH_INFO: `/v3/projects/cd0df002812542d8a87034125ec00d87` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:47.138970 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde42f4-1700-4e84-922d-962d7fe8aed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd0df002812542d8a87034125ec00d87)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:47.140818 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde42f4-1700-4e84-922d-962d7fe8aed2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:47.195079 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-fbde42f4-1700-4e84-922d-962d7fe8aed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd0df002812542d8a87034125ec00d87', 'request_id': 'req-fbde42f4-1700-4e84-922d-962d7fe8aed2'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:47.200769 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-fbde42f4-1700-4e84-922d-962d7fe8aed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd0df002812542d8a87034125ec00d87', 'request_id': 'req-fbde42f4-1700-4e84-922d-962d7fe8aed2'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:47.206971 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-fbde42f4-1700-4e84-922d-962d7fe8aed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd0df002812542d8a87034125ec00d87', 'request_id': 'req-fbde42f4-1700-4e84-922d-962d7fe8aed2'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:47.220011 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-fbde42f4-1700-4e84-922d-962d7fe8aed2 admin admin] The token cache is being invalidate because project cd0df002812542d8a87034125ec00d87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:33:47.220289 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-fbde42f4-1700-4e84-922d-962d7fe8aed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:47.220892 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-fbde42f4-1700-4e84-922d-962d7fe8aed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:47.222475 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1265/2540] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:33:47 2022] DELETE /identity/v3/projects/cd0df002812542d8a87034125ec00d87 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 21:33:47.227441 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e756c-3d00-4775-b38b-d318711bf9f7 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:47.227969 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e756c-3d00-4775-b38b-d318711bf9f7 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:47.227969 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e756c-3d00-4775-b38b-d318711bf9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:47.246758 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-e11e756c-3d00-4775-b38b-d318711bf9f7 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:33:47.247960 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-e11e756c-3d00-4775-b38b-d318711bf9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:47.304560 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1276/2541] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:33:47.313797 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a200f40-fe41-42c5-a7b7-f21a88dc494e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:47.314134 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a200f40-fe41-42c5-a7b7-f21a88dc494e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:47.314530 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a200f40-fe41-42c5-a7b7-f21a88dc494e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:47.334094 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-1a200f40-fe41-42c5-a7b7-f21a88dc494e None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:33:47.335314 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1a200f40-fe41-42c5-a7b7-f21a88dc494e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:47.344300 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1266/2542] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:33:47.348735 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e756c-3d00-4775-b38b-d318711bf9f7 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:47.358633 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e756c-3d00-4775-b38b-d318711bf9f7 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:47.363776 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26823c-d65a-4e6b-82d5-4004856e4a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:47.364432 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26823c-d65a-4e6b-82d5-4004856e4a5e admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:47.364711 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26823c-d65a-4e6b-82d5-4004856e4a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:47.365023 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26823c-d65a-4e6b-82d5-4004856e4a5e admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:47.365790 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26823c-d65a-4e6b-82d5-4004856e4a5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:33:47.366097 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26823c-d65a-4e6b-82d5-4004856e4a5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:47.367700 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26823c-d65a-4e6b-82d5-4004856e4a5e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:47.379659 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1277/2543] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 21:33:47.384218 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a200f40-fe41-42c5-a7b7-f21a88dc494e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:47.394828 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a200f40-fe41-42c5-a7b7-f21a88dc494e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:47.402794 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72416fa-a5c0-4497-b011-675fddee6685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:47.403449 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72416fa-a5c0-4497-b011-675fddee6685 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:47.403727 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72416fa-a5c0-4497-b011-675fddee6685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:47.404013 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72416fa-a5c0-4497-b011-675fddee6685 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:47.404702 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72416fa-a5c0-4497-b011-675fddee6685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:47.406635 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72416fa-a5c0-4497-b011-675fddee6685 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:47.433531 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1267/2544] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:33:47 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:33:47.437833 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26823c-d65a-4e6b-82d5-4004856e4a5e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:47.448051 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26823c-d65a-4e6b-82d5-4004856e4a5e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:47.503115 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc619384-1dbf-4445-87a9-4c1b2d462fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:47.503810 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc619384-1dbf-4445-87a9-4c1b2d462fde admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:47.504086 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc619384-1dbf-4445-87a9-4c1b2d462fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:47.504360 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc619384-1dbf-4445-87a9-4c1b2d462fde admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:47.505109 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc619384-1dbf-4445-87a9-4c1b2d462fde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:47.507072 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc619384-1dbf-4445-87a9-4c1b2d462fde admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:47.528492 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1278/2545] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:33:47 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:33:47.532613 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72416fa-a5c0-4497-b011-675fddee6685 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:47.543391 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72416fa-a5c0-4497-b011-675fddee6685 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:47.548800 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2defc5c-6540-4227-91d9-fb7f65ff12ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:47.549490 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2defc5c-6540-4227-91d9-fb7f65ff12ae admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:47.549789 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2defc5c-6540-4227-91d9-fb7f65ff12ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:47.550056 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2defc5c-6540-4227-91d9-fb7f65ff12ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:47.551114 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2defc5c-6540-4227-91d9-fb7f65ff12ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:47.552804 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2defc5c-6540-4227-91d9-fb7f65ff12ae admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:47.564573 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1268/2546] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:33:47.568505 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc619384-1dbf-4445-87a9-4c1b2d462fde admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:47.578534 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc619384-1dbf-4445-87a9-4c1b2d462fde admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:47.583867 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef0592-b082-4f5a-867d-5daade02ae99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:47.584542 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef0592-b082-4f5a-867d-5daade02ae99 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:47.584806 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef0592-b082-4f5a-867d-5daade02ae99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:47.585073 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef0592-b082-4f5a-867d-5daade02ae99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:47.585894 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef0592-b082-4f5a-867d-5daade02ae99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:47.587560 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef0592-b082-4f5a-867d-5daade02ae99 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:47.600166 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1279/2547] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:33:47.604941 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2defc5c-6540-4227-91d9-fb7f65ff12ae admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:47.614825 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2defc5c-6540-4227-91d9-fb7f65ff12ae admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:47.620019 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee75f27-e66b-4b92-8b1c-a166fbe83728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:47.621007 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee75f27-e66b-4b92-8b1c-a166fbe83728 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:47.621148 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee75f27-e66b-4b92-8b1c-a166fbe83728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:47.621517 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee75f27-e66b-4b92-8b1c-a166fbe83728 admin admin] PATH_INFO: `/v3/projects/c5f7cf925fc34c8fb52d5d971b9b0788/users/bed24447f64a4dc69dcac5bdd3f1298f/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:47.636438 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee75f27-e66b-4b92-8b1c-a166fbe83728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5f7cf925fc34c8fb52d5d971b9b0788, user_id=bed24447f64a4dc69dcac5bdd3f1298f, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:47.639221 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee75f27-e66b-4b92-8b1c-a166fbe83728 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:47.655263 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1269/2548] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:33:47 2022] PUT /identity/v3/projects/c5f7cf925fc34c8fb52d5d971b9b0788/users/bed24447f64a4dc69dcac5bdd3f1298f/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:33:47.665492 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721894b3-9188-4758-82af-14b5e212d63b None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:47.665802 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721894b3-9188-4758-82af-14b5e212d63b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:47.667001 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721894b3-9188-4758-82af-14b5e212d63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:47.692998 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-721894b3-9188-4758-82af-14b5e212d63b None None] MFA Rules not processed for user `bed24447f64a4dc69dcac5bdd3f1298f`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:33:47.694207 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-721894b3-9188-4758-82af-14b5e212d63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:47.756671 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1280/2549] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:33:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:33:47.762807 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee75f27-e66b-4b92-8b1c-a166fbe83728 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:47.830449 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee75f27-e66b-4b92-8b1c-a166fbe83728 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:47.836403 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a49f0-00c2-405b-9969-8163247d8259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:47.837062 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a49f0-00c2-405b-9969-8163247d8259 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:47.837321 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a49f0-00c2-405b-9969-8163247d8259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:47.837651 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a49f0-00c2-405b-9969-8163247d8259 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:47.838338 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a49f0-00c2-405b-9969-8163247d8259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:47.840257 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a49f0-00c2-405b-9969-8163247d8259 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:47.868770 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1270/2550] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:33:47 2022] POST /identity/v3/projects => generated 369 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:33:47.872992 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721894b3-9188-4758-82af-14b5e212d63b None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:47.883808 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721894b3-9188-4758-82af-14b5e212d63b None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:47.939076 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87942df9-382d-4df1-932e-749c7ddadfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:47.939656 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87942df9-382d-4df1-932e-749c7ddadfe2 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:47.939923 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87942df9-382d-4df1-932e-749c7ddadfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:47.940185 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87942df9-382d-4df1-932e-749c7ddadfe2 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:47.940863 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87942df9-382d-4df1-932e-749c7ddadfe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:47.942801 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87942df9-382d-4df1-932e-749c7ddadfe2 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:47.964555 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1281/2551] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:33:47 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:33:47.968592 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a49f0-00c2-405b-9969-8163247d8259 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:47.979259 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a49f0-00c2-405b-9969-8163247d8259 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:47.984766 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a6854-1780-41f1-bbab-da83c03244c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:47.985422 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a6854-1780-41f1-bbab-da83c03244c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:47.985705 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a6854-1780-41f1-bbab-da83c03244c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:47.985975 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a6854-1780-41f1-bbab-da83c03244c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:47.986711 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a6854-1780-41f1-bbab-da83c03244c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:47.988314 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a6854-1780-41f1-bbab-da83c03244c4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:47.999949 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1271/2552] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:33:48.004144 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87942df9-382d-4df1-932e-749c7ddadfe2 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:48.015097 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87942df9-382d-4df1-932e-749c7ddadfe2 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:48.020661 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258de0a-fe81-4e09-b957-c0dadf9cc670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:48.021597 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258de0a-fe81-4e09-b957-c0dadf9cc670 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:48.021867 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258de0a-fe81-4e09-b957-c0dadf9cc670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:48.022131 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258de0a-fe81-4e09-b957-c0dadf9cc670 admin admin] PATH_INFO: `/v3/projects/ed734412697e4f1fa3b48f398ae32536/users/5a4ca8310d6c4eb58f0c3c7f9027340f/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:48.037026 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258de0a-fe81-4e09-b957-c0dadf9cc670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed734412697e4f1fa3b48f398ae32536, user_id=5a4ca8310d6c4eb58f0c3c7f9027340f, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:48.039659 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258de0a-fe81-4e09-b957-c0dadf9cc670 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:48.054759 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1282/2553] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:33:48 2022] PUT /identity/v3/projects/ed734412697e4f1fa3b48f398ae32536/users/5a4ca8310d6c4eb58f0c3c7f9027340f/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:33:48.059047 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a6854-1780-41f1-bbab-da83c03244c4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:48.068954 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a6854-1780-41f1-bbab-da83c03244c4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:48.126325 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9afce7e-80c4-4603-af44-345de3039c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:48.127014 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afce7e-80c4-4603-af44-345de3039c8d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:48.127248 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afce7e-80c4-4603-af44-345de3039c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:48.127517 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afce7e-80c4-4603-af44-345de3039c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:48.128248 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9afce7e-80c4-4603-af44-345de3039c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:48.130117 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9afce7e-80c4-4603-af44-345de3039c8d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:48.140036 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1272/2554] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:33:48.145926 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258de0a-fe81-4e09-b957-c0dadf9cc670 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:48.156837 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258de0a-fe81-4e09-b957-c0dadf9cc670 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:48.162095 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156c0bb-5224-4afe-a962-dd2934514ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:48.162986 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156c0bb-5224-4afe-a962-dd2934514ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:48.163266 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156c0bb-5224-4afe-a962-dd2934514ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:48.163519 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156c0bb-5224-4afe-a962-dd2934514ea0 admin admin] PATH_INFO: `/v3/projects/ed734412697e4f1fa3b48f398ae32536/users/5a4ca8310d6c4eb58f0c3c7f9027340f/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:48.165584 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156c0bb-5224-4afe-a962-dd2934514ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed734412697e4f1fa3b48f398ae32536, user_id=5a4ca8310d6c4eb58f0c3c7f9027340f, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:48.168293 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156c0bb-5224-4afe-a962-dd2934514ea0 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:48.179090 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1283/2555] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:33:48 2022] PUT /identity/v3/projects/ed734412697e4f1fa3b48f398ae32536/users/5a4ca8310d6c4eb58f0c3c7f9027340f/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:33:48.190762 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd7545-ba2e-4c74-9ba8-7c4d2fc927f4 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:48.190960 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd7545-ba2e-4c74-9ba8-7c4d2fc927f4 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:48.191241 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd7545-ba2e-4c74-9ba8-7c4d2fc927f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:48.217820 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-c3dd7545-ba2e-4c74-9ba8-7c4d2fc927f4 None None] MFA Rules not processed for user `5a4ca8310d6c4eb58f0c3c7f9027340f`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:33:48.218995 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c3dd7545-ba2e-4c74-9ba8-7c4d2fc927f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:48.285995 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1273/2556] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:33:48 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:33:48.295697 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156c0bb-5224-4afe-a962-dd2934514ea0 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:48.298169 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-f156c0bb-5224-4afe-a962-dd2934514ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:48.358784 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156c0bb-5224-4afe-a962-dd2934514ea0 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:48.363387 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d173762-287d-42f4-b155-6ed00e91347f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:48.364039 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d173762-287d-42f4-b155-6ed00e91347f service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:48.364320 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d173762-287d-42f4-b155-6ed00e91347f service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:48.364590 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d173762-287d-42f4-b155-6ed00e91347f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:48.375365 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d173762-287d-42f4-b155-6ed00e91347f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:48.376845 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d173762-287d-42f4-b155-6ed00e91347f service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:48.387445 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1284/2557] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:33:48 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:33:49.777272 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd7545-ba2e-4c74-9ba8-7c4d2fc927f4 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:49.846960 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd7545-ba2e-4c74-9ba8-7c4d2fc927f4 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:49.854748 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c352c1-c958-4c12-af1b-0d5152fcd388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:49.856038 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c352c1-c958-4c12-af1b-0d5152fcd388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:49.856372 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c352c1-c958-4c12-af1b-0d5152fcd388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:49.856772 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c352c1-c958-4c12-af1b-0d5152fcd388 admin admin] PATH_INFO: `/v3/users/bed24447f64a4dc69dcac5bdd3f1298f` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:49.858368 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c352c1-c958-4c12-af1b-0d5152fcd388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed24447f64a4dc69dcac5bdd3f1298f)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:49.860262 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c352c1-c958-4c12-af1b-0d5152fcd388 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:49.909345 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-68c352c1-c958-4c12-af1b-0d5152fcd388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed24447f64a4dc69dcac5bdd3f1298f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:49.916101 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-68c352c1-c958-4c12-af1b-0d5152fcd388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed24447f64a4dc69dcac5bdd3f1298f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:49.927801 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-68c352c1-c958-4c12-af1b-0d5152fcd388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed24447f64a4dc69dcac5bdd3f1298f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:49.928529 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-68c352c1-c958-4c12-af1b-0d5152fcd388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed24447f64a4dc69dcac5bdd3f1298f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:49.938145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-68c352c1-c958-4c12-af1b-0d5152fcd388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed24447f64a4dc69dcac5bdd3f1298f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:49.944376 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1274/2558] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:33:49 2022] DELETE /identity/v3/users/bed24447f64a4dc69dcac5bdd3f1298f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:33:49.949021 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d900a0-4621-415e-ad8e-4d06001ee6ad None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:49.949594 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d900a0-4621-415e-ad8e-4d06001ee6ad None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:49.949594 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d900a0-4621-415e-ad8e-4d06001ee6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:49.967018 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-92d900a0-4621-415e-ad8e-4d06001ee6ad None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:33:49.968165 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-92d900a0-4621-415e-ad8e-4d06001ee6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:50.027636 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1285/2559] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:33:50.037570 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c352c1-c958-4c12-af1b-0d5152fcd388 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:50.039009 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-68c352c1-c958-4c12-af1b-0d5152fcd388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:50.094173 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c352c1-c958-4c12-af1b-0d5152fcd388 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:50.097845 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f44721-008d-461e-b786-a0faf5baf3d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:50.098486 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f44721-008d-461e-b786-a0faf5baf3d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:50.098757 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f44721-008d-461e-b786-a0faf5baf3d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:50.099022 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f44721-008d-461e-b786-a0faf5baf3d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:50.107942 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f44721-008d-461e-b786-a0faf5baf3d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:50.109329 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f44721-008d-461e-b786-a0faf5baf3d8 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:50.119600 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1275/2560] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:33:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:33:50.392345 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d900a0-4621-415e-ad8e-4d06001ee6ad None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:50.393834 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-92d900a0-4621-415e-ad8e-4d06001ee6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:50.407819 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d900a0-4621-415e-ad8e-4d06001ee6ad None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:50.413076 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec864b-df9f-422d-9a34-4f849ac0524d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:50.414062 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec864b-df9f-422d-9a34-4f849ac0524d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:50.414338 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec864b-df9f-422d-9a34-4f849ac0524d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:50.414684 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec864b-df9f-422d-9a34-4f849ac0524d admin admin] PATH_INFO: `/v3/projects/c5f7cf925fc34c8fb52d5d971b9b0788` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:50.415823 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec864b-df9f-422d-9a34-4f849ac0524d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5f7cf925fc34c8fb52d5d971b9b0788)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:50.417726 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec864b-df9f-422d-9a34-4f849ac0524d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:50.464794 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-a5ec864b-df9f-422d-9a34-4f849ac0524d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5f7cf925fc34c8fb52d5d971b9b0788', 'request_id': 'req-a5ec864b-df9f-422d-9a34-4f849ac0524d'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:50.470412 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-a5ec864b-df9f-422d-9a34-4f849ac0524d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5f7cf925fc34c8fb52d5d971b9b0788', 'request_id': 'req-a5ec864b-df9f-422d-9a34-4f849ac0524d'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:50.477164 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-a5ec864b-df9f-422d-9a34-4f849ac0524d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5f7cf925fc34c8fb52d5d971b9b0788', 'request_id': 'req-a5ec864b-df9f-422d-9a34-4f849ac0524d'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:50.490220 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-a5ec864b-df9f-422d-9a34-4f849ac0524d admin admin] The token cache is being invalidate because project c5f7cf925fc34c8fb52d5d971b9b0788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:33:50.490499 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-a5ec864b-df9f-422d-9a34-4f849ac0524d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:50.491101 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-a5ec864b-df9f-422d-9a34-4f849ac0524d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:50.492617 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1286/2561] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:33:50 2022] DELETE /identity/v3/projects/c5f7cf925fc34c8fb52d5d971b9b0788 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:33:50.496583 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f44721-008d-461e-b786-a0faf5baf3d8 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:50.506474 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f44721-008d-461e-b786-a0faf5baf3d8 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:50.570855 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22be79-8b1b-4e90-883e-dde9b5d0824b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:50.572200 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22be79-8b1b-4e90-883e-dde9b5d0824b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:50.572432 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22be79-8b1b-4e90-883e-dde9b5d0824b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:50.572720 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22be79-8b1b-4e90-883e-dde9b5d0824b admin admin] PATH_INFO: `/v3/users/5a4ca8310d6c4eb58f0c3c7f9027340f` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:50.574773 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22be79-8b1b-4e90-883e-dde9b5d0824b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a4ca8310d6c4eb58f0c3c7f9027340f)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:50.576796 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22be79-8b1b-4e90-883e-dde9b5d0824b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:50.622322 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-de22be79-8b1b-4e90-883e-dde9b5d0824b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a4ca8310d6c4eb58f0c3c7f9027340f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:50.629388 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-de22be79-8b1b-4e90-883e-dde9b5d0824b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a4ca8310d6c4eb58f0c3c7f9027340f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:50.642197 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-de22be79-8b1b-4e90-883e-dde9b5d0824b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a4ca8310d6c4eb58f0c3c7f9027340f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:50.642960 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-de22be79-8b1b-4e90-883e-dde9b5d0824b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a4ca8310d6c4eb58f0c3c7f9027340f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:50.650548 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-de22be79-8b1b-4e90-883e-dde9b5d0824b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a4ca8310d6c4eb58f0c3c7f9027340f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:50.656424 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1276/2562] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:33:50 2022] DELETE /identity/v3/users/5a4ca8310d6c4eb58f0c3c7f9027340f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:33:50.938769 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec864b-df9f-422d-9a34-4f849ac0524d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:50.940391 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-a5ec864b-df9f-422d-9a34-4f849ac0524d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:50.959214 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec864b-df9f-422d-9a34-4f849ac0524d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:51.020039 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be78e2-bfa8-4318-9c86-d71964d8f8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:51.020838 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be78e2-bfa8-4318-9c86-d71964d8f8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:51.021114 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be78e2-bfa8-4318-9c86-d71964d8f8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:51.021396 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be78e2-bfa8-4318-9c86-d71964d8f8cc admin admin] PATH_INFO: `/v3/projects/ed734412697e4f1fa3b48f398ae32536` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:51.022618 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be78e2-bfa8-4318-9c86-d71964d8f8cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed734412697e4f1fa3b48f398ae32536)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:51.024535 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be78e2-bfa8-4318-9c86-d71964d8f8cc admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:51.072820 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f7be78e2-bfa8-4318-9c86-d71964d8f8cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed734412697e4f1fa3b48f398ae32536', 'request_id': 'req-f7be78e2-bfa8-4318-9c86-d71964d8f8cc'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:51.078485 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f7be78e2-bfa8-4318-9c86-d71964d8f8cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed734412697e4f1fa3b48f398ae32536', 'request_id': 'req-f7be78e2-bfa8-4318-9c86-d71964d8f8cc'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:51.084655 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f7be78e2-bfa8-4318-9c86-d71964d8f8cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed734412697e4f1fa3b48f398ae32536', 'request_id': 'req-f7be78e2-bfa8-4318-9c86-d71964d8f8cc'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:51.097574 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f7be78e2-bfa8-4318-9c86-d71964d8f8cc admin admin] The token cache is being invalidate because project ed734412697e4f1fa3b48f398ae32536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:33:51.097855 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f7be78e2-bfa8-4318-9c86-d71964d8f8cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:51.098467 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f7be78e2-bfa8-4318-9c86-d71964d8f8cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:33:51.100048 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1287/2563] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:33:50 2022] DELETE /identity/v3/projects/ed734412697e4f1fa3b48f398ae32536 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:33:51.105059 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8d6fc-5695-472f-87e4-51bc7fcb5acc None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:51.105618 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8d6fc-5695-472f-87e4-51bc7fcb5acc None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:51.105618 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8d6fc-5695-472f-87e4-51bc7fcb5acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:51.126364 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-aef8d6fc-5695-472f-87e4-51bc7fcb5acc None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:33:51.127576 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-aef8d6fc-5695-472f-87e4-51bc7fcb5acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:51.204492 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1277/2564] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 21:33:51.208682 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d45a9-19ef-4b7e-8ae7-420e646e8c53 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:51.208975 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d45a9-19ef-4b7e-8ae7-420e646e8c53 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:51.209460 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d45a9-19ef-4b7e-8ae7-420e646e8c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:51.228489 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-372d45a9-19ef-4b7e-8ae7-420e646e8c53 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:33:51.229947 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-372d45a9-19ef-4b7e-8ae7-420e646e8c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:51.238395 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1288/2565] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:33:51.242575 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8d6fc-5695-472f-87e4-51bc7fcb5acc None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:51.252447 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8d6fc-5695-472f-87e4-51bc7fcb5acc None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:51.257020 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb94dd-8308-4b6d-8c36-2912a4567c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:51.257774 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb94dd-8308-4b6d-8c36-2912a4567c3e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:51.258053 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb94dd-8308-4b6d-8c36-2912a4567c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:51.258326 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb94dd-8308-4b6d-8c36-2912a4567c3e admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:51.259056 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb94dd-8308-4b6d-8c36-2912a4567c3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:33:51.259358 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb94dd-8308-4b6d-8c36-2912a4567c3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:51.261614 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb94dd-8308-4b6d-8c36-2912a4567c3e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:51.275646 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1278/2566] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:33:51.279823 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d45a9-19ef-4b7e-8ae7-420e646e8c53 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:51.289185 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d45a9-19ef-4b7e-8ae7-420e646e8c53 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:51.295235 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeaf707-c68f-460e-a4a4-33cb11e5d080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:51.295876 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeaf707-c68f-460e-a4a4-33cb11e5d080 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:51.296153 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeaf707-c68f-460e-a4a4-33cb11e5d080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:51.296418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeaf707-c68f-460e-a4a4-33cb11e5d080 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:51.297106 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeaf707-c68f-460e-a4a4-33cb11e5d080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:51.299020 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeaf707-c68f-460e-a4a4-33cb11e5d080 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:51.326850 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1289/2567] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:33:51 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:33:51.332460 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb94dd-8308-4b6d-8c36-2912a4567c3e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:51.342479 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb94dd-8308-4b6d-8c36-2912a4567c3e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:51.398591 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfed409-a3ae-48b4-8080-e5fc3c5951df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:51.399259 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfed409-a3ae-48b4-8080-e5fc3c5951df admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:51.399534 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfed409-a3ae-48b4-8080-e5fc3c5951df admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:51.399801 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfed409-a3ae-48b4-8080-e5fc3c5951df admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:51.400491 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfed409-a3ae-48b4-8080-e5fc3c5951df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:51.402613 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfed409-a3ae-48b4-8080-e5fc3c5951df admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:51.423312 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1279/2568] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:33:51 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:33:51.427470 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeaf707-c68f-460e-a4a4-33cb11e5d080 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:51.438444 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeaf707-c68f-460e-a4a4-33cb11e5d080 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:51.443795 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc177b-f2c2-45f1-9dee-61ff3d4db093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:51.444449 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc177b-f2c2-45f1-9dee-61ff3d4db093 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:51.444722 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc177b-f2c2-45f1-9dee-61ff3d4db093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:51.444991 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc177b-f2c2-45f1-9dee-61ff3d4db093 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:51.445747 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc177b-f2c2-45f1-9dee-61ff3d4db093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:51.447337 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc177b-f2c2-45f1-9dee-61ff3d4db093 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:51.458929 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1290/2569] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:33:51.462797 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfed409-a3ae-48b4-8080-e5fc3c5951df admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:51.472893 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfed409-a3ae-48b4-8080-e5fc3c5951df admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:51.478509 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fef2c-0211-4b72-8bdd-595c43696df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:51.479155 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fef2c-0211-4b72-8bdd-595c43696df4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:51.479429 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fef2c-0211-4b72-8bdd-595c43696df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:51.479690 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fef2c-0211-4b72-8bdd-595c43696df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:51.480406 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fef2c-0211-4b72-8bdd-595c43696df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:51.482055 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fef2c-0211-4b72-8bdd-595c43696df4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:51.492102 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1280/2570] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:33:51.496339 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc177b-f2c2-45f1-9dee-61ff3d4db093 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:51.506476 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc177b-f2c2-45f1-9dee-61ff3d4db093 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:51.511886 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc695e08-8037-435e-9c3a-00b1c4d11b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:51.512757 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc695e08-8037-435e-9c3a-00b1c4d11b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:51.513032 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc695e08-8037-435e-9c3a-00b1c4d11b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:51.513301 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc695e08-8037-435e-9c3a-00b1c4d11b78 admin admin] PATH_INFO: `/v3/projects/ce7a0662698446a4b1f838b06330c568/users/ebd54b881ad54b0f967a0352266cafd5/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:51.529495 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc695e08-8037-435e-9c3a-00b1c4d11b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7a0662698446a4b1f838b06330c568, user_id=ebd54b881ad54b0f967a0352266cafd5, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:51.532150 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc695e08-8037-435e-9c3a-00b1c4d11b78 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:51.547970 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1291/2571] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:33:51 2022] PUT /identity/v3/projects/ce7a0662698446a4b1f838b06330c568/users/ebd54b881ad54b0f967a0352266cafd5/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:33:51.558835 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad00c49-ed62-4395-9a05-43705bc3840c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:51.559120 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad00c49-ed62-4395-9a05-43705bc3840c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:51.559394 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad00c49-ed62-4395-9a05-43705bc3840c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:51.587881 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-6ad00c49-ed62-4395-9a05-43705bc3840c None None] MFA Rules not processed for user `ebd54b881ad54b0f967a0352266cafd5`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:33:51.589061 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6ad00c49-ed62-4395-9a05-43705bc3840c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:51.653882 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1281/2572] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:33:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:33:51.658818 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc695e08-8037-435e-9c3a-00b1c4d11b78 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:51.721496 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc695e08-8037-435e-9c3a-00b1c4d11b78 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:51.727074 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70299a99-4161-42c5-9b45-90e39c02b166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:51.727718 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70299a99-4161-42c5-9b45-90e39c02b166 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:51.727993 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70299a99-4161-42c5-9b45-90e39c02b166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:51.728264 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70299a99-4161-42c5-9b45-90e39c02b166 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:51.728952 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70299a99-4161-42c5-9b45-90e39c02b166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:51.730846 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70299a99-4161-42c5-9b45-90e39c02b166 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:51.757870 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1292/2573] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:33:51 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 21:33:51.762170 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad00c49-ed62-4395-9a05-43705bc3840c None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:51.773386 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad00c49-ed62-4395-9a05-43705bc3840c None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:51.832441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59786fc5-e4d9-4c86-be9d-d77ff3369d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:51.833028 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59786fc5-e4d9-4c86-be9d-d77ff3369d1e admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:51.833306 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59786fc5-e4d9-4c86-be9d-d77ff3369d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:51.833595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59786fc5-e4d9-4c86-be9d-d77ff3369d1e admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:51.834284 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59786fc5-e4d9-4c86-be9d-d77ff3369d1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:51.836221 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59786fc5-e4d9-4c86-be9d-d77ff3369d1e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:51.857721 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1282/2574] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:33:51 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:33:51.861884 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70299a99-4161-42c5-9b45-90e39c02b166 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:51.871998 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70299a99-4161-42c5-9b45-90e39c02b166 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:51.877252 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec57e3-feec-4374-a9a0-a68232ab35af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:51.877929 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec57e3-feec-4374-a9a0-a68232ab35af admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:51.878202 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec57e3-feec-4374-a9a0-a68232ab35af admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:51.878443 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec57e3-feec-4374-a9a0-a68232ab35af admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:51.879199 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec57e3-feec-4374-a9a0-a68232ab35af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:51.880792 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec57e3-feec-4374-a9a0-a68232ab35af admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:51.891357 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1293/2575] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:33:51.896013 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59786fc5-e4d9-4c86-be9d-d77ff3369d1e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:51.911551 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59786fc5-e4d9-4c86-be9d-d77ff3369d1e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:51.918790 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1656bd9-6b72-4404-bb0b-946713b08556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:51.919659 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1656bd9-6b72-4404-bb0b-946713b08556 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:51.919972 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1656bd9-6b72-4404-bb0b-946713b08556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:51.920274 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1656bd9-6b72-4404-bb0b-946713b08556 admin admin] PATH_INFO: `/v3/projects/9d4d3380cca84c84ac14ac460e535926/users/38b1ec2cc8f04e60b53862c6f5e3805d/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:51.936526 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1656bd9-6b72-4404-bb0b-946713b08556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d4d3380cca84c84ac14ac460e535926, user_id=38b1ec2cc8f04e60b53862c6f5e3805d, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:51.939184 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1656bd9-6b72-4404-bb0b-946713b08556 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:51.955415 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1283/2576] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:33:51 2022] PUT /identity/v3/projects/9d4d3380cca84c84ac14ac460e535926/users/38b1ec2cc8f04e60b53862c6f5e3805d/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:33:51.959754 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec57e3-feec-4374-a9a0-a68232ab35af admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:51.971097 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec57e3-feec-4374-a9a0-a68232ab35af admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:52.031518 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47717f0f-5b0c-4114-93b6-145e3b4004e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:52.032173 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47717f0f-5b0c-4114-93b6-145e3b4004e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:52.032448 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47717f0f-5b0c-4114-93b6-145e3b4004e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:52.032718 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47717f0f-5b0c-4114-93b6-145e3b4004e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:52.033469 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47717f0f-5b0c-4114-93b6-145e3b4004e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:52.035059 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47717f0f-5b0c-4114-93b6-145e3b4004e7 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:52.047225 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1294/2577] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:33:52.051537 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1656bd9-6b72-4404-bb0b-946713b08556 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:52.062704 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1656bd9-6b72-4404-bb0b-946713b08556 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:52.067782 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec01d5-77b6-424e-b46b-999c092bad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:52.068649 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec01d5-77b6-424e-b46b-999c092bad63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:52.068947 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec01d5-77b6-424e-b46b-999c092bad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:52.069217 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec01d5-77b6-424e-b46b-999c092bad63 admin admin] PATH_INFO: `/v3/projects/9d4d3380cca84c84ac14ac460e535926/users/38b1ec2cc8f04e60b53862c6f5e3805d/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:52.071346 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec01d5-77b6-424e-b46b-999c092bad63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d4d3380cca84c84ac14ac460e535926, user_id=38b1ec2cc8f04e60b53862c6f5e3805d, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:52.073991 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec01d5-77b6-424e-b46b-999c092bad63 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:52.084485 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1284/2578] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:33:52 2022] PUT /identity/v3/projects/9d4d3380cca84c84ac14ac460e535926/users/38b1ec2cc8f04e60b53862c6f5e3805d/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:33:52.095715 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e97558-588b-4207-9f04-acb05fdf6aaf None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:52.096015 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e97558-588b-4207-9f04-acb05fdf6aaf None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:52.096290 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e97558-588b-4207-9f04-acb05fdf6aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:52.123690 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-e1e97558-588b-4207-9f04-acb05fdf6aaf None None] MFA Rules not processed for user `38b1ec2cc8f04e60b53862c6f5e3805d`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:33:52.124887 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-e1e97558-588b-4207-9f04-acb05fdf6aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:52.194302 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1295/2579] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:33:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:33:52.203950 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec01d5-77b6-424e-b46b-999c092bad63 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:52.205807 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-82ec01d5-77b6-424e-b46b-999c092bad63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:52.261747 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec01d5-77b6-424e-b46b-999c092bad63 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:52.265455 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381298a-ea2d-46d4-ab34-1ed90126b49e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:52.266096 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381298a-ea2d-46d4-ab34-1ed90126b49e service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:52.266374 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381298a-ea2d-46d4-ab34-1ed90126b49e service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:52.266667 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381298a-ea2d-46d4-ab34-1ed90126b49e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:52.323125 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381298a-ea2d-46d4-ab34-1ed90126b49e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:52.324554 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381298a-ea2d-46d4-ab34-1ed90126b49e service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:52.336166 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1285/2580] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:33:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:33:55.441651 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e97558-588b-4207-9f04-acb05fdf6aaf None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:55.443261 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-e1e97558-588b-4207-9f04-acb05fdf6aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:55.522146 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e97558-588b-4207-9f04-acb05fdf6aaf None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:55.528110 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b396f3-271c-490c-8ade-874801f961bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:55.528766 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b396f3-271c-490c-8ade-874801f961bb service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:55.529048 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b396f3-271c-490c-8ade-874801f961bb service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:55.529323 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b396f3-271c-490c-8ade-874801f961bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:55.531331 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-c7b396f3-271c-490c-8ade-874801f961bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:55.543942 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b396f3-271c-490c-8ade-874801f961bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:55.545567 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b396f3-271c-490c-8ade-874801f961bb service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:55.553414 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381298a-ea2d-46d4-ab34-1ed90126b49e service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:55.555114 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4381298a-ea2d-46d4-ab34-1ed90126b49e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:55.557443 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1296/2581] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:33:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:33:55.570652 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381298a-ea2d-46d4-ab34-1ed90126b49e service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:55.574990 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00c1a6-f3f7-4f66-af84-853f046025af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:55.575615 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00c1a6-f3f7-4f66-af84-853f046025af service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:55.575891 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00c1a6-f3f7-4f66-af84-853f046025af service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:55.576154 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00c1a6-f3f7-4f66-af84-853f046025af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:55.578132 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2c00c1a6-f3f7-4f66-af84-853f046025af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:55.645984 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00c1a6-f3f7-4f66-af84-853f046025af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:55.647425 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00c1a6-f3f7-4f66-af84-853f046025af service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:55.665500 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1286/2582] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:33:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:33:58.996287 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b396f3-271c-490c-8ade-874801f961bb service nova] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:59.006245 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b396f3-271c-490c-8ade-874801f961bb service nova] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:59.009956 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e597483-780f-4653-a54b-194a91093161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:59.010595 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e597483-780f-4653-a54b-194a91093161 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:59.010869 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e597483-780f-4653-a54b-194a91093161 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:59.011136 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e597483-780f-4653-a54b-194a91093161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:59.020261 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e597483-780f-4653-a54b-194a91093161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:59.021718 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e597483-780f-4653-a54b-194a91093161 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:59.031480 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1297/2583] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:33:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:33:59.685778 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00c1a6-f3f7-4f66-af84-853f046025af service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:33:59.687784 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2c00c1a6-f3f7-4f66-af84-853f046025af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:59.754408 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00c1a6-f3f7-4f66-af84-853f046025af service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:33:59.758326 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a456e6-3c9f-42cc-986d-5ad8c05c751d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:33:59.758953 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a456e6-3c9f-42cc-986d-5ad8c05c751d service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:33:59.759226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a456e6-3c9f-42cc-986d-5ad8c05c751d service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:33:59.759493 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a456e6-3c9f-42cc-986d-5ad8c05c751d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:33:59.761588 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-70a456e6-3c9f-42cc-986d-5ad8c05c751d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:33:59.831385 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a456e6-3c9f-42cc-986d-5ad8c05c751d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:33:59.833612 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a456e6-3c9f-42cc-986d-5ad8c05c751d service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:33:59.847105 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1287/2584] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:33:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:34:28.948308 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e597483-780f-4653-a54b-194a91093161 service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:29.030379 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e597483-780f-4653-a54b-194a91093161 service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:29.035094 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea68b44-d25d-446a-b247-da721044baaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:29.035955 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea68b44-d25d-446a-b247-da721044baaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:29.036232 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea68b44-d25d-446a-b247-da721044baaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:29.036494 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea68b44-d25d-446a-b247-da721044baaa admin admin] PATH_INFO: `/v3/users/ebd54b881ad54b0f967a0352266cafd5` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:29.037713 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea68b44-d25d-446a-b247-da721044baaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebd54b881ad54b0f967a0352266cafd5)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:29.039608 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea68b44-d25d-446a-b247-da721044baaa admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:29.089844 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0ea68b44-d25d-446a-b247-da721044baaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebd54b881ad54b0f967a0352266cafd5'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:29.096708 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0ea68b44-d25d-446a-b247-da721044baaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebd54b881ad54b0f967a0352266cafd5'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:29.108176 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0ea68b44-d25d-446a-b247-da721044baaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebd54b881ad54b0f967a0352266cafd5'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:29.108844 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0ea68b44-d25d-446a-b247-da721044baaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebd54b881ad54b0f967a0352266cafd5'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:29.109476 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0ea68b44-d25d-446a-b247-da721044baaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebd54b881ad54b0f967a0352266cafd5'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:29.123117 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1298/2585] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:34:28 2022] DELETE /identity/v3/users/ebd54b881ad54b0f967a0352266cafd5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:34:29.127954 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22842b-ab88-400d-8282-f7d607874f81 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:29.128490 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22842b-ab88-400d-8282-f7d607874f81 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:29.128490 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22842b-ab88-400d-8282-f7d607874f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:29.145266 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-2e22842b-ab88-400d-8282-f7d607874f81 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:34:29.146500 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2e22842b-ab88-400d-8282-f7d607874f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:29.209469 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1288/2586] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:34:29.224418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea68b44-d25d-446a-b247-da721044baaa admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:29.226116 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-0ea68b44-d25d-446a-b247-da721044baaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:29.313403 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea68b44-d25d-446a-b247-da721044baaa admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:29.318193 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43394746-6d6a-41bd-9a1e-e1771ee2a59c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:29.318839 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43394746-6d6a-41bd-9a1e-e1771ee2a59c service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:29.319114 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43394746-6d6a-41bd-9a1e-e1771ee2a59c service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:29.319384 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43394746-6d6a-41bd-9a1e-e1771ee2a59c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:29.329870 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43394746-6d6a-41bd-9a1e-e1771ee2a59c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:29.331305 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43394746-6d6a-41bd-9a1e-e1771ee2a59c service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:29.340649 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1299/2587] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:34:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:34:29.638013 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22842b-ab88-400d-8282-f7d607874f81 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:29.639747 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2e22842b-ab88-400d-8282-f7d607874f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:29.653505 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22842b-ab88-400d-8282-f7d607874f81 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:29.659598 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e111161-5da5-4f4a-bcdf-1ea421269db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:29.660471 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e111161-5da5-4f4a-bcdf-1ea421269db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:29.660746 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e111161-5da5-4f4a-bcdf-1ea421269db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:29.660992 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e111161-5da5-4f4a-bcdf-1ea421269db1 admin admin] PATH_INFO: `/v3/projects/ce7a0662698446a4b1f838b06330c568` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:29.662426 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e111161-5da5-4f4a-bcdf-1ea421269db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce7a0662698446a4b1f838b06330c568)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:29.664332 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e111161-5da5-4f4a-bcdf-1ea421269db1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:29.716717 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8e111161-5da5-4f4a-bcdf-1ea421269db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce7a0662698446a4b1f838b06330c568', 'request_id': 'req-8e111161-5da5-4f4a-bcdf-1ea421269db1'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:29.722658 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8e111161-5da5-4f4a-bcdf-1ea421269db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce7a0662698446a4b1f838b06330c568', 'request_id': 'req-8e111161-5da5-4f4a-bcdf-1ea421269db1'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:29.729066 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8e111161-5da5-4f4a-bcdf-1ea421269db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce7a0662698446a4b1f838b06330c568', 'request_id': 'req-8e111161-5da5-4f4a-bcdf-1ea421269db1'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:29.746565 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8e111161-5da5-4f4a-bcdf-1ea421269db1 admin admin] The token cache is being invalidate because project ce7a0662698446a4b1f838b06330c568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:34:29.746841 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8e111161-5da5-4f4a-bcdf-1ea421269db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:29.747573 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8e111161-5da5-4f4a-bcdf-1ea421269db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:29.749231 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1289/2588] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:34:29 2022] DELETE /identity/v3/projects/ce7a0662698446a4b1f838b06330c568 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:34:29.755153 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43394746-6d6a-41bd-9a1e-e1771ee2a59c service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:29.770542 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43394746-6d6a-41bd-9a1e-e1771ee2a59c service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:29.833304 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8b6fc-2e42-40cd-87a4-a78c02631944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:29.834194 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8b6fc-2e42-40cd-87a4-a78c02631944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:29.834488 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8b6fc-2e42-40cd-87a4-a78c02631944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:29.834752 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8b6fc-2e42-40cd-87a4-a78c02631944 admin admin] PATH_INFO: `/v3/users/38b1ec2cc8f04e60b53862c6f5e3805d` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:29.836143 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8b6fc-2e42-40cd-87a4-a78c02631944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38b1ec2cc8f04e60b53862c6f5e3805d)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:29.838253 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8b6fc-2e42-40cd-87a4-a78c02631944 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:29.897438 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-9ce8b6fc-2e42-40cd-87a4-a78c02631944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38b1ec2cc8f04e60b53862c6f5e3805d'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:29.906902 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-9ce8b6fc-2e42-40cd-87a4-a78c02631944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38b1ec2cc8f04e60b53862c6f5e3805d'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:29.923257 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-9ce8b6fc-2e42-40cd-87a4-a78c02631944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38b1ec2cc8f04e60b53862c6f5e3805d'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:29.924351 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-9ce8b6fc-2e42-40cd-87a4-a78c02631944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38b1ec2cc8f04e60b53862c6f5e3805d'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:29.925196 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-9ce8b6fc-2e42-40cd-87a4-a78c02631944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38b1ec2cc8f04e60b53862c6f5e3805d'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:29.940767 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1300/2589] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:34:29 2022] DELETE /identity/v3/users/38b1ec2cc8f04e60b53862c6f5e3805d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:34:30.229315 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e111161-5da5-4f4a-bcdf-1ea421269db1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:30.231489 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8e111161-5da5-4f4a-bcdf-1ea421269db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:30.246530 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e111161-5da5-4f4a-bcdf-1ea421269db1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:30.310562 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75103531-b5f3-4a7b-b1aa-58192a282fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:30.311531 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75103531-b5f3-4a7b-b1aa-58192a282fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:30.311793 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75103531-b5f3-4a7b-b1aa-58192a282fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:30.312056 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75103531-b5f3-4a7b-b1aa-58192a282fba admin admin] PATH_INFO: `/v3/projects/9d4d3380cca84c84ac14ac460e535926` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:30.313287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75103531-b5f3-4a7b-b1aa-58192a282fba admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d4d3380cca84c84ac14ac460e535926)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:30.316357 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75103531-b5f3-4a7b-b1aa-58192a282fba admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:30.375122 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-75103531-b5f3-4a7b-b1aa-58192a282fba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d4d3380cca84c84ac14ac460e535926', 'request_id': 'req-75103531-b5f3-4a7b-b1aa-58192a282fba'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:30.380424 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-75103531-b5f3-4a7b-b1aa-58192a282fba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d4d3380cca84c84ac14ac460e535926', 'request_id': 'req-75103531-b5f3-4a7b-b1aa-58192a282fba'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:30.386567 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-75103531-b5f3-4a7b-b1aa-58192a282fba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d4d3380cca84c84ac14ac460e535926', 'request_id': 'req-75103531-b5f3-4a7b-b1aa-58192a282fba'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:30.400623 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-75103531-b5f3-4a7b-b1aa-58192a282fba admin admin] The token cache is being invalidate because project 9d4d3380cca84c84ac14ac460e535926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:34:30.400905 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-75103531-b5f3-4a7b-b1aa-58192a282fba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:30.401588 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-75103531-b5f3-4a7b-b1aa-58192a282fba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:30.403495 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1290/2590] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:34:30 2022] DELETE /identity/v3/projects/9d4d3380cca84c84ac14ac460e535926 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:34:30.409134 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db11bbf-21f6-4c7a-b31d-2e786e33fcd2 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:30.409669 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db11bbf-21f6-4c7a-b31d-2e786e33fcd2 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:30.409804 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db11bbf-21f6-4c7a-b31d-2e786e33fcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:30.427513 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-0db11bbf-21f6-4c7a-b31d-2e786e33fcd2 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:34:30.428750 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-0db11bbf-21f6-4c7a-b31d-2e786e33fcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:30.499393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1301/2591] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:34:30.508294 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2f022-de49-4097-b416-59fc19d46d13 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:30.508579 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2f022-de49-4097-b416-59fc19d46d13 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:30.508849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2f022-de49-4097-b416-59fc19d46d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:30.527641 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-b7d2f022-de49-4097-b416-59fc19d46d13 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:34:30.528858 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b7d2f022-de49-4097-b416-59fc19d46d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:30.537579 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1291/2592] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 21:34:30.542035 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db11bbf-21f6-4c7a-b31d-2e786e33fcd2 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:30.551931 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db11bbf-21f6-4c7a-b31d-2e786e33fcd2 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:30.557539 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136aeb5-daf7-45ee-b705-ebd92641ee36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:30.558204 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136aeb5-daf7-45ee-b705-ebd92641ee36 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:30.558479 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136aeb5-daf7-45ee-b705-ebd92641ee36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:30.558741 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136aeb5-daf7-45ee-b705-ebd92641ee36 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:30.559471 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136aeb5-daf7-45ee-b705-ebd92641ee36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:34:30.559765 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136aeb5-daf7-45ee-b705-ebd92641ee36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:30.561420 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136aeb5-daf7-45ee-b705-ebd92641ee36 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:30.573193 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1302/2593] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 21:34:30.577637 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2f022-de49-4097-b416-59fc19d46d13 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:30.586937 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2f022-de49-4097-b416-59fc19d46d13 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:30.592442 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d37a4-dc1a-4a04-b6cf-5321cb683444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:30.593070 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d37a4-dc1a-4a04-b6cf-5321cb683444 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:30.593512 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d37a4-dc1a-4a04-b6cf-5321cb683444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:30.593772 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d37a4-dc1a-4a04-b6cf-5321cb683444 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:30.594625 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d37a4-dc1a-4a04-b6cf-5321cb683444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:30.596769 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d37a4-dc1a-4a04-b6cf-5321cb683444 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:30.622654 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1292/2594] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:34:30 2022] POST /identity/v3/projects => generated 407 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:34:30.626760 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136aeb5-daf7-45ee-b705-ebd92641ee36 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:30.637010 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136aeb5-daf7-45ee-b705-ebd92641ee36 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:30.695262 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b173f7-c978-4005-8070-28406fd67911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:30.695928 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b173f7-c978-4005-8070-28406fd67911 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:30.696212 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b173f7-c978-4005-8070-28406fd67911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:30.696491 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b173f7-c978-4005-8070-28406fd67911 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:30.697190 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b173f7-c978-4005-8070-28406fd67911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:30.699198 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b173f7-c978-4005-8070-28406fd67911 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:30.720681 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1303/2595] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:34:30 2022] POST /identity/v3/users => generated 304 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 21:34:30.724992 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d37a4-dc1a-4a04-b6cf-5321cb683444 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:30.737416 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d37a4-dc1a-4a04-b6cf-5321cb683444 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:30.743862 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295ac07-1fd8-41ee-a6e4-791d2b46d1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:30.744583 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295ac07-1fd8-41ee-a6e4-791d2b46d1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:30.744843 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295ac07-1fd8-41ee-a6e4-791d2b46d1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:30.745103 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295ac07-1fd8-41ee-a6e4-791d2b46d1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:30.745880 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295ac07-1fd8-41ee-a6e4-791d2b46d1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:30.747527 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295ac07-1fd8-41ee-a6e4-791d2b46d1e2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:30.758018 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1293/2596] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:34:30.761929 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b173f7-c978-4005-8070-28406fd67911 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:30.772288 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b173f7-c978-4005-8070-28406fd67911 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:30.782120 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f348d-f5da-4036-9715-13704e91ff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:30.782775 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f348d-f5da-4036-9715-13704e91ff24 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:30.783053 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f348d-f5da-4036-9715-13704e91ff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:30.783321 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f348d-f5da-4036-9715-13704e91ff24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:30.784041 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f348d-f5da-4036-9715-13704e91ff24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:30.785658 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f348d-f5da-4036-9715-13704e91ff24 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:30.795708 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1304/2597] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:34:30.799943 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295ac07-1fd8-41ee-a6e4-791d2b46d1e2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:30.811236 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295ac07-1fd8-41ee-a6e4-791d2b46d1e2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:30.816700 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f9d21-1be6-4f35-aedf-6e7f9003757e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:30.817535 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f9d21-1be6-4f35-aedf-6e7f9003757e admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:30.817814 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f9d21-1be6-4f35-aedf-6e7f9003757e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:30.818078 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f9d21-1be6-4f35-aedf-6e7f9003757e admin admin] PATH_INFO: `/v3/projects/3d57f2c1a42b4ec89137e2600960343a/users/75e8fed0b304404c831026e1456861a0/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:30.833980 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f9d21-1be6-4f35-aedf-6e7f9003757e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d57f2c1a42b4ec89137e2600960343a, user_id=75e8fed0b304404c831026e1456861a0, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:30.836606 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f9d21-1be6-4f35-aedf-6e7f9003757e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:30.852391 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1294/2598] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:34:30 2022] PUT /identity/v3/projects/3d57f2c1a42b4ec89137e2600960343a/users/75e8fed0b304404c831026e1456861a0/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:34:30.864762 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d90406-dc9b-4a85-89b6-9bdc589576a9 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:30.865035 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d90406-dc9b-4a85-89b6-9bdc589576a9 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:30.865431 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d90406-dc9b-4a85-89b6-9bdc589576a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:30.893383 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-f6d90406-dc9b-4a85-89b6-9bdc589576a9 None None] MFA Rules not processed for user `75e8fed0b304404c831026e1456861a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:34:30.894560 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-f6d90406-dc9b-4a85-89b6-9bdc589576a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:30.968001 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1305/2599] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:34:30 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:34:30.972638 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f9d21-1be6-4f35-aedf-6e7f9003757e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:31.033197 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f9d21-1be6-4f35-aedf-6e7f9003757e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:31.038868 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba2b44-2f29-45cf-ab6f-d9bc042cda62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:31.039505 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba2b44-2f29-45cf-ab6f-d9bc042cda62 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:31.039776 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba2b44-2f29-45cf-ab6f-d9bc042cda62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:31.040042 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba2b44-2f29-45cf-ab6f-d9bc042cda62 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:31.040738 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba2b44-2f29-45cf-ab6f-d9bc042cda62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:31.044815 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba2b44-2f29-45cf-ab6f-d9bc042cda62 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:31.074049 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1295/2600] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:34:30 2022] POST /identity/v3/projects => generated 409 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:34:31.078259 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d90406-dc9b-4a85-89b6-9bdc589576a9 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:31.089487 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d90406-dc9b-4a85-89b6-9bdc589576a9 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:31.143378 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234018e3-8d41-4c84-961b-5bfe14e65b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:31.144044 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234018e3-8d41-4c84-961b-5bfe14e65b10 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:31.144330 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234018e3-8d41-4c84-961b-5bfe14e65b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:31.144597 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234018e3-8d41-4c84-961b-5bfe14e65b10 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:31.145288 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234018e3-8d41-4c84-961b-5bfe14e65b10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:31.147205 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234018e3-8d41-4c84-961b-5bfe14e65b10 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:31.169922 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1306/2601] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:34:31 2022] POST /identity/v3/users => generated 311 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:34:31.174752 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba2b44-2f29-45cf-ab6f-d9bc042cda62 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:31.190885 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba2b44-2f29-45cf-ab6f-d9bc042cda62 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:31.198797 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11f442-fa5b-4412-88e1-1351230fa840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:31.199446 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11f442-fa5b-4412-88e1-1351230fa840 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:31.199724 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11f442-fa5b-4412-88e1-1351230fa840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:31.199996 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11f442-fa5b-4412-88e1-1351230fa840 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:31.200719 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11f442-fa5b-4412-88e1-1351230fa840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:31.202333 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11f442-fa5b-4412-88e1-1351230fa840 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:31.213186 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1296/2602] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:34:31.217536 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234018e3-8d41-4c84-961b-5bfe14e65b10 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:31.227632 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234018e3-8d41-4c84-961b-5bfe14e65b10 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:31.233079 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede91d6-d0b7-454a-86b8-ef95d01db7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:31.233990 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede91d6-d0b7-454a-86b8-ef95d01db7e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:31.234265 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede91d6-d0b7-454a-86b8-ef95d01db7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:31.234536 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede91d6-d0b7-454a-86b8-ef95d01db7e5 admin admin] PATH_INFO: `/v3/projects/3943b0254bac460187f8ef209c7efde5/users/6d87079b76fc4ce9b14b7b4bd4fb4a68/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:31.248953 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede91d6-d0b7-454a-86b8-ef95d01db7e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3943b0254bac460187f8ef209c7efde5, user_id=6d87079b76fc4ce9b14b7b4bd4fb4a68, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:31.251576 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede91d6-d0b7-454a-86b8-ef95d01db7e5 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:31.266386 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1307/2603] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:34:31 2022] PUT /identity/v3/projects/3943b0254bac460187f8ef209c7efde5/users/6d87079b76fc4ce9b14b7b4bd4fb4a68/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:34:31.270689 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11f442-fa5b-4412-88e1-1351230fa840 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:31.282478 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11f442-fa5b-4412-88e1-1351230fa840 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:31.355999 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7718308-c380-4e21-8b5d-b7fcc652e9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:31.356825 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7718308-c380-4e21-8b5d-b7fcc652e9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:31.357192 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7718308-c380-4e21-8b5d-b7fcc652e9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:31.357536 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7718308-c380-4e21-8b5d-b7fcc652e9c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:31.358619 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7718308-c380-4e21-8b5d-b7fcc652e9c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:31.361102 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7718308-c380-4e21-8b5d-b7fcc652e9c4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:31.374166 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1297/2604] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:34:31.378620 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede91d6-d0b7-454a-86b8-ef95d01db7e5 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:31.389524 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede91d6-d0b7-454a-86b8-ef95d01db7e5 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:31.395413 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0f044-2b01-4545-b91a-035b241f65eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:31.396285 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0f044-2b01-4545-b91a-035b241f65eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:31.396556 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0f044-2b01-4545-b91a-035b241f65eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:31.396827 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0f044-2b01-4545-b91a-035b241f65eb admin admin] PATH_INFO: `/v3/projects/3943b0254bac460187f8ef209c7efde5/users/6d87079b76fc4ce9b14b7b4bd4fb4a68/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:31.399085 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0f044-2b01-4545-b91a-035b241f65eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3943b0254bac460187f8ef209c7efde5, user_id=6d87079b76fc4ce9b14b7b4bd4fb4a68, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:31.401852 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0f044-2b01-4545-b91a-035b241f65eb admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:31.412945 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1308/2605] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:34:31 2022] PUT /identity/v3/projects/3943b0254bac460187f8ef209c7efde5/users/6d87079b76fc4ce9b14b7b4bd4fb4a68/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:34:31.424069 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafaadc-19d8-4f2f-8e96-f7b0d60fd2e5 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:31.424393 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafaadc-19d8-4f2f-8e96-f7b0d60fd2e5 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:31.424662 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafaadc-19d8-4f2f-8e96-f7b0d60fd2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:31.456812 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-6aafaadc-19d8-4f2f-8e96-f7b0d60fd2e5 None None] MFA Rules not processed for user `6d87079b76fc4ce9b14b7b4bd4fb4a68`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:34:31.458044 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6aafaadc-19d8-4f2f-8e96-f7b0d60fd2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:31.530417 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1298/2606] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:34:31 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:34:31.540283 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0f044-2b01-4545-b91a-035b241f65eb admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:31.542140 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-95e0f044-2b01-4545-b91a-035b241f65eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:31.601548 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0f044-2b01-4545-b91a-035b241f65eb admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:31.606210 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202b447-eb76-4700-a6be-ebf5900a0952 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:31.606778 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202b447-eb76-4700-a6be-ebf5900a0952 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:31.607058 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202b447-eb76-4700-a6be-ebf5900a0952 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:31.607325 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202b447-eb76-4700-a6be-ebf5900a0952 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:31.616780 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202b447-eb76-4700-a6be-ebf5900a0952 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:31.618264 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202b447-eb76-4700-a6be-ebf5900a0952 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:31.627709 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1309/2607] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:34:31 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:34:31.785901 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafaadc-19d8-4f2f-8e96-f7b0d60fd2e5 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:31.814329 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafaadc-19d8-4f2f-8e96-f7b0d60fd2e5 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:31.821103 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d6b05-88bc-46a6-96bf-b21cd88f36b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:31.822075 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d6b05-88bc-46a6-96bf-b21cd88f36b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:31.822461 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d6b05-88bc-46a6-96bf-b21cd88f36b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:31.822733 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d6b05-88bc-46a6-96bf-b21cd88f36b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:31.887315 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d6b05-88bc-46a6-96bf-b21cd88f36b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:31.888678 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d6b05-88bc-46a6-96bf-b21cd88f36b2 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:31.897942 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1299/2608] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:34:31 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:34:41.256060 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202b447-eb76-4700-a6be-ebf5900a0952 service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:41.320712 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202b447-eb76-4700-a6be-ebf5900a0952 service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:41.326643 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7db95-d475-4636-b21e-4e53c78338f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:41.327558 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7db95-d475-4636-b21e-4e53c78338f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:41.327768 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7db95-d475-4636-b21e-4e53c78338f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:41.328039 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7db95-d475-4636-b21e-4e53c78338f7 admin admin] PATH_INFO: `/v3/users/75e8fed0b304404c831026e1456861a0` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:41.329494 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7db95-d475-4636-b21e-4e53c78338f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75e8fed0b304404c831026e1456861a0)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:41.331418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7db95-d475-4636-b21e-4e53c78338f7 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:41.376557 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-8dc7db95-d475-4636-b21e-4e53c78338f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75e8fed0b304404c831026e1456861a0'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:41.382927 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-8dc7db95-d475-4636-b21e-4e53c78338f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75e8fed0b304404c831026e1456861a0'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:41.393828 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-8dc7db95-d475-4636-b21e-4e53c78338f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75e8fed0b304404c831026e1456861a0'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:41.394514 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-8dc7db95-d475-4636-b21e-4e53c78338f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75e8fed0b304404c831026e1456861a0'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:41.395121 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-8dc7db95-d475-4636-b21e-4e53c78338f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75e8fed0b304404c831026e1456861a0'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:41.410869 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1310/2609] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:34:41 2022] DELETE /identity/v3/users/75e8fed0b304404c831026e1456861a0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:34:41.415631 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5be67-9b2f-4dd3-a0f9-dd974c151841 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:41.416174 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5be67-9b2f-4dd3-a0f9-dd974c151841 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:41.416174 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5be67-9b2f-4dd3-a0f9-dd974c151841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:41.445122 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7fc5be67-9b2f-4dd3-a0f9-dd974c151841 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:34:41.446341 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7fc5be67-9b2f-4dd3-a0f9-dd974c151841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:41.504927 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1300/2610] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 21:34:41.515153 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7db95-d475-4636-b21e-4e53c78338f7 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:41.516681 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-8dc7db95-d475-4636-b21e-4e53c78338f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:41.576648 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7db95-d475-4636-b21e-4e53c78338f7 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:41.581106 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3898b-ae93-46fc-8065-5be543427009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:41.581790 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3898b-ae93-46fc-8065-5be543427009 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:41.582068 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3898b-ae93-46fc-8065-5be543427009 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:41.582340 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3898b-ae93-46fc-8065-5be543427009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:41.594336 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3898b-ae93-46fc-8065-5be543427009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:41.596667 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3898b-ae93-46fc-8065-5be543427009 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:41.609993 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1311/2611] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:34:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:34:41.868012 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5be67-9b2f-4dd3-a0f9-dd974c151841 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:41.869580 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7fc5be67-9b2f-4dd3-a0f9-dd974c151841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:41.881964 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5be67-9b2f-4dd3-a0f9-dd974c151841 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:41.886939 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedd530-8e11-4781-8757-25c6b8331a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:41.887806 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedd530-8e11-4781-8757-25c6b8331a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:41.888089 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedd530-8e11-4781-8757-25c6b8331a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:41.888361 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedd530-8e11-4781-8757-25c6b8331a8d admin admin] PATH_INFO: `/v3/projects/3d57f2c1a42b4ec89137e2600960343a` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:41.889676 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedd530-8e11-4781-8757-25c6b8331a8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d57f2c1a42b4ec89137e2600960343a)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:41.891670 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedd530-8e11-4781-8757-25c6b8331a8d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:41.916582 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3898b-ae93-46fc-8065-5be543427009 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:41.926136 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3898b-ae93-46fc-8065-5be543427009 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:41.930468 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f26fd8-5e91-4351-bb38-1d57e495990a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:41.931232 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f26fd8-5e91-4351-bb38-1d57e495990a service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:41.931445 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f26fd8-5e91-4351-bb38-1d57e495990a service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:41.931660 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f26fd8-5e91-4351-bb38-1d57e495990a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:41.933601 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d5f26fd8-5e91-4351-bb38-1d57e495990a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:41.943235 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f26fd8-5e91-4351-bb38-1d57e495990a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:41.944465 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ccedd530-8e11-4781-8757-25c6b8331a8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d57f2c1a42b4ec89137e2600960343a', 'request_id': 'req-ccedd530-8e11-4781-8757-25c6b8331a8d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:41.944651 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f26fd8-5e91-4351-bb38-1d57e495990a service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:41.950503 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ccedd530-8e11-4781-8757-25c6b8331a8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d57f2c1a42b4ec89137e2600960343a', 'request_id': 'req-ccedd530-8e11-4781-8757-25c6b8331a8d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:41.952784 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1312/2612] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:34:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:34:41.957135 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ccedd530-8e11-4781-8757-25c6b8331a8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d57f2c1a42b4ec89137e2600960343a', 'request_id': 'req-ccedd530-8e11-4781-8757-25c6b8331a8d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:41.971534 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ccedd530-8e11-4781-8757-25c6b8331a8d admin admin] The token cache is being invalidate because project 3d57f2c1a42b4ec89137e2600960343a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:34:41.971893 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ccedd530-8e11-4781-8757-25c6b8331a8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:41.972450 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ccedd530-8e11-4781-8757-25c6b8331a8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:41.974038 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1301/2613] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:34:41 2022] DELETE /identity/v3/projects/3d57f2c1a42b4ec89137e2600960343a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:34:41.978143 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f26fd8-5e91-4351-bb38-1d57e495990a service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:41.989377 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f26fd8-5e91-4351-bb38-1d57e495990a service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:42.053735 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63e137-c50e-4108-9277-4f9c6fe7fd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:42.054629 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63e137-c50e-4108-9277-4f9c6fe7fd3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:42.055299 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63e137-c50e-4108-9277-4f9c6fe7fd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:42.055571 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63e137-c50e-4108-9277-4f9c6fe7fd3d admin admin] PATH_INFO: `/v3/users/6d87079b76fc4ce9b14b7b4bd4fb4a68` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:42.056754 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63e137-c50e-4108-9277-4f9c6fe7fd3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d87079b76fc4ce9b14b7b4bd4fb4a68)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:42.058855 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63e137-c50e-4108-9277-4f9c6fe7fd3d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:42.106585 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-5d63e137-c50e-4108-9277-4f9c6fe7fd3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d87079b76fc4ce9b14b7b4bd4fb4a68'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:42.113154 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-5d63e137-c50e-4108-9277-4f9c6fe7fd3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d87079b76fc4ce9b14b7b4bd4fb4a68'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:42.124604 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-5d63e137-c50e-4108-9277-4f9c6fe7fd3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d87079b76fc4ce9b14b7b4bd4fb4a68'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:42.125424 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-5d63e137-c50e-4108-9277-4f9c6fe7fd3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d87079b76fc4ce9b14b7b4bd4fb4a68'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:42.126035 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-5d63e137-c50e-4108-9277-4f9c6fe7fd3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d87079b76fc4ce9b14b7b4bd4fb4a68'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:42.139308 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1313/2614] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:34:41 2022] DELETE /identity/v3/users/6d87079b76fc4ce9b14b7b4bd4fb4a68 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:34:42.397718 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedd530-8e11-4781-8757-25c6b8331a8d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:42.399357 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ccedd530-8e11-4781-8757-25c6b8331a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:42.413704 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedd530-8e11-4781-8757-25c6b8331a8d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:42.477510 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc706c9-26fe-466a-82d5-517cd0df84c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:42.478399 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc706c9-26fe-466a-82d5-517cd0df84c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:42.478660 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc706c9-26fe-466a-82d5-517cd0df84c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:42.478927 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc706c9-26fe-466a-82d5-517cd0df84c7 admin admin] PATH_INFO: `/v3/projects/3943b0254bac460187f8ef209c7efde5` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:42.480349 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc706c9-26fe-466a-82d5-517cd0df84c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3943b0254bac460187f8ef209c7efde5)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:42.482369 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc706c9-26fe-466a-82d5-517cd0df84c7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:42.531210 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4bc706c9-26fe-466a-82d5-517cd0df84c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3943b0254bac460187f8ef209c7efde5', 'request_id': 'req-4bc706c9-26fe-466a-82d5-517cd0df84c7'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:42.536422 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4bc706c9-26fe-466a-82d5-517cd0df84c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3943b0254bac460187f8ef209c7efde5', 'request_id': 'req-4bc706c9-26fe-466a-82d5-517cd0df84c7'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:42.542468 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4bc706c9-26fe-466a-82d5-517cd0df84c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3943b0254bac460187f8ef209c7efde5', 'request_id': 'req-4bc706c9-26fe-466a-82d5-517cd0df84c7'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:42.557581 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4bc706c9-26fe-466a-82d5-517cd0df84c7 admin admin] The token cache is being invalidate because project 3943b0254bac460187f8ef209c7efde5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:34:42.557856 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4bc706c9-26fe-466a-82d5-517cd0df84c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:42.558555 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4bc706c9-26fe-466a-82d5-517cd0df84c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:42.560131 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1302/2615] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:34:42 2022] DELETE /identity/v3/projects/3943b0254bac460187f8ef209c7efde5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:34:42.564967 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd0bdd-fdcb-4059-a3fb-db1fb05a5e8b None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:42.565441 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd0bdd-fdcb-4059-a3fb-db1fb05a5e8b None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:42.565563 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd0bdd-fdcb-4059-a3fb-db1fb05a5e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:42.582750 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-12cd0bdd-fdcb-4059-a3fb-db1fb05a5e8b None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:34:42.583938 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-12cd0bdd-fdcb-4059-a3fb-db1fb05a5e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:42.644346 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1314/2616] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:34:42.652578 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a62aae-4d51-4205-863a-34bda4ce4b78 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:42.653015 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a62aae-4d51-4205-863a-34bda4ce4b78 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:42.653383 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a62aae-4d51-4205-863a-34bda4ce4b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:42.672981 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-d8a62aae-4d51-4205-863a-34bda4ce4b78 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:34:42.674190 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d8a62aae-4d51-4205-863a-34bda4ce4b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:42.684226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1303/2617] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:34:42.688481 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd0bdd-fdcb-4059-a3fb-db1fb05a5e8b None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:42.698384 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd0bdd-fdcb-4059-a3fb-db1fb05a5e8b None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:42.703422 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e181f8-f919-46ac-8a0d-2a25b438b14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:42.704100 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e181f8-f919-46ac-8a0d-2a25b438b14d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:42.704377 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e181f8-f919-46ac-8a0d-2a25b438b14d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:42.704647 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e181f8-f919-46ac-8a0d-2a25b438b14d admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:42.705387 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e181f8-f919-46ac-8a0d-2a25b438b14d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:34:42.705716 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e181f8-f919-46ac-8a0d-2a25b438b14d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:42.707331 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e181f8-f919-46ac-8a0d-2a25b438b14d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:42.719359 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1315/2618] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:34:42.725058 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a62aae-4d51-4205-863a-34bda4ce4b78 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:42.736135 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a62aae-4d51-4205-863a-34bda4ce4b78 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:42.741736 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566057f6-6740-40f8-8fea-867dd3b4f638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:42.742441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566057f6-6740-40f8-8fea-867dd3b4f638 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:42.742718 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566057f6-6740-40f8-8fea-867dd3b4f638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:42.742979 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566057f6-6740-40f8-8fea-867dd3b4f638 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:42.743672 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566057f6-6740-40f8-8fea-867dd3b4f638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:42.745629 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566057f6-6740-40f8-8fea-867dd3b4f638 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:42.777208 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1304/2619] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:34:42 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:34:42.783898 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e181f8-f919-46ac-8a0d-2a25b438b14d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:42.799565 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e181f8-f919-46ac-8a0d-2a25b438b14d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:42.865619 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71db41-a5b3-4f96-931b-13f6bbd92c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:42.866280 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71db41-a5b3-4f96-931b-13f6bbd92c93 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:42.866554 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71db41-a5b3-4f96-931b-13f6bbd92c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:42.866816 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71db41-a5b3-4f96-931b-13f6bbd92c93 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:42.867502 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71db41-a5b3-4f96-931b-13f6bbd92c93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:42.869411 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71db41-a5b3-4f96-931b-13f6bbd92c93 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:42.891999 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1316/2620] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:34:42 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:34:42.896356 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566057f6-6740-40f8-8fea-867dd3b4f638 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:42.907034 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566057f6-6740-40f8-8fea-867dd3b4f638 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:42.912350 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5448451-fdc8-4404-9880-312182347d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:42.913001 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5448451-fdc8-4404-9880-312182347d34 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:42.913284 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5448451-fdc8-4404-9880-312182347d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:42.913586 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5448451-fdc8-4404-9880-312182347d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:42.914324 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5448451-fdc8-4404-9880-312182347d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:42.915949 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5448451-fdc8-4404-9880-312182347d34 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:42.926372 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1305/2621] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:34:42.930645 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71db41-a5b3-4f96-931b-13f6bbd92c93 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:42.940816 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71db41-a5b3-4f96-931b-13f6bbd92c93 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:42.945698 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce1d53-11a5-4892-95de-578cf99c74e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:42.946350 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce1d53-11a5-4892-95de-578cf99c74e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:42.946627 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce1d53-11a5-4892-95de-578cf99c74e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:42.946900 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce1d53-11a5-4892-95de-578cf99c74e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:42.947634 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce1d53-11a5-4892-95de-578cf99c74e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:42.949305 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce1d53-11a5-4892-95de-578cf99c74e4 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:42.959165 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1317/2622] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:34:42.963103 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5448451-fdc8-4404-9880-312182347d34 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:42.972892 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5448451-fdc8-4404-9880-312182347d34 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:42.977860 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c888875-496e-4867-84e9-4b4be9b52a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:42.978727 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c888875-496e-4867-84e9-4b4be9b52a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:42.979010 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c888875-496e-4867-84e9-4b4be9b52a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:42.979281 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c888875-496e-4867-84e9-4b4be9b52a2a admin admin] PATH_INFO: `/v3/projects/1b1bfb052b8049fb8663bef5855b20f6/users/0118f13a2b314b7a946f57aabcd25d40/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:42.995440 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c888875-496e-4867-84e9-4b4be9b52a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b1bfb052b8049fb8663bef5855b20f6, user_id=0118f13a2b314b7a946f57aabcd25d40, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:42.998183 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c888875-496e-4867-84e9-4b4be9b52a2a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:43.014214 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1306/2623] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:34:42 2022] PUT /identity/v3/projects/1b1bfb052b8049fb8663bef5855b20f6/users/0118f13a2b314b7a946f57aabcd25d40/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:34:43.030570 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e6312-5f82-49fa-9f55-ba6c8c3d269e None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:43.030875 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e6312-5f82-49fa-9f55-ba6c8c3d269e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:43.031175 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e6312-5f82-49fa-9f55-ba6c8c3d269e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:43.062421 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-386e6312-5f82-49fa-9f55-ba6c8c3d269e None None] MFA Rules not processed for user `0118f13a2b314b7a946f57aabcd25d40`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:34:43.063603 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-386e6312-5f82-49fa-9f55-ba6c8c3d269e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:43.126406 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1318/2624] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:34:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:34:43.136335 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c888875-496e-4867-84e9-4b4be9b52a2a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:43.138447 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4c888875-496e-4867-84e9-4b4be9b52a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:43.208682 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c888875-496e-4867-84e9-4b4be9b52a2a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:43.213018 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64539af8-90b1-418b-87d6-32085f31d137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:43.213687 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64539af8-90b1-418b-87d6-32085f31d137 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:43.213971 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64539af8-90b1-418b-87d6-32085f31d137 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:43.214235 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64539af8-90b1-418b-87d6-32085f31d137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:43.222865 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64539af8-90b1-418b-87d6-32085f31d137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:43.224292 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64539af8-90b1-418b-87d6-32085f31d137 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:43.233226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1307/2625] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:34:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:34:43.252013 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e6312-5f82-49fa-9f55-ba6c8c3d269e None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:43.318658 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e6312-5f82-49fa-9f55-ba6c8c3d269e None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:43.323878 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbc474-8609-47e3-87ad-3a6331794b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:43.324725 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbc474-8609-47e3-87ad-3a6331794b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:43.325004 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbc474-8609-47e3-87ad-3a6331794b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:43.325276 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbc474-8609-47e3-87ad-3a6331794b3f admin admin] PATH_INFO: `/v3/users/0118f13a2b314b7a946f57aabcd25d40` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:43.326530 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbc474-8609-47e3-87ad-3a6331794b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0118f13a2b314b7a946f57aabcd25d40)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:43.328455 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbc474-8609-47e3-87ad-3a6331794b3f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:43.375547 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-95bbc474-8609-47e3-87ad-3a6331794b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0118f13a2b314b7a946f57aabcd25d40'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:43.382751 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-95bbc474-8609-47e3-87ad-3a6331794b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0118f13a2b314b7a946f57aabcd25d40'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:43.394255 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-95bbc474-8609-47e3-87ad-3a6331794b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0118f13a2b314b7a946f57aabcd25d40'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:43.394941 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-95bbc474-8609-47e3-87ad-3a6331794b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0118f13a2b314b7a946f57aabcd25d40'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:43.395562 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-95bbc474-8609-47e3-87ad-3a6331794b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0118f13a2b314b7a946f57aabcd25d40'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:43.408645 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1319/2626] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:34:43 2022] DELETE /identity/v3/users/0118f13a2b314b7a946f57aabcd25d40 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:34:43.413272 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233341f2-baab-4780-9ad8-2c62510def27 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:43.413591 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233341f2-baab-4780-9ad8-2c62510def27 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:43.413866 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233341f2-baab-4780-9ad8-2c62510def27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:43.431763 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-233341f2-baab-4780-9ad8-2c62510def27 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:34:43.432974 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-233341f2-baab-4780-9ad8-2c62510def27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:43.497201 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1308/2627] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:34:43.507151 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbc474-8609-47e3-87ad-3a6331794b3f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:43.508958 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-95bbc474-8609-47e3-87ad-3a6331794b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:43.574751 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbc474-8609-47e3-87ad-3a6331794b3f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:43.579150 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fd2ae-be23-472c-b536-c4059cce4f31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:43.579921 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fd2ae-be23-472c-b536-c4059cce4f31 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:43.580192 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fd2ae-be23-472c-b536-c4059cce4f31 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:43.580463 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fd2ae-be23-472c-b536-c4059cce4f31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:43.590084 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fd2ae-be23-472c-b536-c4059cce4f31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:43.591513 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fd2ae-be23-472c-b536-c4059cce4f31 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:43.602014 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1320/2628] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:34:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:34:43.883839 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233341f2-baab-4780-9ad8-2c62510def27 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:43.885342 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-233341f2-baab-4780-9ad8-2c62510def27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:43.900090 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233341f2-baab-4780-9ad8-2c62510def27 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:43.907022 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bd0a7-b3cb-475b-937a-e751b102d2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:43.907916 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bd0a7-b3cb-475b-937a-e751b102d2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:43.908176 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bd0a7-b3cb-475b-937a-e751b102d2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:43.908560 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bd0a7-b3cb-475b-937a-e751b102d2fa admin admin] PATH_INFO: `/v3/projects/1b1bfb052b8049fb8663bef5855b20f6` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:43.910060 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bd0a7-b3cb-475b-937a-e751b102d2fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b1bfb052b8049fb8663bef5855b20f6)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:43.911953 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bd0a7-b3cb-475b-937a-e751b102d2fa admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:43.958702 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-556bd0a7-b3cb-475b-937a-e751b102d2fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b1bfb052b8049fb8663bef5855b20f6', 'request_id': 'req-556bd0a7-b3cb-475b-937a-e751b102d2fa'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:43.964227 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-556bd0a7-b3cb-475b-937a-e751b102d2fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b1bfb052b8049fb8663bef5855b20f6', 'request_id': 'req-556bd0a7-b3cb-475b-937a-e751b102d2fa'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:43.970428 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-556bd0a7-b3cb-475b-937a-e751b102d2fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b1bfb052b8049fb8663bef5855b20f6', 'request_id': 'req-556bd0a7-b3cb-475b-937a-e751b102d2fa'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:43.986999 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-556bd0a7-b3cb-475b-937a-e751b102d2fa admin admin] The token cache is being invalidate because project 1b1bfb052b8049fb8663bef5855b20f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:34:43.987344 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-556bd0a7-b3cb-475b-937a-e751b102d2fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:43.988188 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-556bd0a7-b3cb-475b-937a-e751b102d2fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:43.989933 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1309/2629] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:34:43 2022] DELETE /identity/v3/projects/1b1bfb052b8049fb8663bef5855b20f6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:34:43.996472 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5e80d-b2f8-4864-a9f6-a8b5ab5dee55 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:43.996790 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5e80d-b2f8-4864-a9f6-a8b5ab5dee55 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:43.997066 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5e80d-b2f8-4864-a9f6-a8b5ab5dee55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:44.015338 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-f2f5e80d-b2f8-4864-a9f6-a8b5ab5dee55 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:34:44.016542 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-f2f5e80d-b2f8-4864-a9f6-a8b5ab5dee55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:44.078241 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1321/2630] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:34:44.087031 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8b07e-a948-423b-adaf-e2d4a2a34fe8 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:44.087369 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8b07e-a948-423b-adaf-e2d4a2a34fe8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:44.087714 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8b07e-a948-423b-adaf-e2d4a2a34fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:44.108793 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-41b8b07e-a948-423b-adaf-e2d4a2a34fe8 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:34:44.110387 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-41b8b07e-a948-423b-adaf-e2d4a2a34fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:44.122775 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1310/2631] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:34:44.124287 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5e80d-b2f8-4864-a9f6-a8b5ab5dee55 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:44.141926 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5e80d-b2f8-4864-a9f6-a8b5ab5dee55 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:44.147450 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d854063-7986-4be6-90e1-f2cfe2154ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:44.148109 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d854063-7986-4be6-90e1-f2cfe2154ead admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:44.148383 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d854063-7986-4be6-90e1-f2cfe2154ead admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:44.148646 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d854063-7986-4be6-90e1-f2cfe2154ead admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:44.149398 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d854063-7986-4be6-90e1-f2cfe2154ead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:34:44.149701 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d854063-7986-4be6-90e1-f2cfe2154ead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:44.151288 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d854063-7986-4be6-90e1-f2cfe2154ead admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:44.163594 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1322/2632] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:34:44.168087 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8b07e-a948-423b-adaf-e2d4a2a34fe8 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:44.177534 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8b07e-a948-423b-adaf-e2d4a2a34fe8 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:44.183413 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03fbcc-02cc-42f3-af79-405dd9f9a7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:44.184061 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03fbcc-02cc-42f3-af79-405dd9f9a7fd admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:44.184336 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03fbcc-02cc-42f3-af79-405dd9f9a7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:44.184601 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03fbcc-02cc-42f3-af79-405dd9f9a7fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:44.185328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03fbcc-02cc-42f3-af79-405dd9f9a7fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:44.187243 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03fbcc-02cc-42f3-af79-405dd9f9a7fd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:44.216130 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1311/2633] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:34:44 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:34:44.220454 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d854063-7986-4be6-90e1-f2cfe2154ead admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:44.231196 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d854063-7986-4be6-90e1-f2cfe2154ead admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:44.291313 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e655657-ebb6-4f58-bee5-137a0e45854f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:44.292275 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e655657-ebb6-4f58-bee5-137a0e45854f admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:44.292613 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e655657-ebb6-4f58-bee5-137a0e45854f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:44.292940 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e655657-ebb6-4f58-bee5-137a0e45854f admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:44.294052 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e655657-ebb6-4f58-bee5-137a0e45854f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:44.297093 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e655657-ebb6-4f58-bee5-137a0e45854f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:44.323620 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1323/2634] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:34:44 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 21:34:44.328183 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03fbcc-02cc-42f3-af79-405dd9f9a7fd admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:44.338810 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03fbcc-02cc-42f3-af79-405dd9f9a7fd admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:44.344349 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeeea7e-2f71-49ec-ad90-a25b7f95d413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:44.344998 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeeea7e-2f71-49ec-ad90-a25b7f95d413 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:44.345275 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeeea7e-2f71-49ec-ad90-a25b7f95d413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:44.345571 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeeea7e-2f71-49ec-ad90-a25b7f95d413 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:44.346305 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeeea7e-2f71-49ec-ad90-a25b7f95d413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:44.347910 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeeea7e-2f71-49ec-ad90-a25b7f95d413 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:44.358812 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1312/2635] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:34:44.362785 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e655657-ebb6-4f58-bee5-137a0e45854f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:44.373280 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e655657-ebb6-4f58-bee5-137a0e45854f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:44.379215 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a2c4b-52a4-4ed0-b18a-77120242592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:44.379863 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a2c4b-52a4-4ed0-b18a-77120242592b admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:44.380133 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a2c4b-52a4-4ed0-b18a-77120242592b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:44.380401 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a2c4b-52a4-4ed0-b18a-77120242592b admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:44.381145 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a2c4b-52a4-4ed0-b18a-77120242592b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:44.382770 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a2c4b-52a4-4ed0-b18a-77120242592b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:44.393145 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1324/2636] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:34:44.397058 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeeea7e-2f71-49ec-ad90-a25b7f95d413 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:44.407408 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeeea7e-2f71-49ec-ad90-a25b7f95d413 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:44.413135 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba97ae1-34d8-4994-a078-dfe3f798e30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:44.414081 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba97ae1-34d8-4994-a078-dfe3f798e30e admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:44.414336 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba97ae1-34d8-4994-a078-dfe3f798e30e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:44.414625 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba97ae1-34d8-4994-a078-dfe3f798e30e admin admin] PATH_INFO: `/v3/projects/af5be2cf67f648d58f5b3f4aae74840b/users/838743debf3744f2b57aef1f11ae6ff1/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:44.431078 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba97ae1-34d8-4994-a078-dfe3f798e30e admin admin] RBAC: Authorizing `identity:create_grant(project_id=af5be2cf67f648d58f5b3f4aae74840b, user_id=838743debf3744f2b57aef1f11ae6ff1, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:44.433773 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba97ae1-34d8-4994-a078-dfe3f798e30e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:44.449952 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1313/2637] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:34:44 2022] PUT /identity/v3/projects/af5be2cf67f648d58f5b3f4aae74840b/users/838743debf3744f2b57aef1f11ae6ff1/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:34:44.460411 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fac38-d7ce-48e1-932b-49fe366903dc None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:44.460681 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fac38-d7ce-48e1-932b-49fe366903dc None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:44.460950 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fac38-d7ce-48e1-932b-49fe366903dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:44.488629 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-fa0fac38-d7ce-48e1-932b-49fe366903dc None None] MFA Rules not processed for user `838743debf3744f2b57aef1f11ae6ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:34:44.489862 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-fa0fac38-d7ce-48e1-932b-49fe366903dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:44.558150 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1325/2638] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:34:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:34:44.563371 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba97ae1-34d8-4994-a078-dfe3f798e30e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:44.635931 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba97ae1-34d8-4994-a078-dfe3f798e30e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:44.642169 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c25d9-44da-4c9f-99d9-1a8a9adcb507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:44.642820 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c25d9-44da-4c9f-99d9-1a8a9adcb507 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:44.643095 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c25d9-44da-4c9f-99d9-1a8a9adcb507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:44.643368 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c25d9-44da-4c9f-99d9-1a8a9adcb507 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:44.644056 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c25d9-44da-4c9f-99d9-1a8a9adcb507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:44.645982 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c25d9-44da-4c9f-99d9-1a8a9adcb507 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:44.681295 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1314/2639] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:34:44 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:34:44.687015 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fac38-d7ce-48e1-932b-49fe366903dc None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:44.698414 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fac38-d7ce-48e1-932b-49fe366903dc None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:44.758691 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad92ce7-756d-4760-b28f-92e69b050364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:44.759399 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad92ce7-756d-4760-b28f-92e69b050364 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:44.759682 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad92ce7-756d-4760-b28f-92e69b050364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:44.759971 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad92ce7-756d-4760-b28f-92e69b050364 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:44.760681 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad92ce7-756d-4760-b28f-92e69b050364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:44.762621 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad92ce7-756d-4760-b28f-92e69b050364 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:44.784900 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1326/2640] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:34:44 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 21:34:44.789667 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c25d9-44da-4c9f-99d9-1a8a9adcb507 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:44.799927 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c25d9-44da-4c9f-99d9-1a8a9adcb507 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:44.805696 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb58d3-e215-43ae-af5c-8a08f45d5a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:44.806346 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb58d3-e215-43ae-af5c-8a08f45d5a6e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:44.806618 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb58d3-e215-43ae-af5c-8a08f45d5a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:44.806888 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb58d3-e215-43ae-af5c-8a08f45d5a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:44.807622 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb58d3-e215-43ae-af5c-8a08f45d5a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:44.809216 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb58d3-e215-43ae-af5c-8a08f45d5a6e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:44.819976 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1315/2641] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:34:44.825799 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad92ce7-756d-4760-b28f-92e69b050364 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:44.843809 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad92ce7-756d-4760-b28f-92e69b050364 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:44.849213 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214f959-2847-4f68-bf7d-f79ed9deffd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:44.849903 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214f959-2847-4f68-bf7d-f79ed9deffd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:44.850165 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214f959-2847-4f68-bf7d-f79ed9deffd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:44.850449 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214f959-2847-4f68-bf7d-f79ed9deffd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:44.851183 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214f959-2847-4f68-bf7d-f79ed9deffd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:44.852791 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214f959-2847-4f68-bf7d-f79ed9deffd4 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:44.862968 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1327/2642] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:34:44.867224 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb58d3-e215-43ae-af5c-8a08f45d5a6e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:44.877599 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb58d3-e215-43ae-af5c-8a08f45d5a6e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:44.883534 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f24ca-b2ab-4162-a239-773e90c3ff29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:44.884408 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f24ca-b2ab-4162-a239-773e90c3ff29 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:44.884713 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f24ca-b2ab-4162-a239-773e90c3ff29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:44.884955 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f24ca-b2ab-4162-a239-773e90c3ff29 admin admin] PATH_INFO: `/v3/projects/4eba0a6730f64097b38a22d851d126d7/users/5874a8c0fa9f449c94e9eaeacacd818c/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:44.900900 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f24ca-b2ab-4162-a239-773e90c3ff29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eba0a6730f64097b38a22d851d126d7, user_id=5874a8c0fa9f449c94e9eaeacacd818c, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:44.903484 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f24ca-b2ab-4162-a239-773e90c3ff29 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:44.919132 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1316/2643] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:34:44 2022] PUT /identity/v3/projects/4eba0a6730f64097b38a22d851d126d7/users/5874a8c0fa9f449c94e9eaeacacd818c/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:34:44.931093 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e0f9b-7aff-4a18-85e2-7ce8498c14a2 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:44.931379 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e0f9b-7aff-4a18-85e2-7ce8498c14a2 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:44.931650 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e0f9b-7aff-4a18-85e2-7ce8498c14a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:44.958666 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-ac2e0f9b-7aff-4a18-85e2-7ce8498c14a2 None None] MFA Rules not processed for user `5874a8c0fa9f449c94e9eaeacacd818c`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:34:44.959894 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ac2e0f9b-7aff-4a18-85e2-7ce8498c14a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:45.030663 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1328/2644] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:34:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:34:45.037103 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f24ca-b2ab-4162-a239-773e90c3ff29 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:45.114421 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f24ca-b2ab-4162-a239-773e90c3ff29 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:45.121148 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51941af-6f41-40cf-9a83-3e88a2d1cbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:45.121844 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51941af-6f41-40cf-9a83-3e88a2d1cbb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:45.122120 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51941af-6f41-40cf-9a83-3e88a2d1cbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:45.122378 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51941af-6f41-40cf-9a83-3e88a2d1cbb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:45.123104 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51941af-6f41-40cf-9a83-3e88a2d1cbb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:45.124989 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51941af-6f41-40cf-9a83-3e88a2d1cbb3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:45.154742 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1317/2645] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:34:45 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:34:45.158966 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e0f9b-7aff-4a18-85e2-7ce8498c14a2 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:45.171545 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e0f9b-7aff-4a18-85e2-7ce8498c14a2 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:45.226063 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176dcd00-d7f6-448c-b769-2019257afd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:45.226733 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dcd00-d7f6-448c-b769-2019257afd6d admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:45.227033 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dcd00-d7f6-448c-b769-2019257afd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:45.227298 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dcd00-d7f6-448c-b769-2019257afd6d admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:45.228032 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176dcd00-d7f6-448c-b769-2019257afd6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:45.229970 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176dcd00-d7f6-448c-b769-2019257afd6d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:45.250066 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1329/2646] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:34:45 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:34:45.254276 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51941af-6f41-40cf-9a83-3e88a2d1cbb3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:45.264814 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51941af-6f41-40cf-9a83-3e88a2d1cbb3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:45.270598 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b292d0-d6d9-46ab-99b9-9a6de4060882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:45.271267 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b292d0-d6d9-46ab-99b9-9a6de4060882 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:45.271547 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b292d0-d6d9-46ab-99b9-9a6de4060882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:45.271813 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b292d0-d6d9-46ab-99b9-9a6de4060882 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:45.272554 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b292d0-d6d9-46ab-99b9-9a6de4060882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:45.274183 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b292d0-d6d9-46ab-99b9-9a6de4060882 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:45.288947 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1318/2647] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:34:45.293306 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176dcd00-d7f6-448c-b769-2019257afd6d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:45.303440 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176dcd00-d7f6-448c-b769-2019257afd6d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:45.309668 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350bc6c-e51d-469a-ae87-460211b080c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:45.310573 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350bc6c-e51d-469a-ae87-460211b080c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:45.310828 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350bc6c-e51d-469a-ae87-460211b080c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:45.311095 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350bc6c-e51d-469a-ae87-460211b080c9 admin admin] PATH_INFO: `/v3/projects/07f0507ed4ed40588abd88f03b574af9/users/7225d36b5614431fa04833ec8a8a83ab/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:45.326999 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350bc6c-e51d-469a-ae87-460211b080c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f0507ed4ed40588abd88f03b574af9, user_id=7225d36b5614431fa04833ec8a8a83ab, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:45.329668 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350bc6c-e51d-469a-ae87-460211b080c9 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:45.347479 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1330/2648] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:34:45 2022] PUT /identity/v3/projects/07f0507ed4ed40588abd88f03b574af9/users/7225d36b5614431fa04833ec8a8a83ab/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 21:34:45.351511 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b292d0-d6d9-46ab-99b9-9a6de4060882 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:45.361691 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b292d0-d6d9-46ab-99b9-9a6de4060882 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:45.417226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3beae1-8fa4-4b00-8c55-105e07460923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:45.417823 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3beae1-8fa4-4b00-8c55-105e07460923 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:45.418099 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3beae1-8fa4-4b00-8c55-105e07460923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:45.418368 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3beae1-8fa4-4b00-8c55-105e07460923 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:45.419080 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3beae1-8fa4-4b00-8c55-105e07460923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:45.420651 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3beae1-8fa4-4b00-8c55-105e07460923 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:45.434373 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1319/2649] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:34:45.438677 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350bc6c-e51d-469a-ae87-460211b080c9 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:45.449371 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350bc6c-e51d-469a-ae87-460211b080c9 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:45.454700 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f708c7-41f4-4e7e-94cd-5b2b8cc0da2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:45.455612 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f708c7-41f4-4e7e-94cd-5b2b8cc0da2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:45.455893 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f708c7-41f4-4e7e-94cd-5b2b8cc0da2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:45.456162 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f708c7-41f4-4e7e-94cd-5b2b8cc0da2c admin admin] PATH_INFO: `/v3/projects/07f0507ed4ed40588abd88f03b574af9/users/7225d36b5614431fa04833ec8a8a83ab/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:45.458230 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f708c7-41f4-4e7e-94cd-5b2b8cc0da2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f0507ed4ed40588abd88f03b574af9, user_id=7225d36b5614431fa04833ec8a8a83ab, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:45.460860 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f708c7-41f4-4e7e-94cd-5b2b8cc0da2c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:45.471089 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1331/2650] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:34:45 2022] PUT /identity/v3/projects/07f0507ed4ed40588abd88f03b574af9/users/7225d36b5614431fa04833ec8a8a83ab/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:34:45.481164 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2d989-df82-4d83-99a4-ce373400f20e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:45.481530 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2d989-df82-4d83-99a4-ce373400f20e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:45.481816 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2d989-df82-4d83-99a4-ce373400f20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:45.513551 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-a4c2d989-df82-4d83-99a4-ce373400f20e None None] MFA Rules not processed for user `7225d36b5614431fa04833ec8a8a83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:34:45.514925 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a4c2d989-df82-4d83-99a4-ce373400f20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:45.588765 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1320/2651] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:34:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:34:45.599709 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f708c7-41f4-4e7e-94cd-5b2b8cc0da2c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:45.602380 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-c3f708c7-41f4-4e7e-94cd-5b2b8cc0da2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:45.667783 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f708c7-41f4-4e7e-94cd-5b2b8cc0da2c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:45.671803 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe048dbe-5cdc-4b17-b4ad-3d1fda72b930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:45.672438 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe048dbe-5cdc-4b17-b4ad-3d1fda72b930 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:45.672712 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe048dbe-5cdc-4b17-b4ad-3d1fda72b930 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:45.672983 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe048dbe-5cdc-4b17-b4ad-3d1fda72b930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:45.727776 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe048dbe-5cdc-4b17-b4ad-3d1fda72b930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:45.729206 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe048dbe-5cdc-4b17-b4ad-3d1fda72b930 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:45.738248 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1332/2652] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:34:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:34:47.228799 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2d989-df82-4d83-99a4-ce373400f20e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:47.230509 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a4c2d989-df82-4d83-99a4-ce373400f20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:47.243033 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2d989-df82-4d83-99a4-ce373400f20e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:47.246957 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83295d9-4d60-435f-ab80-cc0ad9626842 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:47.247594 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83295d9-4d60-435f-ab80-cc0ad9626842 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:47.247867 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83295d9-4d60-435f-ab80-cc0ad9626842 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:47.248127 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83295d9-4d60-435f-ab80-cc0ad9626842 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:47.306634 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83295d9-4d60-435f-ab80-cc0ad9626842 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:47.308089 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83295d9-4d60-435f-ab80-cc0ad9626842 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:47.317433 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1321/2653] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:34:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:34:47.845630 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe048dbe-5cdc-4b17-b4ad-3d1fda72b930 service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:47.854614 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe048dbe-5cdc-4b17-b4ad-3d1fda72b930 service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:47.859304 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eaad37-68d3-49fb-ae6a-8ff71373e24f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:47.859939 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eaad37-68d3-49fb-ae6a-8ff71373e24f service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:47.860205 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eaad37-68d3-49fb-ae6a-8ff71373e24f service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:47.860471 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eaad37-68d3-49fb-ae6a-8ff71373e24f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:47.870568 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eaad37-68d3-49fb-ae6a-8ff71373e24f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:47.871987 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eaad37-68d3-49fb-ae6a-8ff71373e24f service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:47.881935 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1333/2654] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:34:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:34:51.724924 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83295d9-4d60-435f-ab80-cc0ad9626842 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:51.790225 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83295d9-4d60-435f-ab80-cc0ad9626842 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:51.796516 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a57b16-3178-49ff-b1a0-6cf13637156f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:51.797382 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a57b16-3178-49ff-b1a0-6cf13637156f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:51.797689 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a57b16-3178-49ff-b1a0-6cf13637156f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:51.797956 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a57b16-3178-49ff-b1a0-6cf13637156f admin admin] PATH_INFO: `/v3/users/838743debf3744f2b57aef1f11ae6ff1` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:51.799368 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a57b16-3178-49ff-b1a0-6cf13637156f admin admin] RBAC: Authorizing `identity:delete_user(user_id=838743debf3744f2b57aef1f11ae6ff1)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:51.801293 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a57b16-3178-49ff-b1a0-6cf13637156f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:51.849706 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-21a57b16-3178-49ff-b1a0-6cf13637156f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '838743debf3744f2b57aef1f11ae6ff1'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:51.856322 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-21a57b16-3178-49ff-b1a0-6cf13637156f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '838743debf3744f2b57aef1f11ae6ff1'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:51.868404 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-21a57b16-3178-49ff-b1a0-6cf13637156f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '838743debf3744f2b57aef1f11ae6ff1'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:51.869110 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-21a57b16-3178-49ff-b1a0-6cf13637156f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '838743debf3744f2b57aef1f11ae6ff1'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:51.879035 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-21a57b16-3178-49ff-b1a0-6cf13637156f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '838743debf3744f2b57aef1f11ae6ff1'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:51.888313 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1322/2655] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:34:51 2022] DELETE /identity/v3/users/838743debf3744f2b57aef1f11ae6ff1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:34:51.894311 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27521ded-fb3c-4ad3-b1b1-c70b0e0d31df None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:51.894815 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27521ded-fb3c-4ad3-b1b1-c70b0e0d31df None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:51.894959 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27521ded-fb3c-4ad3-b1b1-c70b0e0d31df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:51.912525 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-27521ded-fb3c-4ad3-b1b1-c70b0e0d31df None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:34:51.913749 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-27521ded-fb3c-4ad3-b1b1-c70b0e0d31df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:51.984719 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1334/2656] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:34:51.994763 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a57b16-3178-49ff-b1a0-6cf13637156f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:51.996460 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-21a57b16-3178-49ff-b1a0-6cf13637156f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:52.065190 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a57b16-3178-49ff-b1a0-6cf13637156f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:52.070546 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06806e-da9f-468c-ba92-c44aec9c3ea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:52.071477 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06806e-da9f-468c-ba92-c44aec9c3ea0 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:52.071852 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06806e-da9f-468c-ba92-c44aec9c3ea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:52.072224 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06806e-da9f-468c-ba92-c44aec9c3ea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:52.086393 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06806e-da9f-468c-ba92-c44aec9c3ea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:52.088633 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06806e-da9f-468c-ba92-c44aec9c3ea0 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:52.100161 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1323/2657] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:34:52.371934 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27521ded-fb3c-4ad3-b1b1-c70b0e0d31df None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:52.373591 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-27521ded-fb3c-4ad3-b1b1-c70b0e0d31df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:52.386479 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27521ded-fb3c-4ad3-b1b1-c70b0e0d31df None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:52.391772 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657a42f-f545-4e96-8396-916e68253950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:52.392638 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657a42f-f545-4e96-8396-916e68253950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:52.393037 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657a42f-f545-4e96-8396-916e68253950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:52.393153 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657a42f-f545-4e96-8396-916e68253950 admin admin] PATH_INFO: `/v3/projects/af5be2cf67f648d58f5b3f4aae74840b` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:52.394401 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657a42f-f545-4e96-8396-916e68253950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af5be2cf67f648d58f5b3f4aae74840b)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:52.396292 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657a42f-f545-4e96-8396-916e68253950 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:52.444043 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b657a42f-f545-4e96-8396-916e68253950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af5be2cf67f648d58f5b3f4aae74840b', 'request_id': 'req-b657a42f-f545-4e96-8396-916e68253950'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:52.449314 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b657a42f-f545-4e96-8396-916e68253950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af5be2cf67f648d58f5b3f4aae74840b', 'request_id': 'req-b657a42f-f545-4e96-8396-916e68253950'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:52.455423 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b657a42f-f545-4e96-8396-916e68253950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af5be2cf67f648d58f5b3f4aae74840b', 'request_id': 'req-b657a42f-f545-4e96-8396-916e68253950'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:52.468310 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b657a42f-f545-4e96-8396-916e68253950 admin admin] The token cache is being invalidate because project af5be2cf67f648d58f5b3f4aae74840b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:34:52.468590 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b657a42f-f545-4e96-8396-916e68253950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:52.469195 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b657a42f-f545-4e96-8396-916e68253950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:52.470744 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1335/2658] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:34:52 2022] DELETE /identity/v3/projects/af5be2cf67f648d58f5b3f4aae74840b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:34:52.474872 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06806e-da9f-468c-ba92-c44aec9c3ea0 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:52.484505 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06806e-da9f-468c-ba92-c44aec9c3ea0 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:52.545305 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e513e6-aa70-4b18-9b18-b33cfbf76fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:52.546234 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e513e6-aa70-4b18-9b18-b33cfbf76fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:52.546509 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e513e6-aa70-4b18-9b18-b33cfbf76fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:52.546777 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e513e6-aa70-4b18-9b18-b33cfbf76fc0 admin admin] PATH_INFO: `/v3/users/5874a8c0fa9f449c94e9eaeacacd818c` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:52.547968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e513e6-aa70-4b18-9b18-b33cfbf76fc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5874a8c0fa9f449c94e9eaeacacd818c)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:52.549911 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e513e6-aa70-4b18-9b18-b33cfbf76fc0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:52.597281 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e8e513e6-aa70-4b18-9b18-b33cfbf76fc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5874a8c0fa9f449c94e9eaeacacd818c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:52.603905 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e8e513e6-aa70-4b18-9b18-b33cfbf76fc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5874a8c0fa9f449c94e9eaeacacd818c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:52.615939 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e8e513e6-aa70-4b18-9b18-b33cfbf76fc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5874a8c0fa9f449c94e9eaeacacd818c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:52.616668 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e8e513e6-aa70-4b18-9b18-b33cfbf76fc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5874a8c0fa9f449c94e9eaeacacd818c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:52.625254 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e8e513e6-aa70-4b18-9b18-b33cfbf76fc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5874a8c0fa9f449c94e9eaeacacd818c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:52.631548 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1324/2659] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:34:52 2022] DELETE /identity/v3/users/5874a8c0fa9f449c94e9eaeacacd818c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:34:52.916824 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657a42f-f545-4e96-8396-916e68253950 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:52.918316 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b657a42f-f545-4e96-8396-916e68253950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:52.931981 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657a42f-f545-4e96-8396-916e68253950 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:52.988686 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66335431-bcab-4ab4-9873-4f26f7d59af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:52.989584 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66335431-bcab-4ab4-9873-4f26f7d59af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:52.989874 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66335431-bcab-4ab4-9873-4f26f7d59af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:52.990150 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66335431-bcab-4ab4-9873-4f26f7d59af9 admin admin] PATH_INFO: `/v3/projects/4eba0a6730f64097b38a22d851d126d7` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:52.991392 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66335431-bcab-4ab4-9873-4f26f7d59af9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eba0a6730f64097b38a22d851d126d7)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:52.993308 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66335431-bcab-4ab4-9873-4f26f7d59af9 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:53.047077 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-66335431-bcab-4ab4-9873-4f26f7d59af9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eba0a6730f64097b38a22d851d126d7', 'request_id': 'req-66335431-bcab-4ab4-9873-4f26f7d59af9'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:53.052341 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-66335431-bcab-4ab4-9873-4f26f7d59af9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eba0a6730f64097b38a22d851d126d7', 'request_id': 'req-66335431-bcab-4ab4-9873-4f26f7d59af9'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:53.058788 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-66335431-bcab-4ab4-9873-4f26f7d59af9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eba0a6730f64097b38a22d851d126d7', 'request_id': 'req-66335431-bcab-4ab4-9873-4f26f7d59af9'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:53.074861 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-66335431-bcab-4ab4-9873-4f26f7d59af9 admin admin] The token cache is being invalidate because project 4eba0a6730f64097b38a22d851d126d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:34:53.075142 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-66335431-bcab-4ab4-9873-4f26f7d59af9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:53.075748 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-66335431-bcab-4ab4-9873-4f26f7d59af9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:53.077497 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1336/2660] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:34:52 2022] DELETE /identity/v3/projects/4eba0a6730f64097b38a22d851d126d7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:34:53.082786 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e513e6-aa70-4b18-9b18-b33cfbf76fc0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:53.084238 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e8e513e6-aa70-4b18-9b18-b33cfbf76fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:53.097584 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e513e6-aa70-4b18-9b18-b33cfbf76fc0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:53.157046 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6efd8b-0f0c-48a4-a69d-b5174f906b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:53.157951 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6efd8b-0f0c-48a4-a69d-b5174f906b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:53.158259 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6efd8b-0f0c-48a4-a69d-b5174f906b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:53.158556 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6efd8b-0f0c-48a4-a69d-b5174f906b38 admin admin] PATH_INFO: `/v3/users/7225d36b5614431fa04833ec8a8a83ab` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:53.160161 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6efd8b-0f0c-48a4-a69d-b5174f906b38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7225d36b5614431fa04833ec8a8a83ab)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:53.162459 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6efd8b-0f0c-48a4-a69d-b5174f906b38 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:53.210670 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ec6efd8b-0f0c-48a4-a69d-b5174f906b38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7225d36b5614431fa04833ec8a8a83ab'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:53.217191 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ec6efd8b-0f0c-48a4-a69d-b5174f906b38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7225d36b5614431fa04833ec8a8a83ab'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:53.228082 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ec6efd8b-0f0c-48a4-a69d-b5174f906b38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7225d36b5614431fa04833ec8a8a83ab'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:53.228734 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ec6efd8b-0f0c-48a4-a69d-b5174f906b38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7225d36b5614431fa04833ec8a8a83ab'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:53.237138 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ec6efd8b-0f0c-48a4-a69d-b5174f906b38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7225d36b5614431fa04833ec8a8a83ab'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:53.242824 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1325/2661] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:34:53 2022] DELETE /identity/v3/users/7225d36b5614431fa04833ec8a8a83ab => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:34:53.506939 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66335431-bcab-4ab4-9873-4f26f7d59af9 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:34:53.508481 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-66335431-bcab-4ab4-9873-4f26f7d59af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:34:53.523011 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66335431-bcab-4ab4-9873-4f26f7d59af9 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:34:53.585057 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f9b4d-4f8f-4be4-a64a-3adf4e0a007a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:34:53.585891 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f9b4d-4f8f-4be4-a64a-3adf4e0a007a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:34:53.586168 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f9b4d-4f8f-4be4-a64a-3adf4e0a007a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:34:53.586433 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f9b4d-4f8f-4be4-a64a-3adf4e0a007a admin admin] PATH_INFO: `/v3/projects/07f0507ed4ed40588abd88f03b574af9` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:34:53.587648 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f9b4d-4f8f-4be4-a64a-3adf4e0a007a admin admin] RBAC: Authorizing `identity:delete_project(project_id=07f0507ed4ed40588abd88f03b574af9)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:34:53.589603 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f9b4d-4f8f-4be4-a64a-3adf4e0a007a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:34:53.635885 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-4c1f9b4d-4f8f-4be4-a64a-3adf4e0a007a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07f0507ed4ed40588abd88f03b574af9', 'request_id': 'req-4c1f9b4d-4f8f-4be4-a64a-3adf4e0a007a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:53.641831 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-4c1f9b4d-4f8f-4be4-a64a-3adf4e0a007a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07f0507ed4ed40588abd88f03b574af9', 'request_id': 'req-4c1f9b4d-4f8f-4be4-a64a-3adf4e0a007a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:53.648674 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-4c1f9b4d-4f8f-4be4-a64a-3adf4e0a007a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07f0507ed4ed40588abd88f03b574af9', 'request_id': 'req-4c1f9b4d-4f8f-4be4-a64a-3adf4e0a007a'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:53.661889 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-4c1f9b4d-4f8f-4be4-a64a-3adf4e0a007a admin admin] The token cache is being invalidate because project 07f0507ed4ed40588abd88f03b574af9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:34:53.662167 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-4c1f9b4d-4f8f-4be4-a64a-3adf4e0a007a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:53.662813 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-4c1f9b4d-4f8f-4be4-a64a-3adf4e0a007a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:34:53.664345 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1337/2662] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:34:53 2022] DELETE /identity/v3/projects/07f0507ed4ed40588abd88f03b574af9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:35:32.146289 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6efd8b-0f0c-48a4-a69d-b5174f906b38 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:35:32.148968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ec6efd8b-0f0c-48a4-a69d-b5174f906b38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:35:32.213205 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6efd8b-0f0c-48a4-a69d-b5174f906b38 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:35:32.262278 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994009c-cf79-448a-99ff-03d5e4b2f705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:35:32.262926 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994009c-cf79-448a-99ff-03d5e4b2f705 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:35:32.263226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994009c-cf79-448a-99ff-03d5e4b2f705 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:35:32.263538 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994009c-cf79-448a-99ff-03d5e4b2f705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:35:32.265523 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f994009c-cf79-448a-99ff-03d5e4b2f705 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:35:32.355819 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994009c-cf79-448a-99ff-03d5e4b2f705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:35:32.357765 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994009c-cf79-448a-99ff-03d5e4b2f705 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:35:32.377797 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1326/2663] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:35:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:36:33.843605 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f9b4d-4f8f-4be4-a64a-3adf4e0a007a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:33.845201 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4c1f9b4d-4f8f-4be4-a64a-3adf4e0a007a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:33.903613 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f9b4d-4f8f-4be4-a64a-3adf4e0a007a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:33.907440 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a87ad8-bec1-4934-8dc7-d2d715b31691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:33.908114 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a87ad8-bec1-4934-8dc7-d2d715b31691 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:33.908389 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a87ad8-bec1-4934-8dc7-d2d715b31691 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:33.908654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a87ad8-bec1-4934-8dc7-d2d715b31691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:33.910533 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-16a87ad8-bec1-4934-8dc7-d2d715b31691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:33.971048 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a87ad8-bec1-4934-8dc7-d2d715b31691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:33.972501 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a87ad8-bec1-4934-8dc7-d2d715b31691 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:33.982525 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1338/2664] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:36:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:36:34.437514 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994009c-cf79-448a-99ff-03d5e4b2f705 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:34.438899 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f994009c-cf79-448a-99ff-03d5e4b2f705 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:34.522898 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994009c-cf79-448a-99ff-03d5e4b2f705 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:34.531359 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07032a-6c5c-481e-8a61-c04d1e37d78c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f05eb88abe24af4825259712b497d48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:34.532146 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07032a-6c5c-481e-8a61-c04d1e37d78c service placement] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:34.532846 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07032a-6c5c-481e-8a61-c04d1e37d78c service placement] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:34.533189 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07032a-6c5c-481e-8a61-c04d1e37d78c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:34.535361 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5c07032a-6c5c-481e-8a61-c04d1e37d78c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:34.551889 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07032a-6c5c-481e-8a61-c04d1e37d78c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:34.553643 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07032a-6c5c-481e-8a61-c04d1e37d78c service placement] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:34.564046 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1327/2665] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:36:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:36:35.945160 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e5363-619e-47ae-8977-5a93321fd820 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:35.945737 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e5363-619e-47ae-8977-5a93321fd820 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:35.945814 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e5363-619e-47ae-8977-5a93321fd820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:35.966377 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-c39e5363-619e-47ae-8977-5a93321fd820 None None] MFA Rules not processed for user `4f847dd93a4348038e39859597386d15`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:36:35.967865 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-c39e5363-619e-47ae-8977-5a93321fd820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:36.027583 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1339/2666] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:36:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:36:36.851987 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07032a-6c5c-481e-8a61-c04d1e37d78c service placement] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:36.862752 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07032a-6c5c-481e-8a61-c04d1e37d78c service placement] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:36.867918 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aea70-db5e-4cfa-85e8-3536efd5de4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:36.869378 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aea70-db5e-4cfa-85e8-3536efd5de4f service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:36.869660 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aea70-db5e-4cfa-85e8-3536efd5de4f service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:36.869931 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aea70-db5e-4cfa-85e8-3536efd5de4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:36.872058 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a46aea70-db5e-4cfa-85e8-3536efd5de4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:36.882694 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aea70-db5e-4cfa-85e8-3536efd5de4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:36.884159 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aea70-db5e-4cfa-85e8-3536efd5de4f service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:36.893145 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1328/2667] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:36:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:36:37.700264 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e5363-619e-47ae-8977-5a93321fd820 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:37.701863 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-c39e5363-619e-47ae-8977-5a93321fd820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:37.717784 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e5363-619e-47ae-8977-5a93321fd820 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:37.722314 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e443a8-48ff-4bc1-9166-64a8cd5c1145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:37.723224 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e443a8-48ff-4bc1-9166-64a8cd5c1145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:37.723539 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e443a8-48ff-4bc1-9166-64a8cd5c1145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:37.723812 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e443a8-48ff-4bc1-9166-64a8cd5c1145 admin admin] PATH_INFO: `/v3/users/54f6015a565b4a5eb74ec571f8774bbd` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:37.725015 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e443a8-48ff-4bc1-9166-64a8cd5c1145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f6015a565b4a5eb74ec571f8774bbd)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:37.727148 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e443a8-48ff-4bc1-9166-64a8cd5c1145 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:37.775310 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-61e443a8-48ff-4bc1-9166-64a8cd5c1145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f6015a565b4a5eb74ec571f8774bbd'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:37.782739 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-61e443a8-48ff-4bc1-9166-64a8cd5c1145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f6015a565b4a5eb74ec571f8774bbd'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:37.794763 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-61e443a8-48ff-4bc1-9166-64a8cd5c1145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f6015a565b4a5eb74ec571f8774bbd'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:37.795489 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-61e443a8-48ff-4bc1-9166-64a8cd5c1145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f6015a565b4a5eb74ec571f8774bbd'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:37.796078 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-61e443a8-48ff-4bc1-9166-64a8cd5c1145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f6015a565b4a5eb74ec571f8774bbd'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:37.811137 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1340/2668] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:36:37 2022] DELETE /identity/v3/users/54f6015a565b4a5eb74ec571f8774bbd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:36:37.988172 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aea70-db5e-4cfa-85e8-3536efd5de4f service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:38.002280 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aea70-db5e-4cfa-85e8-3536efd5de4f service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:38.065430 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0aeb16-91d7-4a33-92f9-9c9526778be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:38.066215 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aeb16-91d7-4a33-92f9-9c9526778be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:38.066494 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aeb16-91d7-4a33-92f9-9c9526778be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:38.066763 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aeb16-91d7-4a33-92f9-9c9526778be9 admin admin] PATH_INFO: `/v3/projects/c96651580da845748b21e850a875d357` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:38.068047 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0aeb16-91d7-4a33-92f9-9c9526778be9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96651580da845748b21e850a875d357)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:38.070075 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0aeb16-91d7-4a33-92f9-9c9526778be9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:38.118552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6f0aeb16-91d7-4a33-92f9-9c9526778be9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96651580da845748b21e850a875d357', 'request_id': 'req-6f0aeb16-91d7-4a33-92f9-9c9526778be9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:38.124418 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6f0aeb16-91d7-4a33-92f9-9c9526778be9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96651580da845748b21e850a875d357', 'request_id': 'req-6f0aeb16-91d7-4a33-92f9-9c9526778be9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:38.130864 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6f0aeb16-91d7-4a33-92f9-9c9526778be9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96651580da845748b21e850a875d357', 'request_id': 'req-6f0aeb16-91d7-4a33-92f9-9c9526778be9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:38.144441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6f0aeb16-91d7-4a33-92f9-9c9526778be9 admin admin] The token cache is being invalidate because project c96651580da845748b21e850a875d357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:36:38.144717 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6f0aeb16-91d7-4a33-92f9-9c9526778be9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:38.145328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6f0aeb16-91d7-4a33-92f9-9c9526778be9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:38.146886 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1329/2669] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:36:37 2022] DELETE /identity/v3/projects/c96651580da845748b21e850a875d357 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 21:36:38.152643 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bafba8-12e2-4091-b5f2-bc1fa726b4a9 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:38.152923 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bafba8-12e2-4091-b5f2-bc1fa726b4a9 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:38.153190 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bafba8-12e2-4091-b5f2-bc1fa726b4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:38.171116 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-35bafba8-12e2-4091-b5f2-bc1fa726b4a9 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:36:38.172299 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-35bafba8-12e2-4091-b5f2-bc1fa726b4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:38.232854 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1341/2670] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:36:38.240285 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0941ea-03a2-4945-964d-bcd7a348af42 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:38.240570 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0941ea-03a2-4945-964d-bcd7a348af42 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:38.240843 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0941ea-03a2-4945-964d-bcd7a348af42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:38.261510 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ce0941ea-03a2-4945-964d-bcd7a348af42 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:36:38.262715 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ce0941ea-03a2-4945-964d-bcd7a348af42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:38.271389 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1330/2671] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:36:38.275934 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bafba8-12e2-4091-b5f2-bc1fa726b4a9 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:38.286829 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bafba8-12e2-4091-b5f2-bc1fa726b4a9 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:38.291654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788438d5-09dc-44d4-a6cd-1a8ec79a971a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:38.292419 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788438d5-09dc-44d4-a6cd-1a8ec79a971a admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:38.292624 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788438d5-09dc-44d4-a6cd-1a8ec79a971a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:38.292951 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788438d5-09dc-44d4-a6cd-1a8ec79a971a admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:38.293730 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788438d5-09dc-44d4-a6cd-1a8ec79a971a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:36:38.294030 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788438d5-09dc-44d4-a6cd-1a8ec79a971a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:38.295731 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788438d5-09dc-44d4-a6cd-1a8ec79a971a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:38.309889 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1342/2672] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:36:38.313587 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0941ea-03a2-4945-964d-bcd7a348af42 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:38.323896 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0941ea-03a2-4945-964d-bcd7a348af42 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:38.328815 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56454f6f-ddad-4de6-850c-306bb321e280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:38.329669 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56454f6f-ddad-4de6-850c-306bb321e280 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:38.330014 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56454f6f-ddad-4de6-850c-306bb321e280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:38.330346 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56454f6f-ddad-4de6-850c-306bb321e280 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:38.331228 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56454f6f-ddad-4de6-850c-306bb321e280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:38.333271 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56454f6f-ddad-4de6-850c-306bb321e280 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:38.363580 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1331/2673] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:36:38 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 21:36:38.367868 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788438d5-09dc-44d4-a6cd-1a8ec79a971a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:38.378466 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788438d5-09dc-44d4-a6cd-1a8ec79a971a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:38.438369 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a1c3a-e442-471e-8e02-98046ecb18d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:38.439086 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a1c3a-e442-471e-8e02-98046ecb18d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:38.439321 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a1c3a-e442-471e-8e02-98046ecb18d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:38.439594 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a1c3a-e442-471e-8e02-98046ecb18d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:38.440343 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a1c3a-e442-471e-8e02-98046ecb18d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:38.442313 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a1c3a-e442-471e-8e02-98046ecb18d1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:38.467294 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1343/2674] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:36:38 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:36:38.471495 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56454f6f-ddad-4de6-850c-306bb321e280 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:38.486701 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56454f6f-ddad-4de6-850c-306bb321e280 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:38.493198 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5d2f1-780c-4f00-9492-151ef7da75b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:38.494023 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5d2f1-780c-4f00-9492-151ef7da75b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:38.494496 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5d2f1-780c-4f00-9492-151ef7da75b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:38.494832 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5d2f1-780c-4f00-9492-151ef7da75b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:38.495653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5d2f1-780c-4f00-9492-151ef7da75b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:38.497542 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5d2f1-780c-4f00-9492-151ef7da75b1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:38.512689 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1332/2675] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:36:38.515418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a1c3a-e442-471e-8e02-98046ecb18d1 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:38.525986 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a1c3a-e442-471e-8e02-98046ecb18d1 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:38.531157 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c5f7c-6dc6-4ef0-9d43-05ceefae2d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:38.532393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c5f7c-6dc6-4ef0-9d43-05ceefae2d98 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:38.532393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c5f7c-6dc6-4ef0-9d43-05ceefae2d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:38.532393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c5f7c-6dc6-4ef0-9d43-05ceefae2d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:38.533115 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c5f7c-6dc6-4ef0-9d43-05ceefae2d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:38.535143 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c5f7c-6dc6-4ef0-9d43-05ceefae2d98 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:38.548453 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1344/2676] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 21:36:38.553101 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5d2f1-780c-4f00-9492-151ef7da75b1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:38.563972 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5d2f1-780c-4f00-9492-151ef7da75b1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:38.568892 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f1803-9b1d-4e46-b139-f4af23d5b88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:38.569897 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f1803-9b1d-4e46-b139-f4af23d5b88b admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:38.570235 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f1803-9b1d-4e46-b139-f4af23d5b88b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:38.570565 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f1803-9b1d-4e46-b139-f4af23d5b88b admin admin] PATH_INFO: `/v3/projects/4f91ef4a8c79482e90071cc13359a297/users/16d4156058ed4e3a8c287922fa8072c1/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:38.586241 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f1803-9b1d-4e46-b139-f4af23d5b88b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f91ef4a8c79482e90071cc13359a297, user_id=16d4156058ed4e3a8c287922fa8072c1, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:38.588902 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f1803-9b1d-4e46-b139-f4af23d5b88b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:38.604770 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1333/2677] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:36:38 2022] PUT /identity/v3/projects/4f91ef4a8c79482e90071cc13359a297/users/16d4156058ed4e3a8c287922fa8072c1/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:36:38.616976 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55025f9e-3f96-4a3a-9c01-de4b39f54c29 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:38.617658 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55025f9e-3f96-4a3a-9c01-de4b39f54c29 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:38.618155 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55025f9e-3f96-4a3a-9c01-de4b39f54c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:38.644849 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-55025f9e-3f96-4a3a-9c01-de4b39f54c29 None None] MFA Rules not processed for user `16d4156058ed4e3a8c287922fa8072c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:36:38.646265 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-55025f9e-3f96-4a3a-9c01-de4b39f54c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:38.710920 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1345/2678] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:36:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:36:38.722991 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f1803-9b1d-4e46-b139-f4af23d5b88b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:38.724951 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d60f1803-9b1d-4e46-b139-f4af23d5b88b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:38.962551 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f1803-9b1d-4e46-b139-f4af23d5b88b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:38.968366 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8773d-b482-4c03-9962-8f5881dee9ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:38.969212 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8773d-b482-4c03-9962-8f5881dee9ef service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:38.969543 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8773d-b482-4c03-9962-8f5881dee9ef service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:38.969815 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8773d-b482-4c03-9962-8f5881dee9ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:38.978052 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8773d-b482-4c03-9962-8f5881dee9ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:38.979816 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8773d-b482-4c03-9962-8f5881dee9ef service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:38.989226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1334/2679] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:36:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:36:41.727207 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55025f9e-3f96-4a3a-9c01-de4b39f54c29 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:41.799195 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55025f9e-3f96-4a3a-9c01-de4b39f54c29 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:41.804973 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f0da4-9206-4c4b-89f4-5d032254f46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:41.805871 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f0da4-9206-4c4b-89f4-5d032254f46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:41.806159 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f0da4-9206-4c4b-89f4-5d032254f46f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:41.806429 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f0da4-9206-4c4b-89f4-5d032254f46f admin admin] PATH_INFO: `/v3/users/16d4156058ed4e3a8c287922fa8072c1` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:41.807661 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f0da4-9206-4c4b-89f4-5d032254f46f admin admin] RBAC: Authorizing `identity:delete_user(user_id=16d4156058ed4e3a8c287922fa8072c1)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:41.809612 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f0da4-9206-4c4b-89f4-5d032254f46f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:41.857635 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d66f0da4-9206-4c4b-89f4-5d032254f46f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16d4156058ed4e3a8c287922fa8072c1'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:41.864295 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d66f0da4-9206-4c4b-89f4-5d032254f46f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16d4156058ed4e3a8c287922fa8072c1'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:41.877047 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d66f0da4-9206-4c4b-89f4-5d032254f46f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16d4156058ed4e3a8c287922fa8072c1'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:41.877757 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d66f0da4-9206-4c4b-89f4-5d032254f46f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16d4156058ed4e3a8c287922fa8072c1'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:41.878430 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d66f0da4-9206-4c4b-89f4-5d032254f46f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16d4156058ed4e3a8c287922fa8072c1'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:41.892807 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1346/2680] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:36:41 2022] DELETE /identity/v3/users/16d4156058ed4e3a8c287922fa8072c1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:36:41.897896 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943eeaa-4510-4cf4-9137-079daa75b7ad None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:41.898391 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943eeaa-4510-4cf4-9137-079daa75b7ad None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:41.898656 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943eeaa-4510-4cf4-9137-079daa75b7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:41.919878 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-4943eeaa-4510-4cf4-9137-079daa75b7ad None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:36:41.921080 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4943eeaa-4510-4cf4-9137-079daa75b7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:41.994489 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1335/2681] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:36:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:36:42.004781 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f0da4-9206-4c4b-89f4-5d032254f46f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:42.006340 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d66f0da4-9206-4c4b-89f4-5d032254f46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:42.066329 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f0da4-9206-4c4b-89f4-5d032254f46f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:42.070992 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc96974-2efd-4a7e-b04c-bb40d3a76891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:42.071704 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc96974-2efd-4a7e-b04c-bb40d3a76891 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:42.071978 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc96974-2efd-4a7e-b04c-bb40d3a76891 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:42.072216 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc96974-2efd-4a7e-b04c-bb40d3a76891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:42.081805 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc96974-2efd-4a7e-b04c-bb40d3a76891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:42.083251 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc96974-2efd-4a7e-b04c-bb40d3a76891 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:42.092787 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1347/2682] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:36:42.448154 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943eeaa-4510-4cf4-9137-079daa75b7ad None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:42.450006 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4943eeaa-4510-4cf4-9137-079daa75b7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:42.462790 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943eeaa-4510-4cf4-9137-079daa75b7ad None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:42.468446 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ef87b-f6f7-4a2b-beba-a942a379f6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:42.469470 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ef87b-f6f7-4a2b-beba-a942a379f6c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:42.469743 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ef87b-f6f7-4a2b-beba-a942a379f6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:42.470006 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ef87b-f6f7-4a2b-beba-a942a379f6c3 admin admin] PATH_INFO: `/v3/projects/4f91ef4a8c79482e90071cc13359a297` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:42.471335 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ef87b-f6f7-4a2b-beba-a942a379f6c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f91ef4a8c79482e90071cc13359a297)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:42.473227 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ef87b-f6f7-4a2b-beba-a942a379f6c3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:42.522396 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4c6ef87b-f6f7-4a2b-beba-a942a379f6c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f91ef4a8c79482e90071cc13359a297', 'request_id': 'req-4c6ef87b-f6f7-4a2b-beba-a942a379f6c3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:42.527887 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4c6ef87b-f6f7-4a2b-beba-a942a379f6c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f91ef4a8c79482e90071cc13359a297', 'request_id': 'req-4c6ef87b-f6f7-4a2b-beba-a942a379f6c3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:42.534068 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4c6ef87b-f6f7-4a2b-beba-a942a379f6c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f91ef4a8c79482e90071cc13359a297', 'request_id': 'req-4c6ef87b-f6f7-4a2b-beba-a942a379f6c3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:42.547830 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4c6ef87b-f6f7-4a2b-beba-a942a379f6c3 admin admin] The token cache is being invalidate because project 4f91ef4a8c79482e90071cc13359a297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:36:42.548112 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4c6ef87b-f6f7-4a2b-beba-a942a379f6c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:42.548726 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4c6ef87b-f6f7-4a2b-beba-a942a379f6c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:42.550314 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1336/2683] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:36:42 2022] DELETE /identity/v3/projects/4f91ef4a8c79482e90071cc13359a297 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:36:42.555930 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c80ed-1782-4350-a69d-e54e5effe28f None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:42.556220 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c80ed-1782-4350-a69d-e54e5effe28f None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:42.556494 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c80ed-1782-4350-a69d-e54e5effe28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:42.579330 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-1f0c80ed-1782-4350-a69d-e54e5effe28f None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:36:42.580459 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-1f0c80ed-1782-4350-a69d-e54e5effe28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:42.654898 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1348/2684] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:36:42.663064 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d056d34-a8dc-4abd-9235-68a4cdf41caa None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:42.663353 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d056d34-a8dc-4abd-9235-68a4cdf41caa None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:42.663620 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d056d34-a8dc-4abd-9235-68a4cdf41caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:42.684536 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7d056d34-a8dc-4abd-9235-68a4cdf41caa None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:36:42.685772 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7d056d34-a8dc-4abd-9235-68a4cdf41caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:42.695408 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1337/2685] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:36:42.699704 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c80ed-1782-4350-a69d-e54e5effe28f None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:42.709910 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c80ed-1782-4350-a69d-e54e5effe28f None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:42.715743 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab84b31-af02-4a4d-89cb-3d32dbad3250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:42.716388 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab84b31-af02-4a4d-89cb-3d32dbad3250 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:42.716660 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab84b31-af02-4a4d-89cb-3d32dbad3250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:42.716923 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab84b31-af02-4a4d-89cb-3d32dbad3250 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:42.717691 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab84b31-af02-4a4d-89cb-3d32dbad3250 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:36:42.717989 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab84b31-af02-4a4d-89cb-3d32dbad3250 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:42.719571 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab84b31-af02-4a4d-89cb-3d32dbad3250 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:42.731576 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1349/2686] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:36:42.735962 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d056d34-a8dc-4abd-9235-68a4cdf41caa None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:42.745641 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d056d34-a8dc-4abd-9235-68a4cdf41caa None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:42.751533 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ae187-c512-491d-a4ee-8cf31755be39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:42.752205 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ae187-c512-491d-a4ee-8cf31755be39 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:42.752478 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ae187-c512-491d-a4ee-8cf31755be39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:42.752740 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ae187-c512-491d-a4ee-8cf31755be39 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:42.753464 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ae187-c512-491d-a4ee-8cf31755be39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:42.755421 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ae187-c512-491d-a4ee-8cf31755be39 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:42.783516 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1338/2687] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:36:42 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:36:42.788188 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab84b31-af02-4a4d-89cb-3d32dbad3250 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:42.798327 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab84b31-af02-4a4d-89cb-3d32dbad3250 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:42.859901 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3859d4-5ff5-4957-8e52-5e2e53c051ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:42.860494 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3859d4-5ff5-4957-8e52-5e2e53c051ad admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:42.860775 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3859d4-5ff5-4957-8e52-5e2e53c051ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:42.861046 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3859d4-5ff5-4957-8e52-5e2e53c051ad admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:42.861768 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3859d4-5ff5-4957-8e52-5e2e53c051ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:42.863743 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3859d4-5ff5-4957-8e52-5e2e53c051ad admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:42.886148 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1350/2688] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:36:42 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:36:42.891305 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ae187-c512-491d-a4ee-8cf31755be39 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:42.901866 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ae187-c512-491d-a4ee-8cf31755be39 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:42.907563 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a30c40-c8a1-436a-b44e-244734fb9132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:42.908214 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a30c40-c8a1-436a-b44e-244734fb9132 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:42.908485 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a30c40-c8a1-436a-b44e-244734fb9132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:42.908773 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a30c40-c8a1-436a-b44e-244734fb9132 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:42.909563 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a30c40-c8a1-436a-b44e-244734fb9132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:42.911127 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a30c40-c8a1-436a-b44e-244734fb9132 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:42.921564 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1339/2689] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:36:42.925507 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3859d4-5ff5-4957-8e52-5e2e53c051ad admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:42.936294 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3859d4-5ff5-4957-8e52-5e2e53c051ad admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:42.942294 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6031a-72ef-40f5-abee-1c67f134f05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:42.942934 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6031a-72ef-40f5-abee-1c67f134f05d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:42.943206 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6031a-72ef-40f5-abee-1c67f134f05d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:42.943468 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6031a-72ef-40f5-abee-1c67f134f05d admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:42.944189 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6031a-72ef-40f5-abee-1c67f134f05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:42.945796 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6031a-72ef-40f5-abee-1c67f134f05d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:42.956089 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1351/2690] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:36:42.960165 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a30c40-c8a1-436a-b44e-244734fb9132 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:42.970437 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a30c40-c8a1-436a-b44e-244734fb9132 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:42.976308 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4417c5-f461-484a-9c51-22446e43dd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:42.977174 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4417c5-f461-484a-9c51-22446e43dd45 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:42.977491 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4417c5-f461-484a-9c51-22446e43dd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:42.977755 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4417c5-f461-484a-9c51-22446e43dd45 admin admin] PATH_INFO: `/v3/projects/193378226a3e4e08833a0e4fa5455176/users/543db548dc1342209b3a250dafe05725/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:42.993410 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4417c5-f461-484a-9c51-22446e43dd45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=193378226a3e4e08833a0e4fa5455176, user_id=543db548dc1342209b3a250dafe05725, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:42.996067 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4417c5-f461-484a-9c51-22446e43dd45 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:43.012304 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1340/2691] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:36:42 2022] PUT /identity/v3/projects/193378226a3e4e08833a0e4fa5455176/users/543db548dc1342209b3a250dafe05725/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:36:43.017677 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d7c40-fe3b-4f8e-bb9e-d3b5385cfc02 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:43.017964 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d7c40-fe3b-4f8e-bb9e-d3b5385cfc02 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:43.018230 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d7c40-fe3b-4f8e-bb9e-d3b5385cfc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:43.036003 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-510d7c40-fe3b-4f8e-bb9e-d3b5385cfc02 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:36:43.037171 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-510d7c40-fe3b-4f8e-bb9e-d3b5385cfc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:43.107396 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1352/2692] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:36:43.117402 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4417c5-f461-484a-9c51-22446e43dd45 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:43.119189 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-de4417c5-f461-484a-9c51-22446e43dd45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:43.174353 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4417c5-f461-484a-9c51-22446e43dd45 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:43.179411 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e0ab6-2974-422d-8d4f-c8aa148c136a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:43.180075 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e0ab6-2974-422d-8d4f-c8aa148c136a service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:43.180378 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e0ab6-2974-422d-8d4f-c8aa148c136a service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:43.180640 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e0ab6-2974-422d-8d4f-c8aa148c136a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:43.190278 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e0ab6-2974-422d-8d4f-c8aa148c136a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:43.191700 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e0ab6-2974-422d-8d4f-c8aa148c136a service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:43.200911 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1341/2693] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:36:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:36:43.807748 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a968c01-da6f-4d1d-a367-eefee35a1741 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:43.808274 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a968c01-da6f-4d1d-a367-eefee35a1741 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:43.808475 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a968c01-da6f-4d1d-a367-eefee35a1741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:43.835841 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-6a968c01-da6f-4d1d-a367-eefee35a1741 None None] MFA Rules not processed for user `543db548dc1342209b3a250dafe05725`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:36:43.837127 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-6a968c01-da6f-4d1d-a367-eefee35a1741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:43.907594 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1353/2694] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:36:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:36:43.912499 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e0ab6-2974-422d-8d4f-c8aa148c136a service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:43.922358 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e0ab6-2974-422d-8d4f-c8aa148c136a service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:43.927319 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388c5ac-02ae-41ed-80f2-b1bc4371f88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:43.928031 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388c5ac-02ae-41ed-80f2-b1bc4371f88b admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:43.928318 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388c5ac-02ae-41ed-80f2-b1bc4371f88b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:43.928552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388c5ac-02ae-41ed-80f2-b1bc4371f88b admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:43.929271 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388c5ac-02ae-41ed-80f2-b1bc4371f88b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:43.931261 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388c5ac-02ae-41ed-80f2-b1bc4371f88b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:43.956808 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1342/2695] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:36:43 2022] POST /identity/v3/projects => generated 405 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 21:36:43.961031 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a968c01-da6f-4d1d-a367-eefee35a1741 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:43.971953 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a968c01-da6f-4d1d-a367-eefee35a1741 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:44.027112 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470706f-454f-469f-af9b-154e7c917b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:44.027773 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470706f-454f-469f-af9b-154e7c917b50 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:44.028052 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470706f-454f-469f-af9b-154e7c917b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:44.028317 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470706f-454f-469f-af9b-154e7c917b50 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:44.029009 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470706f-454f-469f-af9b-154e7c917b50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:44.030946 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470706f-454f-469f-af9b-154e7c917b50 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:44.049441 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1354/2696] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:36:43 2022] POST /identity/v3/users => generated 309 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:36:44.053953 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388c5ac-02ae-41ed-80f2-b1bc4371f88b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:44.064718 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388c5ac-02ae-41ed-80f2-b1bc4371f88b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:44.070616 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641b563-0248-410e-91bb-f20d4965ebd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:44.071304 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641b563-0248-410e-91bb-f20d4965ebd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:44.071586 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641b563-0248-410e-91bb-f20d4965ebd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:44.071885 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641b563-0248-410e-91bb-f20d4965ebd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:44.072650 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641b563-0248-410e-91bb-f20d4965ebd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:44.074385 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641b563-0248-410e-91bb-f20d4965ebd8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:44.085679 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1343/2697] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:36:44.089745 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470706f-454f-469f-af9b-154e7c917b50 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:44.099720 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470706f-454f-469f-af9b-154e7c917b50 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:44.105180 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01d29f-5072-41d0-bf70-48ab805b3e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:44.106065 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01d29f-5072-41d0-bf70-48ab805b3e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:44.106339 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01d29f-5072-41d0-bf70-48ab805b3e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:44.106602 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01d29f-5072-41d0-bf70-48ab805b3e14 admin admin] PATH_INFO: `/v3/projects/b9f9df0780254509b2c93f8959c09fdb/users/fbf72492f2d34224bc6bd37cfc20d825/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:44.120952 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01d29f-5072-41d0-bf70-48ab805b3e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f9df0780254509b2c93f8959c09fdb, user_id=fbf72492f2d34224bc6bd37cfc20d825, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:44.123626 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01d29f-5072-41d0-bf70-48ab805b3e14 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:44.137724 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1355/2698] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:36:44 2022] PUT /identity/v3/projects/b9f9df0780254509b2c93f8959c09fdb/users/fbf72492f2d34224bc6bd37cfc20d825/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 21:36:44.141790 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641b563-0248-410e-91bb-f20d4965ebd8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:44.151549 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641b563-0248-410e-91bb-f20d4965ebd8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:44.207168 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54676549-232b-4bcd-8d80-396470bc87e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:44.207829 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54676549-232b-4bcd-8d80-396470bc87e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:44.208104 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54676549-232b-4bcd-8d80-396470bc87e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:44.208370 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54676549-232b-4bcd-8d80-396470bc87e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:44.209097 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54676549-232b-4bcd-8d80-396470bc87e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:44.210695 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54676549-232b-4bcd-8d80-396470bc87e3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:44.220997 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1344/2699] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:36:44.225494 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01d29f-5072-41d0-bf70-48ab805b3e14 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:44.235972 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01d29f-5072-41d0-bf70-48ab805b3e14 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:44.240856 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dcacda-b79c-498c-a18f-ef8d1b0867e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:44.241764 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcacda-b79c-498c-a18f-ef8d1b0867e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:44.242072 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcacda-b79c-498c-a18f-ef8d1b0867e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:44.242344 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcacda-b79c-498c-a18f-ef8d1b0867e8 admin admin] PATH_INFO: `/v3/projects/b9f9df0780254509b2c93f8959c09fdb/users/fbf72492f2d34224bc6bd37cfc20d825/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:44.244360 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dcacda-b79c-498c-a18f-ef8d1b0867e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f9df0780254509b2c93f8959c09fdb, user_id=fbf72492f2d34224bc6bd37cfc20d825, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:44.247009 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dcacda-b79c-498c-a18f-ef8d1b0867e8 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:44.257289 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1356/2700] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:36:44 2022] PUT /identity/v3/projects/b9f9df0780254509b2c93f8959c09fdb/users/fbf72492f2d34224bc6bd37cfc20d825/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:36:44.886959 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1cfc6-1dd2-4e8c-801a-926bfc74c9bf None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:44.887249 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1cfc6-1dd2-4e8c-801a-926bfc74c9bf None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:44.887511 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1cfc6-1dd2-4e8c-801a-926bfc74c9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:44.917583 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-61e1cfc6-1dd2-4e8c-801a-926bfc74c9bf None None] MFA Rules not processed for user `fbf72492f2d34224bc6bd37cfc20d825`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:36:44.918876 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-61e1cfc6-1dd2-4e8c-801a-926bfc74c9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:44.998853 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1345/2701] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:36:44 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:36:46.064450 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dcacda-b79c-498c-a18f-ef8d1b0867e8 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:46.128588 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dcacda-b79c-498c-a18f-ef8d1b0867e8 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:46.133572 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1e812-ea98-4bda-ad8f-f05b4cfefbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:46.134689 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1e812-ea98-4bda-ad8f-f05b4cfefbee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:46.135006 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1e812-ea98-4bda-ad8f-f05b4cfefbee admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:46.135254 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1e812-ea98-4bda-ad8f-f05b4cfefbee admin admin] PATH_INFO: `/v3/users/543db548dc1342209b3a250dafe05725` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:46.136572 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1e812-ea98-4bda-ad8f-f05b4cfefbee admin admin] RBAC: Authorizing `identity:delete_user(user_id=543db548dc1342209b3a250dafe05725)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:46.138622 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1e812-ea98-4bda-ad8f-f05b4cfefbee admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:46.193785 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-50d1e812-ea98-4bda-ad8f-f05b4cfefbee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '543db548dc1342209b3a250dafe05725'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:46.202234 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-50d1e812-ea98-4bda-ad8f-f05b4cfefbee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '543db548dc1342209b3a250dafe05725'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:46.217079 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-50d1e812-ea98-4bda-ad8f-f05b4cfefbee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '543db548dc1342209b3a250dafe05725'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:46.217816 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-50d1e812-ea98-4bda-ad8f-f05b4cfefbee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '543db548dc1342209b3a250dafe05725'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:46.218479 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-50d1e812-ea98-4bda-ad8f-f05b4cfefbee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '543db548dc1342209b3a250dafe05725'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:46.233998 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1357/2702] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:36:46 2022] DELETE /identity/v3/users/543db548dc1342209b3a250dafe05725 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:36:46.423007 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1cfc6-1dd2-4e8c-801a-926bfc74c9bf None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:46.434458 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1cfc6-1dd2-4e8c-801a-926bfc74c9bf None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:46.489651 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ed61d-c713-4497-a169-e7784c4b0c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:46.490510 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ed61d-c713-4497-a169-e7784c4b0c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:46.490774 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ed61d-c713-4497-a169-e7784c4b0c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:46.491074 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ed61d-c713-4497-a169-e7784c4b0c0e admin admin] PATH_INFO: `/v3/projects/193378226a3e4e08833a0e4fa5455176` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:46.492326 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ed61d-c713-4497-a169-e7784c4b0c0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=193378226a3e4e08833a0e4fa5455176)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:46.494360 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ed61d-c713-4497-a169-e7784c4b0c0e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:46.542203 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d51ed61d-c713-4497-a169-e7784c4b0c0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '193378226a3e4e08833a0e4fa5455176', 'request_id': 'req-d51ed61d-c713-4497-a169-e7784c4b0c0e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:46.547804 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d51ed61d-c713-4497-a169-e7784c4b0c0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '193378226a3e4e08833a0e4fa5455176', 'request_id': 'req-d51ed61d-c713-4497-a169-e7784c4b0c0e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:46.554582 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d51ed61d-c713-4497-a169-e7784c4b0c0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '193378226a3e4e08833a0e4fa5455176', 'request_id': 'req-d51ed61d-c713-4497-a169-e7784c4b0c0e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:46.569201 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d51ed61d-c713-4497-a169-e7784c4b0c0e admin admin] The token cache is being invalidate because project 193378226a3e4e08833a0e4fa5455176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:36:46.569647 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d51ed61d-c713-4497-a169-e7784c4b0c0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:46.570472 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d51ed61d-c713-4497-a169-e7784c4b0c0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:46.572512 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1346/2703] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:36:46 2022] DELETE /identity/v3/projects/193378226a3e4e08833a0e4fa5455176 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:36:46.576517 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1e812-ea98-4bda-ad8f-f05b4cfefbee admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:46.578056 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-50d1e812-ea98-4bda-ad8f-f05b4cfefbee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:46.593154 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1e812-ea98-4bda-ad8f-f05b4cfefbee admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:46.655432 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2bbb3-48e6-4316-9739-a8c060203506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:46.656303 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2bbb3-48e6-4316-9739-a8c060203506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:46.656586 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2bbb3-48e6-4316-9739-a8c060203506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:46.656857 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2bbb3-48e6-4316-9739-a8c060203506 admin admin] PATH_INFO: `/v3/users/fbf72492f2d34224bc6bd37cfc20d825` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:46.658059 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e2bbb3-48e6-4316-9739-a8c060203506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf72492f2d34224bc6bd37cfc20d825)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:46.659989 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e2bbb3-48e6-4316-9739-a8c060203506 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:46.713599 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-54e2bbb3-48e6-4316-9739-a8c060203506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf72492f2d34224bc6bd37cfc20d825'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:46.720505 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-54e2bbb3-48e6-4316-9739-a8c060203506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf72492f2d34224bc6bd37cfc20d825'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:46.731705 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-54e2bbb3-48e6-4316-9739-a8c060203506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf72492f2d34224bc6bd37cfc20d825'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:46.732381 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-54e2bbb3-48e6-4316-9739-a8c060203506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf72492f2d34224bc6bd37cfc20d825'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:46.733015 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-54e2bbb3-48e6-4316-9739-a8c060203506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf72492f2d34224bc6bd37cfc20d825'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:46.747263 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1358/2704] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:36:46 2022] DELETE /identity/v3/users/fbf72492f2d34224bc6bd37cfc20d825 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:36:46.929942 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ed61d-c713-4497-a169-e7784c4b0c0e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:46.931436 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d51ed61d-c713-4497-a169-e7784c4b0c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:46.944424 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ed61d-c713-4497-a169-e7784c4b0c0e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:47.000824 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd428d82-6a0c-4f04-91f1-94717327a578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:47.001905 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd428d82-6a0c-4f04-91f1-94717327a578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:47.002332 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd428d82-6a0c-4f04-91f1-94717327a578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:47.002884 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd428d82-6a0c-4f04-91f1-94717327a578 admin admin] PATH_INFO: `/v3/projects/b9f9df0780254509b2c93f8959c09fdb` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:47.004257 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd428d82-6a0c-4f04-91f1-94717327a578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f9df0780254509b2c93f8959c09fdb)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:47.006216 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd428d82-6a0c-4f04-91f1-94717327a578 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:47.052925 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-cd428d82-6a0c-4f04-91f1-94717327a578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f9df0780254509b2c93f8959c09fdb', 'request_id': 'req-cd428d82-6a0c-4f04-91f1-94717327a578'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:47.058221 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-cd428d82-6a0c-4f04-91f1-94717327a578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f9df0780254509b2c93f8959c09fdb', 'request_id': 'req-cd428d82-6a0c-4f04-91f1-94717327a578'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:47.064126 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-cd428d82-6a0c-4f04-91f1-94717327a578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f9df0780254509b2c93f8959c09fdb', 'request_id': 'req-cd428d82-6a0c-4f04-91f1-94717327a578'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:47.077259 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-cd428d82-6a0c-4f04-91f1-94717327a578 admin admin] The token cache is being invalidate because project b9f9df0780254509b2c93f8959c09fdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:36:47.077568 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-cd428d82-6a0c-4f04-91f1-94717327a578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:47.078195 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-cd428d82-6a0c-4f04-91f1-94717327a578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:47.079744 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1347/2705] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:36:46 2022] DELETE /identity/v3/projects/b9f9df0780254509b2c93f8959c09fdb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:36:47.084773 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b9392-f7fc-4ffa-bbbf-aa43ca471ba7 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:47.085241 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b9392-f7fc-4ffa-bbbf-aa43ca471ba7 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:47.085311 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b9392-f7fc-4ffa-bbbf-aa43ca471ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:47.105190 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-a76b9392-f7fc-4ffa-bbbf-aa43ca471ba7 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:36:47.106679 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-a76b9392-f7fc-4ffa-bbbf-aa43ca471ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:47.301700 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1359/2706] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:36:47.309644 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f8177-d095-47f8-a6ec-c722dda51132 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:47.309929 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f8177-d095-47f8-a6ec-c722dda51132 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:47.310189 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f8177-d095-47f8-a6ec-c722dda51132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:47.329044 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-a37f8177-d095-47f8-a6ec-c722dda51132 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:36:47.330258 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a37f8177-d095-47f8-a6ec-c722dda51132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:47.339730 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1348/2707] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:36:47.344041 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b9392-f7fc-4ffa-bbbf-aa43ca471ba7 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:47.353943 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b9392-f7fc-4ffa-bbbf-aa43ca471ba7 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:47.358845 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c7ac8-b4d9-4cbf-b391-608435fcb1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:47.359498 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c7ac8-b4d9-4cbf-b391-608435fcb1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:47.359776 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c7ac8-b4d9-4cbf-b391-608435fcb1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:47.360054 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c7ac8-b4d9-4cbf-b391-608435fcb1f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:47.360783 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c7ac8-b4d9-4cbf-b391-608435fcb1f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:36:47.361078 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c7ac8-b4d9-4cbf-b391-608435fcb1f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:47.362724 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c7ac8-b4d9-4cbf-b391-608435fcb1f5 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:47.374431 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1360/2708] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:36:47.378620 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f8177-d095-47f8-a6ec-c722dda51132 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:47.388062 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f8177-d095-47f8-a6ec-c722dda51132 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:47.393773 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6273b8-950f-4efc-b77a-94a6265ee193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:47.394418 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6273b8-950f-4efc-b77a-94a6265ee193 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:47.394692 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6273b8-950f-4efc-b77a-94a6265ee193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:47.394978 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6273b8-950f-4efc-b77a-94a6265ee193 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:47.395669 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6273b8-950f-4efc-b77a-94a6265ee193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:47.397654 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6273b8-950f-4efc-b77a-94a6265ee193 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:47.426560 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1349/2709] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:36:47 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:36:47.431338 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c7ac8-b4d9-4cbf-b391-608435fcb1f5 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:47.442259 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c7ac8-b4d9-4cbf-b391-608435fcb1f5 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:47.499033 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19420ffb-64f3-46a9-8913-41109030f04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:47.499696 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19420ffb-64f3-46a9-8913-41109030f04d admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:47.499975 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19420ffb-64f3-46a9-8913-41109030f04d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:47.500246 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19420ffb-64f3-46a9-8913-41109030f04d admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:47.500914 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19420ffb-64f3-46a9-8913-41109030f04d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:47.502884 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19420ffb-64f3-46a9-8913-41109030f04d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:47.526028 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1361/2710] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:36:47 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 21:36:47.530276 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6273b8-950f-4efc-b77a-94a6265ee193 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:47.541310 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6273b8-950f-4efc-b77a-94a6265ee193 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:47.546968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4ab18-246f-4abd-a844-2a7e2ebefdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:47.547654 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4ab18-246f-4abd-a844-2a7e2ebefdcd admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:47.547968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4ab18-246f-4abd-a844-2a7e2ebefdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:47.548234 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4ab18-246f-4abd-a844-2a7e2ebefdcd admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:47.548965 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4ab18-246f-4abd-a844-2a7e2ebefdcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:47.550583 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4ab18-246f-4abd-a844-2a7e2ebefdcd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:47.561954 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1350/2711] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:36:47.566088 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19420ffb-64f3-46a9-8913-41109030f04d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:47.576281 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19420ffb-64f3-46a9-8913-41109030f04d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:47.581834 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aab1f8-1430-4f2d-935d-c3fef1e43fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:47.582486 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aab1f8-1430-4f2d-935d-c3fef1e43fab admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:47.582760 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aab1f8-1430-4f2d-935d-c3fef1e43fab admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:47.583027 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aab1f8-1430-4f2d-935d-c3fef1e43fab admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:47.583737 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aab1f8-1430-4f2d-935d-c3fef1e43fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:47.585370 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aab1f8-1430-4f2d-935d-c3fef1e43fab admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:47.595858 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1362/2712] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:36:47.599993 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4ab18-246f-4abd-a844-2a7e2ebefdcd admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:47.610153 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4ab18-246f-4abd-a844-2a7e2ebefdcd admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:47.615336 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a63d1e-7eca-4221-abd6-d9cbcee48412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:47.616471 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a63d1e-7eca-4221-abd6-d9cbcee48412 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:47.616747 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a63d1e-7eca-4221-abd6-d9cbcee48412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:47.617048 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a63d1e-7eca-4221-abd6-d9cbcee48412 admin admin] PATH_INFO: `/v3/projects/1feb608b9cf24d3e8a80b4986ea4d0d9/users/d8a03f72705642b787c169b2677de2a2/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:47.632044 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a63d1e-7eca-4221-abd6-d9cbcee48412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1feb608b9cf24d3e8a80b4986ea4d0d9, user_id=d8a03f72705642b787c169b2677de2a2, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:47.634759 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a63d1e-7eca-4221-abd6-d9cbcee48412 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:47.650135 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1351/2713] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:36:47 2022] PUT /identity/v3/projects/1feb608b9cf24d3e8a80b4986ea4d0d9/users/d8a03f72705642b787c169b2677de2a2/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:36:47.660519 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12efcf-716b-42da-86f6-9cbd7877c9c4 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:47.660835 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12efcf-716b-42da-86f6-9cbd7877c9c4 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:47.661106 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12efcf-716b-42da-86f6-9cbd7877c9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:47.689187 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-fe12efcf-716b-42da-86f6-9cbd7877c9c4 None None] MFA Rules not processed for user `d8a03f72705642b787c169b2677de2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:36:47.690454 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-fe12efcf-716b-42da-86f6-9cbd7877c9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:47.757603 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1363/2714] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:36:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:36:47.762441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a63d1e-7eca-4221-abd6-d9cbcee48412 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:47.826525 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a63d1e-7eca-4221-abd6-d9cbcee48412 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:47.831911 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbda68-2e62-4f71-b48d-da9f9ffecca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:47.832554 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbda68-2e62-4f71-b48d-da9f9ffecca5 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:47.832833 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbda68-2e62-4f71-b48d-da9f9ffecca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:47.833096 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbda68-2e62-4f71-b48d-da9f9ffecca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:47.833824 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbda68-2e62-4f71-b48d-da9f9ffecca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:47.835728 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbda68-2e62-4f71-b48d-da9f9ffecca5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:47.868187 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1352/2715] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:36:47 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 21:36:47.872288 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12efcf-716b-42da-86f6-9cbd7877c9c4 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:47.882764 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12efcf-716b-42da-86f6-9cbd7877c9c4 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:47.936216 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6824c46-4428-4e95-adaa-b1f282e97e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:47.936871 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6824c46-4428-4e95-adaa-b1f282e97e23 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:47.937141 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6824c46-4428-4e95-adaa-b1f282e97e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:47.937423 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6824c46-4428-4e95-adaa-b1f282e97e23 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:47.938117 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6824c46-4428-4e95-adaa-b1f282e97e23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:47.939988 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6824c46-4428-4e95-adaa-b1f282e97e23 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:47.961487 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1364/2716] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:36:47 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 21:36:47.967245 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbda68-2e62-4f71-b48d-da9f9ffecca5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:47.980761 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbda68-2e62-4f71-b48d-da9f9ffecca5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:47.986374 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77239d37-35e5-4770-bdcf-224e0dff0f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:47.987029 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77239d37-35e5-4770-bdcf-224e0dff0f90 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:47.987309 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77239d37-35e5-4770-bdcf-224e0dff0f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:47.987578 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77239d37-35e5-4770-bdcf-224e0dff0f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:47.988314 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77239d37-35e5-4770-bdcf-224e0dff0f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:47.989961 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77239d37-35e5-4770-bdcf-224e0dff0f90 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:48.001098 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1353/2717] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:36:48.005333 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6824c46-4428-4e95-adaa-b1f282e97e23 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:48.015709 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6824c46-4428-4e95-adaa-b1f282e97e23 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:48.021264 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5e7f9-c829-482d-9ae9-665ab93cb9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:48.022178 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5e7f9-c829-482d-9ae9-665ab93cb9d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:48.022467 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5e7f9-c829-482d-9ae9-665ab93cb9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:48.022733 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5e7f9-c829-482d-9ae9-665ab93cb9d2 admin admin] PATH_INFO: `/v3/projects/0249663bd5fc48c3815ecd99491f39c4/users/d5b710c64b8f4820bf9e52aeea4eb818/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:48.038482 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5e7f9-c829-482d-9ae9-665ab93cb9d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0249663bd5fc48c3815ecd99491f39c4, user_id=d5b710c64b8f4820bf9e52aeea4eb818, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:48.041109 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5e7f9-c829-482d-9ae9-665ab93cb9d2 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:48.056961 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1365/2718] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:36:48 2022] PUT /identity/v3/projects/0249663bd5fc48c3815ecd99491f39c4/users/d5b710c64b8f4820bf9e52aeea4eb818/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:36:48.062753 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77239d37-35e5-4770-bdcf-224e0dff0f90 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:48.074919 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77239d37-35e5-4770-bdcf-224e0dff0f90 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:48.135108 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4fb9f-48a3-466f-bf50-da6133e9125f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:48.135682 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4fb9f-48a3-466f-bf50-da6133e9125f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:48.135958 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4fb9f-48a3-466f-bf50-da6133e9125f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:48.136227 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4fb9f-48a3-466f-bf50-da6133e9125f admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:48.136948 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4fb9f-48a3-466f-bf50-da6133e9125f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:48.138564 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4fb9f-48a3-466f-bf50-da6133e9125f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:48.148144 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1354/2719] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:36:48.152318 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5e7f9-c829-482d-9ae9-665ab93cb9d2 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:48.162647 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5e7f9-c829-482d-9ae9-665ab93cb9d2 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:48.167810 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2286ed-9375-4783-b6c0-4ec4c473f332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:48.168685 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2286ed-9375-4783-b6c0-4ec4c473f332 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:48.168962 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2286ed-9375-4783-b6c0-4ec4c473f332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:48.169232 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2286ed-9375-4783-b6c0-4ec4c473f332 admin admin] PATH_INFO: `/v3/projects/0249663bd5fc48c3815ecd99491f39c4/users/d5b710c64b8f4820bf9e52aeea4eb818/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:48.171292 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2286ed-9375-4783-b6c0-4ec4c473f332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0249663bd5fc48c3815ecd99491f39c4, user_id=d5b710c64b8f4820bf9e52aeea4eb818, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:48.173943 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2286ed-9375-4783-b6c0-4ec4c473f332 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:48.184911 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1366/2720] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:36:48 2022] PUT /identity/v3/projects/0249663bd5fc48c3815ecd99491f39c4/users/d5b710c64b8f4820bf9e52aeea4eb818/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:36:48.196219 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab19199-c7a7-4fa6-be91-20dd9bd3c797 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:48.196478 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab19199-c7a7-4fa6-be91-20dd9bd3c797 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:48.196787 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab19199-c7a7-4fa6-be91-20dd9bd3c797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:48.223922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-9ab19199-c7a7-4fa6-be91-20dd9bd3c797 None None] MFA Rules not processed for user `d5b710c64b8f4820bf9e52aeea4eb818`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:36:48.225091 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9ab19199-c7a7-4fa6-be91-20dd9bd3c797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:48.291270 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1355/2721] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:36:48 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:36:48.301749 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2286ed-9375-4783-b6c0-4ec4c473f332 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:48.303730 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-bc2286ed-9375-4783-b6c0-4ec4c473f332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:48.358495 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2286ed-9375-4783-b6c0-4ec4c473f332 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:48.362482 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0d4a6-0d05-430f-a3c3-5c054420579c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:48.363108 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0d4a6-0d05-430f-a3c3-5c054420579c service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:48.363353 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0d4a6-0d05-430f-a3c3-5c054420579c service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:48.363615 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0d4a6-0d05-430f-a3c3-5c054420579c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:48.372848 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0d4a6-0d05-430f-a3c3-5c054420579c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:48.374289 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0d4a6-0d05-430f-a3c3-5c054420579c service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:48.383968 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1367/2722] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:36:48 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:36:48.760926 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab19199-c7a7-4fa6-be91-20dd9bd3c797 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:48.826061 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab19199-c7a7-4fa6-be91-20dd9bd3c797 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:48.834345 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632621fe-c191-4cdd-914a-e84fa88a84e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:48.835384 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632621fe-c191-4cdd-914a-e84fa88a84e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:48.835659 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632621fe-c191-4cdd-914a-e84fa88a84e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:48.835926 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632621fe-c191-4cdd-914a-e84fa88a84e1 admin admin] PATH_INFO: `/v3/users/d8a03f72705642b787c169b2677de2a2` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:48.837277 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632621fe-c191-4cdd-914a-e84fa88a84e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8a03f72705642b787c169b2677de2a2)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:48.839217 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632621fe-c191-4cdd-914a-e84fa88a84e1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:48.887999 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-632621fe-c191-4cdd-914a-e84fa88a84e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8a03f72705642b787c169b2677de2a2'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:48.894465 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-632621fe-c191-4cdd-914a-e84fa88a84e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8a03f72705642b787c169b2677de2a2'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:48.905825 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-632621fe-c191-4cdd-914a-e84fa88a84e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8a03f72705642b787c169b2677de2a2'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:48.906478 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-632621fe-c191-4cdd-914a-e84fa88a84e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8a03f72705642b787c169b2677de2a2'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:48.916716 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-632621fe-c191-4cdd-914a-e84fa88a84e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8a03f72705642b787c169b2677de2a2'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:48.922683 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1356/2723] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:36:48 2022] DELETE /identity/v3/users/d8a03f72705642b787c169b2677de2a2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:36:48.927554 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e40e4e-0ea6-4976-8965-e65a0d33b48f None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:48.927838 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e40e4e-0ea6-4976-8965-e65a0d33b48f None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:48.928105 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e40e4e-0ea6-4976-8965-e65a0d33b48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:48.945043 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-48e40e4e-0ea6-4976-8965-e65a0d33b48f None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:36:48.950453 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-48e40e4e-0ea6-4976-8965-e65a0d33b48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:49.011459 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1368/2724] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:36:49.025669 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632621fe-c191-4cdd-914a-e84fa88a84e1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:49.027148 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-632621fe-c191-4cdd-914a-e84fa88a84e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:49.083578 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632621fe-c191-4cdd-914a-e84fa88a84e1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:49.087867 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768cf23-e0fa-4b6c-ac99-bd54363fc9ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:49.088496 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768cf23-e0fa-4b6c-ac99-bd54363fc9ab service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:49.088767 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768cf23-e0fa-4b6c-ac99-bd54363fc9ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:49.089028 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768cf23-e0fa-4b6c-ac99-bd54363fc9ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:49.098279 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768cf23-e0fa-4b6c-ac99-bd54363fc9ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:49.099753 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768cf23-e0fa-4b6c-ac99-bd54363fc9ab service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:49.109398 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1357/2725] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:36:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:36:49.379792 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e40e4e-0ea6-4976-8965-e65a0d33b48f None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:49.381311 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-48e40e4e-0ea6-4976-8965-e65a0d33b48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:49.395257 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e40e4e-0ea6-4976-8965-e65a0d33b48f None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:49.402734 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44192872-aed5-4541-ace9-0d39edfe5c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:49.403618 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44192872-aed5-4541-ace9-0d39edfe5c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:49.403918 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44192872-aed5-4541-ace9-0d39edfe5c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:49.404150 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44192872-aed5-4541-ace9-0d39edfe5c36 admin admin] PATH_INFO: `/v3/projects/1feb608b9cf24d3e8a80b4986ea4d0d9` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:49.405595 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44192872-aed5-4541-ace9-0d39edfe5c36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1feb608b9cf24d3e8a80b4986ea4d0d9)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:49.407571 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44192872-aed5-4541-ace9-0d39edfe5c36 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:49.464773 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-44192872-aed5-4541-ace9-0d39edfe5c36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1feb608b9cf24d3e8a80b4986ea4d0d9', 'request_id': 'req-44192872-aed5-4541-ace9-0d39edfe5c36'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:49.470584 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-44192872-aed5-4541-ace9-0d39edfe5c36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1feb608b9cf24d3e8a80b4986ea4d0d9', 'request_id': 'req-44192872-aed5-4541-ace9-0d39edfe5c36'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:49.476779 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-44192872-aed5-4541-ace9-0d39edfe5c36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1feb608b9cf24d3e8a80b4986ea4d0d9', 'request_id': 'req-44192872-aed5-4541-ace9-0d39edfe5c36'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:49.491325 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-44192872-aed5-4541-ace9-0d39edfe5c36 admin admin] The token cache is being invalidate because project 1feb608b9cf24d3e8a80b4986ea4d0d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:36:49.491607 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-44192872-aed5-4541-ace9-0d39edfe5c36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:49.492225 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-44192872-aed5-4541-ace9-0d39edfe5c36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:49.494024 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1369/2726] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:36:49 2022] DELETE /identity/v3/projects/1feb608b9cf24d3e8a80b4986ea4d0d9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:36:49.498116 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768cf23-e0fa-4b6c-ac99-bd54363fc9ab service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:49.508845 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768cf23-e0fa-4b6c-ac99-bd54363fc9ab service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:49.565481 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d468cfc-6d57-4084-b848-7fe3945f2a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:49.566460 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d468cfc-6d57-4084-b848-7fe3945f2a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:49.566799 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d468cfc-6d57-4084-b848-7fe3945f2a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:49.567132 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d468cfc-6d57-4084-b848-7fe3945f2a8d admin admin] PATH_INFO: `/v3/users/d5b710c64b8f4820bf9e52aeea4eb818` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:49.568413 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d468cfc-6d57-4084-b848-7fe3945f2a8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5b710c64b8f4820bf9e52aeea4eb818)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:49.570352 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d468cfc-6d57-4084-b848-7fe3945f2a8d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:49.618260 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-2d468cfc-6d57-4084-b848-7fe3945f2a8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5b710c64b8f4820bf9e52aeea4eb818'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:49.625949 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-2d468cfc-6d57-4084-b848-7fe3945f2a8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5b710c64b8f4820bf9e52aeea4eb818'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:49.637982 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-2d468cfc-6d57-4084-b848-7fe3945f2a8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5b710c64b8f4820bf9e52aeea4eb818'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:49.638731 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-2d468cfc-6d57-4084-b848-7fe3945f2a8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5b710c64b8f4820bf9e52aeea4eb818'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:49.647888 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-2d468cfc-6d57-4084-b848-7fe3945f2a8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5b710c64b8f4820bf9e52aeea4eb818'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:49.654652 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1358/2727] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:36:49 2022] DELETE /identity/v3/users/d5b710c64b8f4820bf9e52aeea4eb818 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:36:49.931479 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44192872-aed5-4541-ace9-0d39edfe5c36 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:49.933020 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-44192872-aed5-4541-ace9-0d39edfe5c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:49.946579 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44192872-aed5-4541-ace9-0d39edfe5c36 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:50.005230 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46c039-c332-4c08-a6ad-a664aebdcc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:50.006047 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46c039-c332-4c08-a6ad-a664aebdcc09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:50.006326 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46c039-c332-4c08-a6ad-a664aebdcc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:50.006594 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46c039-c332-4c08-a6ad-a664aebdcc09 admin admin] PATH_INFO: `/v3/projects/0249663bd5fc48c3815ecd99491f39c4` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:50.007836 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46c039-c332-4c08-a6ad-a664aebdcc09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0249663bd5fc48c3815ecd99491f39c4)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:50.009787 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46c039-c332-4c08-a6ad-a664aebdcc09 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:50.057051 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-1e46c039-c332-4c08-a6ad-a664aebdcc09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0249663bd5fc48c3815ecd99491f39c4', 'request_id': 'req-1e46c039-c332-4c08-a6ad-a664aebdcc09'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:50.062739 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-1e46c039-c332-4c08-a6ad-a664aebdcc09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0249663bd5fc48c3815ecd99491f39c4', 'request_id': 'req-1e46c039-c332-4c08-a6ad-a664aebdcc09'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:50.069190 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-1e46c039-c332-4c08-a6ad-a664aebdcc09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0249663bd5fc48c3815ecd99491f39c4', 'request_id': 'req-1e46c039-c332-4c08-a6ad-a664aebdcc09'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:50.083353 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-1e46c039-c332-4c08-a6ad-a664aebdcc09 admin admin] The token cache is being invalidate because project 0249663bd5fc48c3815ecd99491f39c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:36:50.083627 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-1e46c039-c332-4c08-a6ad-a664aebdcc09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:50.084239 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-1e46c039-c332-4c08-a6ad-a664aebdcc09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:36:50.085808 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1370/2728] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:36:49 2022] DELETE /identity/v3/projects/0249663bd5fc48c3815ecd99491f39c4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:36:50.091703 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e749d-cf96-467c-aa23-71d97a734e64 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:50.092187 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e749d-cf96-467c-aa23-71d97a734e64 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:50.092187 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e749d-cf96-467c-aa23-71d97a734e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:50.110793 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-1e4e749d-cf96-467c-aa23-71d97a734e64 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:36:50.111986 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1e4e749d-cf96-467c-aa23-71d97a734e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:50.168366 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1359/2729] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:36:50.177285 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195599c-9fd8-4349-9582-7f0366a195ea None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:50.177626 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195599c-9fd8-4349-9582-7f0366a195ea None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:50.177892 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195599c-9fd8-4349-9582-7f0366a195ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:50.198251 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-9195599c-9fd8-4349-9582-7f0366a195ea None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:36:50.199451 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-9195599c-9fd8-4349-9582-7f0366a195ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:50.207880 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1371/2730] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:36:50.212227 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e749d-cf96-467c-aa23-71d97a734e64 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:50.221955 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e749d-cf96-467c-aa23-71d97a734e64 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:50.227265 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb7703-e7d6-4f6d-bea1-95b4aad88800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:50.227913 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb7703-e7d6-4f6d-bea1-95b4aad88800 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:50.228190 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb7703-e7d6-4f6d-bea1-95b4aad88800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:50.228458 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb7703-e7d6-4f6d-bea1-95b4aad88800 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:50.229294 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb7703-e7d6-4f6d-bea1-95b4aad88800 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:36:50.229617 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb7703-e7d6-4f6d-bea1-95b4aad88800 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:50.231206 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb7703-e7d6-4f6d-bea1-95b4aad88800 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:50.242581 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1360/2731] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:36:50.247026 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195599c-9fd8-4349-9582-7f0366a195ea None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:50.256178 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195599c-9fd8-4349-9582-7f0366a195ea None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:50.260995 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45958e0-af20-47be-bffe-e04e92ccf23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:50.261673 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45958e0-af20-47be-bffe-e04e92ccf23f admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:50.261960 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45958e0-af20-47be-bffe-e04e92ccf23f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:50.262239 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45958e0-af20-47be-bffe-e04e92ccf23f admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:50.262926 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45958e0-af20-47be-bffe-e04e92ccf23f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:50.264810 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45958e0-af20-47be-bffe-e04e92ccf23f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:50.292578 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1372/2732] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:36:50 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:36:50.296892 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb7703-e7d6-4f6d-bea1-95b4aad88800 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:50.307374 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb7703-e7d6-4f6d-bea1-95b4aad88800 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:50.360945 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a8cae-9930-4e1a-a8d7-05f832c35696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:50.361667 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a8cae-9930-4e1a-a8d7-05f832c35696 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:50.361946 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a8cae-9930-4e1a-a8d7-05f832c35696 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:50.362239 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a8cae-9930-4e1a-a8d7-05f832c35696 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:50.362927 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a8cae-9930-4e1a-a8d7-05f832c35696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:50.364807 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a8cae-9930-4e1a-a8d7-05f832c35696 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:50.386299 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1361/2733] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:36:50 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:36:50.390398 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45958e0-af20-47be-bffe-e04e92ccf23f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:50.402514 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45958e0-af20-47be-bffe-e04e92ccf23f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:50.408218 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8ef22-0005-49d2-955d-cfb85760e053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:50.408874 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8ef22-0005-49d2-955d-cfb85760e053 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:50.409149 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8ef22-0005-49d2-955d-cfb85760e053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:50.409443 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8ef22-0005-49d2-955d-cfb85760e053 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:50.410171 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8ef22-0005-49d2-955d-cfb85760e053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:50.411772 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8ef22-0005-49d2-955d-cfb85760e053 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:50.422312 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1373/2734] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:36:50.426723 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a8cae-9930-4e1a-a8d7-05f832c35696 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:50.439868 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a8cae-9930-4e1a-a8d7-05f832c35696 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:50.448665 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a88e1-d2de-4962-b606-e7407331bd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:50.449640 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a88e1-d2de-4962-b606-e7407331bd65 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:50.449994 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a88e1-d2de-4962-b606-e7407331bd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:50.450352 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a88e1-d2de-4962-b606-e7407331bd65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:50.451450 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a88e1-d2de-4962-b606-e7407331bd65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:50.453956 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a88e1-d2de-4962-b606-e7407331bd65 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:50.464985 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1362/2735] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:36:50.469305 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8ef22-0005-49d2-955d-cfb85760e053 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:50.480551 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8ef22-0005-49d2-955d-cfb85760e053 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:50.486052 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91c8cd-3997-4494-8be0-989dbdddbbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:50.486959 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91c8cd-3997-4494-8be0-989dbdddbbfe admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:50.487386 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91c8cd-3997-4494-8be0-989dbdddbbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:50.487668 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91c8cd-3997-4494-8be0-989dbdddbbfe admin admin] PATH_INFO: `/v3/projects/3a4632fe4b554ef9a435688295d888df/users/0a448d8b91c7493791319de24396b2c9/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:50.503706 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91c8cd-3997-4494-8be0-989dbdddbbfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4632fe4b554ef9a435688295d888df, user_id=0a448d8b91c7493791319de24396b2c9, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:50.506410 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91c8cd-3997-4494-8be0-989dbdddbbfe admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:50.519594 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1374/2736] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:36:50 2022] PUT /identity/v3/projects/3a4632fe4b554ef9a435688295d888df/users/0a448d8b91c7493791319de24396b2c9/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:36:50.524757 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34d691-8c29-4818-b1f0-f59f36002615 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:50.525044 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34d691-8c29-4818-b1f0-f59f36002615 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:50.525316 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34d691-8c29-4818-b1f0-f59f36002615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:50.543983 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7e34d691-8c29-4818-b1f0-f59f36002615 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:36:50.544922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7e34d691-8c29-4818-b1f0-f59f36002615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:50.601265 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1363/2737] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:36:50.611195 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91c8cd-3997-4494-8be0-989dbdddbbfe admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:50.612909 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ef91c8cd-3997-4494-8be0-989dbdddbbfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:50.671357 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91c8cd-3997-4494-8be0-989dbdddbbfe admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:50.675267 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abdc8d-ddcf-4363-aa95-bde5ded64229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:50.676453 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abdc8d-ddcf-4363-aa95-bde5ded64229 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:50.676761 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abdc8d-ddcf-4363-aa95-bde5ded64229 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:50.677090 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abdc8d-ddcf-4363-aa95-bde5ded64229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:50.686591 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abdc8d-ddcf-4363-aa95-bde5ded64229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:50.688007 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abdc8d-ddcf-4363-aa95-bde5ded64229 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:50.697142 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1375/2738] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:36:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:36:51.293142 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7218aa-9a31-4a32-ac0e-c8ce4cd44f96 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:51.293772 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7218aa-9a31-4a32-ac0e-c8ce4cd44f96 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:51.293772 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7218aa-9a31-4a32-ac0e-c8ce4cd44f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:51.320881 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7b7218aa-9a31-4a32-ac0e-c8ce4cd44f96 None None] MFA Rules not processed for user `0a448d8b91c7493791319de24396b2c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:36:51.322183 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7b7218aa-9a31-4a32-ac0e-c8ce4cd44f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:51.387213 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1364/2739] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:36:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:36:51.396906 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abdc8d-ddcf-4363-aa95-bde5ded64229 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:36:51.398455 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-00abdc8d-ddcf-4363-aa95-bde5ded64229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:51.454225 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abdc8d-ddcf-4363-aa95-bde5ded64229 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:36:51.457870 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896f4f6-ef40-4b46-8fcd-d8b2bd7696e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:36:51.458561 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896f4f6-ef40-4b46-8fcd-d8b2bd7696e8 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:51.458817 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896f4f6-ef40-4b46-8fcd-d8b2bd7696e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:51.459127 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896f4f6-ef40-4b46-8fcd-d8b2bd7696e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:51.467645 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896f4f6-ef40-4b46-8fcd-d8b2bd7696e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:36:51.469049 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896f4f6-ef40-4b46-8fcd-d8b2bd7696e8 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:36:51.478041 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1376/2740] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:36:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:36:52.875512 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b1e15-d88e-44a3-bd46-130e46aa23fb None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:36:52.876073 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b1e15-d88e-44a3-bd46-130e46aa23fb None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:36:52.876073 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b1e15-d88e-44a3-bd46-130e46aa23fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:36:52.894980 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-4c2b1e15-d88e-44a3-bd46-130e46aa23fb None None] MFA Rules not processed for user `0a448d8b91c7493791319de24396b2c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:36:52.896199 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4c2b1e15-d88e-44a3-bd46-130e46aa23fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:36:52.904244 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1365/2741] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:36:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:37:10.268036 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2d634-c3aa-4393-9e58-00c2b3a07025 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:37:10.268576 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2d634-c3aa-4393-9e58-00c2b3a07025 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:37:10.268576 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2d634-c3aa-4393-9e58-00c2b3a07025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:37:10.286935 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-54c2d634-c3aa-4393-9e58-00c2b3a07025 None None] MFA Rules not processed for user `0a448d8b91c7493791319de24396b2c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:37:10.288115 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-54c2d634-c3aa-4393-9e58-00c2b3a07025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:37:10.296137 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1377/2742] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:37:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:37:33.704958 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00ba6c-deab-4de0-b923-9cff6e7a4d27 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:37:33.705490 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00ba6c-deab-4de0-b923-9cff6e7a4d27 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:37:33.705587 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00ba6c-deab-4de0-b923-9cff6e7a4d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:37:33.768711 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-0f00ba6c-deab-4de0-b923-9cff6e7a4d27 None None] MFA Rules not processed for user `de790a1a69994f7498834ded10480e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:37:33.770414 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0f00ba6c-deab-4de0-b923-9cff6e7a4d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:37:33.847442 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1366/2743] 10.222.0.31 () {58 vars in 1009 bytes} [Thu Feb 10 21:37:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:37:33.901144 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2d634-c3aa-4393-9e58-00c2b3a07025 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:37:33.902777 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-54c2d634-c3aa-4393-9e58-00c2b3a07025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:37:33.998404 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2d634-c3aa-4393-9e58-00c2b3a07025 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:37:34.003927 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd370c3d-a514-48b8-a150-97ec1a9d285d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f09689635e54a4e85c0ef0e3539d911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:37:34.004566 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd370c3d-a514-48b8-a150-97ec1a9d285d service swift] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:37:34.004852 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd370c3d-a514-48b8-a150-97ec1a9d285d service swift] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:37:34.005119 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd370c3d-a514-48b8-a150-97ec1a9d285d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:37:34.017755 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd370c3d-a514-48b8-a150-97ec1a9d285d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:37:34.020089 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd370c3d-a514-48b8-a150-97ec1a9d285d service swift] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:37:34.030548 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1378/2744] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 10 21:37:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 21:37:48.128574 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa33a5-55bc-4a4d-8b0b-9cee7d7306b0 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:37:48.129047 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa33a5-55bc-4a4d-8b0b-9cee7d7306b0 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:37:48.129162 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa33a5-55bc-4a4d-8b0b-9cee7d7306b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:37:48.147035 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-92fa33a5-55bc-4a4d-8b0b-9cee7d7306b0 None None] MFA Rules not processed for user `de790a1a69994f7498834ded10480e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:37:48.148221 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-92fa33a5-55bc-4a4d-8b0b-9cee7d7306b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:37:48.156366 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1367/2745] 10.222.0.31 () {58 vars in 967 bytes} [Thu Feb 10 21:37:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:37:48.168607 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd370c3d-a514-48b8-a150-97ec1a9d285d service swift] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:37:48.179723 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd370c3d-a514-48b8-a150-97ec1a9d285d service swift] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:37:48.185815 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050f574-bedd-4395-b846-bb90767585d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f09689635e54a4e85c0ef0e3539d911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:37:48.186455 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050f574-bedd-4395-b846-bb90767585d4 service swift] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:37:48.186740 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050f574-bedd-4395-b846-bb90767585d4 service swift] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:37:48.187005 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050f574-bedd-4395-b846-bb90767585d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:37:48.195348 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050f574-bedd-4395-b846-bb90767585d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:37:48.196909 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050f574-bedd-4395-b846-bb90767585d4 service swift] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:37:48.205756 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1379/2746] 10.222.0.31 () {60 vars in 1384 bytes} [Thu Feb 10 21:37:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 21:37:50.138689 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa33a5-55bc-4a4d-8b0b-9cee7d7306b0 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:37:50.150176 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa33a5-55bc-4a4d-8b0b-9cee7d7306b0 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:37:50.155663 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7798954-cf6d-4461-bb83-6b69a10d9d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:37:50.156903 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7798954-cf6d-4461-bb83-6b69a10d9d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:37:50.157481 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7798954-cf6d-4461-bb83-6b69a10d9d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:37:50.157666 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7798954-cf6d-4461-bb83-6b69a10d9d06 admin admin] PATH_INFO: `/v3/users/0a448d8b91c7493791319de24396b2c9` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:37:50.159046 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7798954-cf6d-4461-bb83-6b69a10d9d06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a448d8b91c7493791319de24396b2c9)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:37:50.161841 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7798954-cf6d-4461-bb83-6b69a10d9d06 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:37:50.211815 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a7798954-cf6d-4461-bb83-6b69a10d9d06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a448d8b91c7493791319de24396b2c9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:37:50.218636 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a7798954-cf6d-4461-bb83-6b69a10d9d06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a448d8b91c7493791319de24396b2c9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:37:50.230441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a7798954-cf6d-4461-bb83-6b69a10d9d06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a448d8b91c7493791319de24396b2c9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:37:50.231169 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a7798954-cf6d-4461-bb83-6b69a10d9d06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a448d8b91c7493791319de24396b2c9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:37:50.239907 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a7798954-cf6d-4461-bb83-6b69a10d9d06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a448d8b91c7493791319de24396b2c9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:37:50.245914 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1368/2747] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:37:50 2022] DELETE /identity/v3/users/0a448d8b91c7493791319de24396b2c9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:37:50.444366 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050f574-bedd-4395-b846-bb90767585d4 service swift] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:37:50.457034 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050f574-bedd-4395-b846-bb90767585d4 service swift] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:37:50.519487 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae4139-1cb5-4b09-bfa8-a8c279242181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:37:50.520354 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4139-1cb5-4b09-bfa8-a8c279242181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:37:50.520632 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4139-1cb5-4b09-bfa8-a8c279242181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:37:50.520931 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4139-1cb5-4b09-bfa8-a8c279242181 admin admin] PATH_INFO: `/v3/projects/3a4632fe4b554ef9a435688295d888df` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:37:50.522142 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae4139-1cb5-4b09-bfa8-a8c279242181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a4632fe4b554ef9a435688295d888df)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:37:50.524041 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae4139-1cb5-4b09-bfa8-a8c279242181 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:37:50.570144 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b2ae4139-1cb5-4b09-bfa8-a8c279242181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a4632fe4b554ef9a435688295d888df', 'request_id': 'req-b2ae4139-1cb5-4b09-bfa8-a8c279242181'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:37:50.575956 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b2ae4139-1cb5-4b09-bfa8-a8c279242181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a4632fe4b554ef9a435688295d888df', 'request_id': 'req-b2ae4139-1cb5-4b09-bfa8-a8c279242181'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:37:50.582530 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b2ae4139-1cb5-4b09-bfa8-a8c279242181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a4632fe4b554ef9a435688295d888df', 'request_id': 'req-b2ae4139-1cb5-4b09-bfa8-a8c279242181'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:37:50.596686 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b2ae4139-1cb5-4b09-bfa8-a8c279242181 admin admin] The token cache is being invalidate because project 3a4632fe4b554ef9a435688295d888df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:37:50.596964 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b2ae4139-1cb5-4b09-bfa8-a8c279242181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:37:50.597619 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b2ae4139-1cb5-4b09-bfa8-a8c279242181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:37:50.599131 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1380/2748] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:37:50 2022] DELETE /identity/v3/projects/3a4632fe4b554ef9a435688295d888df => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:37:50.604331 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407f89c-6781-47e4-8005-e30fa53f7f89 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:37:50.604611 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407f89c-6781-47e4-8005-e30fa53f7f89 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:37:50.604880 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407f89c-6781-47e4-8005-e30fa53f7f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:37:50.622574 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-4407f89c-6781-47e4-8005-e30fa53f7f89 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:37:50.623774 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4407f89c-6781-47e4-8005-e30fa53f7f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:37:50.681749 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1369/2749] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:37:50.689781 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3886c-52bc-47c7-8279-0c0dee44e4e9 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:37:50.690062 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3886c-52bc-47c7-8279-0c0dee44e4e9 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:37:50.690327 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3886c-52bc-47c7-8279-0c0dee44e4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:37:50.709229 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-0bb3886c-52bc-47c7-8279-0c0dee44e4e9 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:37:50.710446 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-0bb3886c-52bc-47c7-8279-0c0dee44e4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:37:50.718329 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1381/2750] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 21:37:50.722436 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407f89c-6781-47e4-8005-e30fa53f7f89 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:37:50.731876 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407f89c-6781-47e4-8005-e30fa53f7f89 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:37:50.736838 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a45c04-4857-486b-be20-2c7e46f47a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:37:50.737512 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a45c04-4857-486b-be20-2c7e46f47a52 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:37:50.737781 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a45c04-4857-486b-be20-2c7e46f47a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:37:50.738045 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a45c04-4857-486b-be20-2c7e46f47a52 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:37:50.738768 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a45c04-4857-486b-be20-2c7e46f47a52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:37:50.739068 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a45c04-4857-486b-be20-2c7e46f47a52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:37:50.740632 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a45c04-4857-486b-be20-2c7e46f47a52 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:37:50.753438 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1370/2751] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:37:50.757484 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3886c-52bc-47c7-8279-0c0dee44e4e9 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:37:50.767189 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3886c-52bc-47c7-8279-0c0dee44e4e9 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:37:50.773474 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a22c7-d03a-4b17-b8f3-1cfa2f38f780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:37:50.774156 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a22c7-d03a-4b17-b8f3-1cfa2f38f780 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:37:50.774457 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a22c7-d03a-4b17-b8f3-1cfa2f38f780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:37:50.774754 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a22c7-d03a-4b17-b8f3-1cfa2f38f780 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:37:50.775449 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a22c7-d03a-4b17-b8f3-1cfa2f38f780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:37:50.777322 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a22c7-d03a-4b17-b8f3-1cfa2f38f780 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:37:50.805988 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1382/2752] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:37:50 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:37:50.810297 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a45c04-4857-486b-be20-2c7e46f47a52 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:37:50.820381 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a45c04-4857-486b-be20-2c7e46f47a52 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:37:50.875319 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab17f6b-2104-4840-9bf4-0e4b49382613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:37:50.875972 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab17f6b-2104-4840-9bf4-0e4b49382613 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:37:50.876251 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab17f6b-2104-4840-9bf4-0e4b49382613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:37:50.876524 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab17f6b-2104-4840-9bf4-0e4b49382613 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:37:50.877211 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab17f6b-2104-4840-9bf4-0e4b49382613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:37:50.879166 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab17f6b-2104-4840-9bf4-0e4b49382613 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:37:50.901948 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1371/2753] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:37:50 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:37:50.906137 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a22c7-d03a-4b17-b8f3-1cfa2f38f780 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:37:50.916236 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a22c7-d03a-4b17-b8f3-1cfa2f38f780 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:37:50.921042 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50deeb1-4c43-4b38-9331-1fbd49e3508e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:37:50.921718 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50deeb1-4c43-4b38-9331-1fbd49e3508e admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:37:50.921991 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50deeb1-4c43-4b38-9331-1fbd49e3508e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:37:50.922256 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50deeb1-4c43-4b38-9331-1fbd49e3508e admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:37:50.922975 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50deeb1-4c43-4b38-9331-1fbd49e3508e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:37:50.924916 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50deeb1-4c43-4b38-9331-1fbd49e3508e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:37:50.935210 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1383/2754] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:37:50.939123 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab17f6b-2104-4840-9bf4-0e4b49382613 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:37:50.949235 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab17f6b-2104-4840-9bf4-0e4b49382613 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:37:50.955205 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe4d3f-4967-481e-824e-4017188e8682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:37:50.955863 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe4d3f-4967-481e-824e-4017188e8682 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:37:50.956143 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe4d3f-4967-481e-824e-4017188e8682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:37:50.956411 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe4d3f-4967-481e-824e-4017188e8682 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:37:50.957150 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe4d3f-4967-481e-824e-4017188e8682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:37:50.958792 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe4d3f-4967-481e-824e-4017188e8682 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:37:50.968978 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1372/2755] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:37:50.972957 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50deeb1-4c43-4b38-9331-1fbd49e3508e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:37:50.982818 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50deeb1-4c43-4b38-9331-1fbd49e3508e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:37:50.988409 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ac696-d72e-4fa2-ad94-472d28dc0656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:37:50.989424 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ac696-d72e-4fa2-ad94-472d28dc0656 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:37:50.989714 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ac696-d72e-4fa2-ad94-472d28dc0656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:37:50.990006 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ac696-d72e-4fa2-ad94-472d28dc0656 admin admin] PATH_INFO: `/v3/projects/3864edceca5b441f8a872fa8d3eb0b62/users/a0d35e43d81f495c911ca97ece7a3713/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:37:51.004827 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ac696-d72e-4fa2-ad94-472d28dc0656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3864edceca5b441f8a872fa8d3eb0b62, user_id=a0d35e43d81f495c911ca97ece7a3713, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:37:51.007486 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ac696-d72e-4fa2-ad94-472d28dc0656 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:37:51.022598 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1384/2756] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:37:50 2022] PUT /identity/v3/projects/3864edceca5b441f8a872fa8d3eb0b62/users/a0d35e43d81f495c911ca97ece7a3713/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:37:51.032745 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda58f2-b2a8-4e1a-93db-c72927cd5374 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:37:51.033026 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda58f2-b2a8-4e1a-93db-c72927cd5374 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:37:51.033377 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda58f2-b2a8-4e1a-93db-c72927cd5374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:37:51.059635 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-acda58f2-b2a8-4e1a-93db-c72927cd5374 None None] MFA Rules not processed for user `a0d35e43d81f495c911ca97ece7a3713`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:37:51.060813 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-acda58f2-b2a8-4e1a-93db-c72927cd5374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:37:51.126407 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1373/2757] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:37:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:37:51.139294 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ac696-d72e-4fa2-ad94-472d28dc0656 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:37:51.141928 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-698ac696-d72e-4fa2-ad94-472d28dc0656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:37:51.203551 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ac696-d72e-4fa2-ad94-472d28dc0656 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:37:51.209887 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303e602-8846-42ae-a65b-9d2758e46b5b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '256860d94eb142c6b2175ae89f977e4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:37:51.210820 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303e602-8846-42ae-a65b-9d2758e46b5b service glance] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:37:51.211184 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303e602-8846-42ae-a65b-9d2758e46b5b service glance] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:37:51.211528 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303e602-8846-42ae-a65b-9d2758e46b5b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:37:51.221186 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303e602-8846-42ae-a65b-9d2758e46b5b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:37:51.222664 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303e602-8846-42ae-a65b-9d2758e46b5b service glance] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:37:51.231610 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1385/2758] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:37:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:38:40.400931 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda58f2-b2a8-4e1a-93db-c72927cd5374 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:40.476291 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda58f2-b2a8-4e1a-93db-c72927cd5374 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:40.481907 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7b9ec-9584-46e1-a5b0-e99ce0b9d202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:40.482767 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7b9ec-9584-46e1-a5b0-e99ce0b9d202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:40.483041 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7b9ec-9584-46e1-a5b0-e99ce0b9d202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:40.483291 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7b9ec-9584-46e1-a5b0-e99ce0b9d202 admin admin] PATH_INFO: `/v3/users/a0d35e43d81f495c911ca97ece7a3713` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:40.484574 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7b9ec-9584-46e1-a5b0-e99ce0b9d202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0d35e43d81f495c911ca97ece7a3713)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:40.486506 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7b9ec-9584-46e1-a5b0-e99ce0b9d202 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:40.536629 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-98d7b9ec-9584-46e1-a5b0-e99ce0b9d202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0d35e43d81f495c911ca97ece7a3713'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:40.543375 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-98d7b9ec-9584-46e1-a5b0-e99ce0b9d202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0d35e43d81f495c911ca97ece7a3713'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:40.555938 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-98d7b9ec-9584-46e1-a5b0-e99ce0b9d202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0d35e43d81f495c911ca97ece7a3713'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:40.556717 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-98d7b9ec-9584-46e1-a5b0-e99ce0b9d202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0d35e43d81f495c911ca97ece7a3713'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:40.564645 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-98d7b9ec-9584-46e1-a5b0-e99ce0b9d202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0d35e43d81f495c911ca97ece7a3713'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:40.572262 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1374/2759] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:38:40 2022] DELETE /identity/v3/users/a0d35e43d81f495c911ca97ece7a3713 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:40.583221 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b8409-5db6-45c9-8381-d72a9052d9e2 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:40.583741 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b8409-5db6-45c9-8381-d72a9052d9e2 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:40.583831 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b8409-5db6-45c9-8381-d72a9052d9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:40.603376 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-0f2b8409-5db6-45c9-8381-d72a9052d9e2 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:40.604584 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-0f2b8409-5db6-45c9-8381-d72a9052d9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:40.671397 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1386/2760] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:40.681580 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7b9ec-9584-46e1-a5b0-e99ce0b9d202 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:40.683010 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-98d7b9ec-9584-46e1-a5b0-e99ce0b9d202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:40.740519 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7b9ec-9584-46e1-a5b0-e99ce0b9d202 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:40.745679 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d75e9a-e323-4e20-bde2-60c395ed0c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:40.746322 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d75e9a-e323-4e20-bde2-60c395ed0c82 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:40.746597 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d75e9a-e323-4e20-bde2-60c395ed0c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:40.746863 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d75e9a-e323-4e20-bde2-60c395ed0c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:40.759860 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d75e9a-e323-4e20-bde2-60c395ed0c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:40.761982 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d75e9a-e323-4e20-bde2-60c395ed0c82 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:40.772592 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1375/2761] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:38:41.055420 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b8409-5db6-45c9-8381-d72a9052d9e2 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:41.057006 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-0f2b8409-5db6-45c9-8381-d72a9052d9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:41.077473 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b8409-5db6-45c9-8381-d72a9052d9e2 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:41.083374 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda3561-c26d-4050-bf7b-afe48f717e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:41.084292 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda3561-c26d-4050-bf7b-afe48f717e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:41.084640 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda3561-c26d-4050-bf7b-afe48f717e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:41.084820 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda3561-c26d-4050-bf7b-afe48f717e94 admin admin] PATH_INFO: `/v3/projects/3864edceca5b441f8a872fa8d3eb0b62` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:41.086101 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda3561-c26d-4050-bf7b-afe48f717e94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3864edceca5b441f8a872fa8d3eb0b62)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:41.088004 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda3561-c26d-4050-bf7b-afe48f717e94 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:41.135267 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-bdda3561-c26d-4050-bf7b-afe48f717e94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3864edceca5b441f8a872fa8d3eb0b62', 'request_id': 'req-bdda3561-c26d-4050-bf7b-afe48f717e94'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:41.140742 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-bdda3561-c26d-4050-bf7b-afe48f717e94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3864edceca5b441f8a872fa8d3eb0b62', 'request_id': 'req-bdda3561-c26d-4050-bf7b-afe48f717e94'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:41.146835 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-bdda3561-c26d-4050-bf7b-afe48f717e94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3864edceca5b441f8a872fa8d3eb0b62', 'request_id': 'req-bdda3561-c26d-4050-bf7b-afe48f717e94'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:41.160282 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-bdda3561-c26d-4050-bf7b-afe48f717e94 admin admin] The token cache is being invalidate because project 3864edceca5b441f8a872fa8d3eb0b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:38:41.160612 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-bdda3561-c26d-4050-bf7b-afe48f717e94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:41.161302 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-bdda3561-c26d-4050-bf7b-afe48f717e94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:41.162906 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1387/2762] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:38:41 2022] DELETE /identity/v3/projects/3864edceca5b441f8a872fa8d3eb0b62 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:41.167901 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23906c92-e2f2-4cea-a4e6-7771f8cc4afb None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:41.168167 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23906c92-e2f2-4cea-a4e6-7771f8cc4afb None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:41.168436 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23906c92-e2f2-4cea-a4e6-7771f8cc4afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:41.186965 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-23906c92-e2f2-4cea-a4e6-7771f8cc4afb None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:41.188077 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-23906c92-e2f2-4cea-a4e6-7771f8cc4afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:41.253210 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1376/2763] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:41.262689 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745996a-0922-4571-9e91-583ceb17f098 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:41.262971 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745996a-0922-4571-9e91-583ceb17f098 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:41.263241 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745996a-0922-4571-9e91-583ceb17f098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:41.282394 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-0745996a-0922-4571-9e91-583ceb17f098 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:41.283589 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-0745996a-0922-4571-9e91-583ceb17f098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:41.292756 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1388/2764] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:41.299338 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23906c92-e2f2-4cea-a4e6-7771f8cc4afb None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:41.309688 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23906c92-e2f2-4cea-a4e6-7771f8cc4afb None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:41.315020 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89c26a-7886-4223-8e55-a045ab8ea16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:41.315662 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89c26a-7886-4223-8e55-a045ab8ea16d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:41.315945 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89c26a-7886-4223-8e55-a045ab8ea16d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:41.316214 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89c26a-7886-4223-8e55-a045ab8ea16d admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:41.316927 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89c26a-7886-4223-8e55-a045ab8ea16d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:38:41.317232 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89c26a-7886-4223-8e55-a045ab8ea16d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:41.318858 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89c26a-7886-4223-8e55-a045ab8ea16d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:41.330558 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1377/2765] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 21:38:41.334760 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745996a-0922-4571-9e91-583ceb17f098 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:41.344356 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745996a-0922-4571-9e91-583ceb17f098 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:41.350316 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecaf71c-0d88-4d27-9e70-50bce8ae92c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:41.350966 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaf71c-0d88-4d27-9e70-50bce8ae92c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:41.351244 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaf71c-0d88-4d27-9e70-50bce8ae92c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:41.351514 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaf71c-0d88-4d27-9e70-50bce8ae92c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:41.352211 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecaf71c-0d88-4d27-9e70-50bce8ae92c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:41.354168 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecaf71c-0d88-4d27-9e70-50bce8ae92c8 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:41.381511 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1389/2766] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:38:41 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:38:41.385775 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89c26a-7886-4223-8e55-a045ab8ea16d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:41.397460 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89c26a-7886-4223-8e55-a045ab8ea16d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:41.469680 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadcab1-64e9-4da4-955e-004f601eda30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:41.470350 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadcab1-64e9-4da4-955e-004f601eda30 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:41.470713 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadcab1-64e9-4da4-955e-004f601eda30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:41.470981 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadcab1-64e9-4da4-955e-004f601eda30 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:41.471668 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadcab1-64e9-4da4-955e-004f601eda30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:41.473583 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadcab1-64e9-4da4-955e-004f601eda30 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:41.496725 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1378/2767] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:38:41 2022] POST /identity/v3/users => generated 300 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:38:41.500942 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecaf71c-0d88-4d27-9e70-50bce8ae92c8 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:41.511158 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecaf71c-0d88-4d27-9e70-50bce8ae92c8 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:41.517310 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd976975-a63a-44de-9fc6-1e95febdb262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:41.517999 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd976975-a63a-44de-9fc6-1e95febdb262 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:41.518563 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd976975-a63a-44de-9fc6-1e95febdb262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:41.518837 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd976975-a63a-44de-9fc6-1e95febdb262 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:41.519554 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd976975-a63a-44de-9fc6-1e95febdb262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:41.521128 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd976975-a63a-44de-9fc6-1e95febdb262 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:41.532441 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1390/2768] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:38:41.536506 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadcab1-64e9-4da4-955e-004f601eda30 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:41.546575 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadcab1-64e9-4da4-955e-004f601eda30 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:41.551709 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f94ec-d5fb-45c8-ae6b-a2dac1dbcd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:41.552357 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f94ec-d5fb-45c8-ae6b-a2dac1dbcd99 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:41.552635 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f94ec-d5fb-45c8-ae6b-a2dac1dbcd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:41.552899 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f94ec-d5fb-45c8-ae6b-a2dac1dbcd99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:41.553675 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f94ec-d5fb-45c8-ae6b-a2dac1dbcd99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:41.555254 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f94ec-d5fb-45c8-ae6b-a2dac1dbcd99 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:41.565051 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1379/2769] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:38:41.569109 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd976975-a63a-44de-9fc6-1e95febdb262 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:41.578947 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd976975-a63a-44de-9fc6-1e95febdb262 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:41.583686 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7768ab5-a8d9-41d6-8247-c80b959b7da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:41.584553 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7768ab5-a8d9-41d6-8247-c80b959b7da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:41.584824 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7768ab5-a8d9-41d6-8247-c80b959b7da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:41.585084 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7768ab5-a8d9-41d6-8247-c80b959b7da4 admin admin] PATH_INFO: `/v3/projects/3a2a1b1299c240089cbb3b803e67352e/users/ed36955ebbe14443b2a6eb74cd184dcc/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:41.599381 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7768ab5-a8d9-41d6-8247-c80b959b7da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2a1b1299c240089cbb3b803e67352e, user_id=ed36955ebbe14443b2a6eb74cd184dcc, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:41.602012 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7768ab5-a8d9-41d6-8247-c80b959b7da4 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:41.620845 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1391/2770] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:38:41 2022] PUT /identity/v3/projects/3a2a1b1299c240089cbb3b803e67352e/users/ed36955ebbe14443b2a6eb74cd184dcc/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:41.632378 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dcfbb-4fdb-41be-abf2-19aa8d7728d5 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:41.632762 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dcfbb-4fdb-41be-abf2-19aa8d7728d5 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:41.633173 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dcfbb-4fdb-41be-abf2-19aa8d7728d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:41.663132 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-fc7dcfbb-4fdb-41be-abf2-19aa8d7728d5 None None] MFA Rules not processed for user `ed36955ebbe14443b2a6eb74cd184dcc`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:41.664386 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-fc7dcfbb-4fdb-41be-abf2-19aa8d7728d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:41.730739 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1380/2771] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:41.741589 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7768ab5-a8d9-41d6-8247-c80b959b7da4 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:41.744824 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-c7768ab5-a8d9-41d6-8247-c80b959b7da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:41.802368 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7768ab5-a8d9-41d6-8247-c80b959b7da4 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:41.806735 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddbeb4-5ef1-443f-bfc7-4b8feab78cbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:41.807405 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddbeb4-5ef1-443f-bfc7-4b8feab78cbe service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:41.807689 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddbeb4-5ef1-443f-bfc7-4b8feab78cbe service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:41.807962 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddbeb4-5ef1-443f-bfc7-4b8feab78cbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:41.817115 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddbeb4-5ef1-443f-bfc7-4b8feab78cbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:41.818662 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddbeb4-5ef1-443f-bfc7-4b8feab78cbe service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:41.828051 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1392/2772] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:38:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:38:42.205752 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7dcfbb-4fdb-41be-abf2-19aa8d7728d5 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:42.207345 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-fc7dcfbb-4fdb-41be-abf2-19aa8d7728d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:42.265441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7dcfbb-4fdb-41be-abf2-19aa8d7728d5 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:42.269133 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc7c6b-80db-4bab-ac53-0bafa520eaae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:42.269842 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc7c6b-80db-4bab-ac53-0bafa520eaae service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:42.270162 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc7c6b-80db-4bab-ac53-0bafa520eaae service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:42.270372 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc7c6b-80db-4bab-ac53-0bafa520eaae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:42.272452 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-33dc7c6b-80db-4bab-ac53-0bafa520eaae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:42.342195 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc7c6b-80db-4bab-ac53-0bafa520eaae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:42.343656 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc7c6b-80db-4bab-ac53-0bafa520eaae service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:42.354012 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1381/2773] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:38:45.725418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddbeb4-5ef1-443f-bfc7-4b8feab78cbe service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:45.727096 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-81ddbeb4-5ef1-443f-bfc7-4b8feab78cbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:45.744787 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddbeb4-5ef1-443f-bfc7-4b8feab78cbe service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:45.750332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a9faf-68a4-47ac-a59a-beafc5c1b720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:45.751427 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a9faf-68a4-47ac-a59a-beafc5c1b720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:45.751699 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a9faf-68a4-47ac-a59a-beafc5c1b720 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:45.751967 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a9faf-68a4-47ac-a59a-beafc5c1b720 admin admin] PATH_INFO: `/v3/users/d6a6f1ee4ac24e0481c4ee1bf8ddf897` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:45.765980 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a9faf-68a4-47ac-a59a-beafc5c1b720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6a6f1ee4ac24e0481c4ee1bf8ddf897)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:45.767899 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a9faf-68a4-47ac-a59a-beafc5c1b720 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:45.813764 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-dc5a9faf-68a4-47ac-a59a-beafc5c1b720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6a6f1ee4ac24e0481c4ee1bf8ddf897'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:45.820241 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-dc5a9faf-68a4-47ac-a59a-beafc5c1b720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6a6f1ee4ac24e0481c4ee1bf8ddf897'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:45.831709 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-dc5a9faf-68a4-47ac-a59a-beafc5c1b720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6a6f1ee4ac24e0481c4ee1bf8ddf897'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:45.832363 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-dc5a9faf-68a4-47ac-a59a-beafc5c1b720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6a6f1ee4ac24e0481c4ee1bf8ddf897'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:45.832952 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-dc5a9faf-68a4-47ac-a59a-beafc5c1b720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6a6f1ee4ac24e0481c4ee1bf8ddf897'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:45.846354 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1393/2774] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:38:45 2022] DELETE /identity/v3/users/d6a6f1ee4ac24e0481c4ee1bf8ddf897 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:46.026710 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc7c6b-80db-4bab-ac53-0bafa520eaae service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:46.036813 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc7c6b-80db-4bab-ac53-0bafa520eaae service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:46.095272 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fecb7-1590-43db-bfb4-fe549c99283c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:46.096114 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fecb7-1590-43db-bfb4-fe549c99283c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:46.096395 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fecb7-1590-43db-bfb4-fe549c99283c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:46.096662 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fecb7-1590-43db-bfb4-fe549c99283c admin admin] PATH_INFO: `/v3/projects/cb01f8cda0e14466a64d43cb40867c5c` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:46.097898 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fecb7-1590-43db-bfb4-fe549c99283c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb01f8cda0e14466a64d43cb40867c5c)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:46.099794 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fecb7-1590-43db-bfb4-fe549c99283c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:46.148792 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ad9fecb7-1590-43db-bfb4-fe549c99283c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb01f8cda0e14466a64d43cb40867c5c', 'request_id': 'req-ad9fecb7-1590-43db-bfb4-fe549c99283c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:46.154665 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ad9fecb7-1590-43db-bfb4-fe549c99283c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb01f8cda0e14466a64d43cb40867c5c', 'request_id': 'req-ad9fecb7-1590-43db-bfb4-fe549c99283c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:46.161073 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ad9fecb7-1590-43db-bfb4-fe549c99283c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb01f8cda0e14466a64d43cb40867c5c', 'request_id': 'req-ad9fecb7-1590-43db-bfb4-fe549c99283c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:46.174207 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ad9fecb7-1590-43db-bfb4-fe549c99283c admin admin] The token cache is being invalidate because project cb01f8cda0e14466a64d43cb40867c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:38:46.174489 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ad9fecb7-1590-43db-bfb4-fe549c99283c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:46.175128 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ad9fecb7-1590-43db-bfb4-fe549c99283c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:46.176709 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1382/2775] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:38:46 2022] DELETE /identity/v3/projects/cb01f8cda0e14466a64d43cb40867c5c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:46.182492 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5d4d2-568f-4881-ae73-05b51162e2b5 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:46.182780 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5d4d2-568f-4881-ae73-05b51162e2b5 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:46.183052 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5d4d2-568f-4881-ae73-05b51162e2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:46.201788 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-0cd5d4d2-568f-4881-ae73-05b51162e2b5 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:46.202966 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-0cd5d4d2-568f-4881-ae73-05b51162e2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:46.275702 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1394/2776] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 21:38:46.286030 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f424e04-a6cb-4f6e-b50b-22fe60d77a97 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:46.286347 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f424e04-a6cb-4f6e-b50b-22fe60d77a97 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:46.286672 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f424e04-a6cb-4f6e-b50b-22fe60d77a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:46.309505 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-2f424e04-a6cb-4f6e-b50b-22fe60d77a97 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:46.310725 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2f424e04-a6cb-4f6e-b50b-22fe60d77a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:46.319997 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1383/2777] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:46.324392 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5d4d2-568f-4881-ae73-05b51162e2b5 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:46.334169 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5d4d2-568f-4881-ae73-05b51162e2b5 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:46.339654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e2b04-b2f6-4d12-98d6-858454fbbc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:46.340327 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e2b04-b2f6-4d12-98d6-858454fbbc7f admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:46.340623 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e2b04-b2f6-4d12-98d6-858454fbbc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:46.340882 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e2b04-b2f6-4d12-98d6-858454fbbc7f admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:46.341662 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e2b04-b2f6-4d12-98d6-858454fbbc7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:38:46.341955 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e2b04-b2f6-4d12-98d6-858454fbbc7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:46.343661 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e2b04-b2f6-4d12-98d6-858454fbbc7f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:46.355518 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1395/2778] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:38:46.360397 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f424e04-a6cb-4f6e-b50b-22fe60d77a97 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:46.369686 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f424e04-a6cb-4f6e-b50b-22fe60d77a97 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:46.375719 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec342e-4d1f-4f6b-a551-34ebdf92b925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:46.376357 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec342e-4d1f-4f6b-a551-34ebdf92b925 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:46.376627 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec342e-4d1f-4f6b-a551-34ebdf92b925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:46.376891 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec342e-4d1f-4f6b-a551-34ebdf92b925 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:46.377598 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec342e-4d1f-4f6b-a551-34ebdf92b925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:46.379446 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec342e-4d1f-4f6b-a551-34ebdf92b925 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:46.411236 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1384/2779] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:38:46 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:38:46.415509 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e2b04-b2f6-4d12-98d6-858454fbbc7f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:46.425847 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e2b04-b2f6-4d12-98d6-858454fbbc7f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:46.485245 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024c72f-f25b-4052-b2dd-0fcfc8d4d765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:46.485889 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024c72f-f25b-4052-b2dd-0fcfc8d4d765 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:46.486150 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024c72f-f25b-4052-b2dd-0fcfc8d4d765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:46.486422 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024c72f-f25b-4052-b2dd-0fcfc8d4d765 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:46.487100 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024c72f-f25b-4052-b2dd-0fcfc8d4d765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:46.488999 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024c72f-f25b-4052-b2dd-0fcfc8d4d765 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:46.509207 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1396/2780] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:38:46 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:38:46.513316 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec342e-4d1f-4f6b-a551-34ebdf92b925 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:46.523637 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec342e-4d1f-4f6b-a551-34ebdf92b925 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:46.529477 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee9946-fdae-4d4a-98a3-789c2b6ee201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:46.530162 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee9946-fdae-4d4a-98a3-789c2b6ee201 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:46.530595 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee9946-fdae-4d4a-98a3-789c2b6ee201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:46.530822 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee9946-fdae-4d4a-98a3-789c2b6ee201 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:46.531564 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee9946-fdae-4d4a-98a3-789c2b6ee201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:46.533155 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee9946-fdae-4d4a-98a3-789c2b6ee201 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:46.545654 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1385/2781] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:38:46.550239 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024c72f-f25b-4052-b2dd-0fcfc8d4d765 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:46.560656 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024c72f-f25b-4052-b2dd-0fcfc8d4d765 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:46.566597 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba0620-746d-4071-aef5-8656de6f1f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:46.567257 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba0620-746d-4071-aef5-8656de6f1f51 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:46.567525 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba0620-746d-4071-aef5-8656de6f1f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:46.567815 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba0620-746d-4071-aef5-8656de6f1f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:46.569745 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba0620-746d-4071-aef5-8656de6f1f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:46.571718 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba0620-746d-4071-aef5-8656de6f1f51 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:46.582548 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1397/2782] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:38:46.587052 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee9946-fdae-4d4a-98a3-789c2b6ee201 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:46.597288 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee9946-fdae-4d4a-98a3-789c2b6ee201 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:46.602288 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc2a64-a3d3-477e-80c4-2586927272bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:46.603187 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc2a64-a3d3-477e-80c4-2586927272bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:46.603463 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc2a64-a3d3-477e-80c4-2586927272bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:46.603735 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc2a64-a3d3-477e-80c4-2586927272bb admin admin] PATH_INFO: `/v3/projects/5712d0e340e34ebfa9e23c1876968dd6/users/76a7dbabb42f4a5d819be44d70b5acb4/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:46.618612 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc2a64-a3d3-477e-80c4-2586927272bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5712d0e340e34ebfa9e23c1876968dd6, user_id=76a7dbabb42f4a5d819be44d70b5acb4, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:46.621269 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc2a64-a3d3-477e-80c4-2586927272bb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:46.636689 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1386/2783] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:38:46 2022] PUT /identity/v3/projects/5712d0e340e34ebfa9e23c1876968dd6/users/76a7dbabb42f4a5d819be44d70b5acb4/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:46.647897 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5fbb1-c436-4ccd-bc3b-b680521aabf2 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:46.648182 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5fbb1-c436-4ccd-bc3b-b680521aabf2 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:46.648483 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5fbb1-c436-4ccd-bc3b-b680521aabf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:46.676689 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-0ca5fbb1-c436-4ccd-bc3b-b680521aabf2 None None] MFA Rules not processed for user `76a7dbabb42f4a5d819be44d70b5acb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:46.677965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-0ca5fbb1-c436-4ccd-bc3b-b680521aabf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:46.746419 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1398/2784] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:46.751122 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc2a64-a3d3-477e-80c4-2586927272bb admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:46.817332 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc2a64-a3d3-477e-80c4-2586927272bb admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:46.823400 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f092da-a891-437d-9d76-1cd4ee5daf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:46.824061 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f092da-a891-437d-9d76-1cd4ee5daf6e admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:46.824340 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f092da-a891-437d-9d76-1cd4ee5daf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:46.824609 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f092da-a891-437d-9d76-1cd4ee5daf6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:46.825301 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f092da-a891-437d-9d76-1cd4ee5daf6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:46.827328 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f092da-a891-437d-9d76-1cd4ee5daf6e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:46.860841 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1387/2785] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:38:46 2022] POST /identity/v3/projects => generated 405 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:38:46.866324 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5fbb1-c436-4ccd-bc3b-b680521aabf2 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:46.878127 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5fbb1-c436-4ccd-bc3b-b680521aabf2 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:46.933705 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73763445-9b2f-4e36-8cc7-0b48fc9b4e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:46.934388 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73763445-9b2f-4e36-8cc7-0b48fc9b4e86 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:46.934660 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73763445-9b2f-4e36-8cc7-0b48fc9b4e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:46.934920 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73763445-9b2f-4e36-8cc7-0b48fc9b4e86 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:46.935604 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73763445-9b2f-4e36-8cc7-0b48fc9b4e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:46.937562 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73763445-9b2f-4e36-8cc7-0b48fc9b4e86 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:46.960517 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1399/2786] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:38:46 2022] POST /identity/v3/users => generated 309 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:38:46.964996 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f092da-a891-437d-9d76-1cd4ee5daf6e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:46.975843 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f092da-a891-437d-9d76-1cd4ee5daf6e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:46.981863 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38744e-fc91-4be2-8d1d-7d915a839e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:46.982507 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38744e-fc91-4be2-8d1d-7d915a839e48 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:46.982793 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38744e-fc91-4be2-8d1d-7d915a839e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:46.983039 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38744e-fc91-4be2-8d1d-7d915a839e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:46.983765 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38744e-fc91-4be2-8d1d-7d915a839e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:46.985341 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38744e-fc91-4be2-8d1d-7d915a839e48 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:46.997960 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1388/2787] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:38:47.002475 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73763445-9b2f-4e36-8cc7-0b48fc9b4e86 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:47.013403 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73763445-9b2f-4e36-8cc7-0b48fc9b4e86 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:47.020297 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace90d34-2300-4f5c-8d9d-f3f047de831a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:47.021179 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace90d34-2300-4f5c-8d9d-f3f047de831a admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:47.021488 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace90d34-2300-4f5c-8d9d-f3f047de831a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:47.021761 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace90d34-2300-4f5c-8d9d-f3f047de831a admin admin] PATH_INFO: `/v3/projects/692489939e9744819b987e724b48d280/users/1ecd6c1b27a94d19b0ff6cb1db9f0ef2/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:47.037897 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace90d34-2300-4f5c-8d9d-f3f047de831a admin admin] RBAC: Authorizing `identity:create_grant(project_id=692489939e9744819b987e724b48d280, user_id=1ecd6c1b27a94d19b0ff6cb1db9f0ef2, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:47.040514 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace90d34-2300-4f5c-8d9d-f3f047de831a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:47.056353 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1400/2788] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:38:47 2022] PUT /identity/v3/projects/692489939e9744819b987e724b48d280/users/1ecd6c1b27a94d19b0ff6cb1db9f0ef2/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 21:38:47.060423 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38744e-fc91-4be2-8d1d-7d915a839e48 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:47.074335 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38744e-fc91-4be2-8d1d-7d915a839e48 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:47.132585 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84f130-6efe-47ed-8525-6811c7f6d014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:47.133579 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84f130-6efe-47ed-8525-6811c7f6d014 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:47.133982 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84f130-6efe-47ed-8525-6811c7f6d014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:47.134355 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84f130-6efe-47ed-8525-6811c7f6d014 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:47.135507 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84f130-6efe-47ed-8525-6811c7f6d014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:47.138049 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84f130-6efe-47ed-8525-6811c7f6d014 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:47.153917 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1389/2789] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:38:47.158770 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace90d34-2300-4f5c-8d9d-f3f047de831a admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:47.169651 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace90d34-2300-4f5c-8d9d-f3f047de831a admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:47.175792 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfefa6a-de35-45b0-957e-bc96b3131d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:47.176704 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfefa6a-de35-45b0-957e-bc96b3131d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:47.176979 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfefa6a-de35-45b0-957e-bc96b3131d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:47.177249 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfefa6a-de35-45b0-957e-bc96b3131d9b admin admin] PATH_INFO: `/v3/projects/692489939e9744819b987e724b48d280/users/1ecd6c1b27a94d19b0ff6cb1db9f0ef2/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:47.179524 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfefa6a-de35-45b0-957e-bc96b3131d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=692489939e9744819b987e724b48d280, user_id=1ecd6c1b27a94d19b0ff6cb1db9f0ef2, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:47.182258 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfefa6a-de35-45b0-957e-bc96b3131d9b admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:47.193748 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1401/2790] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:38:47 2022] PUT /identity/v3/projects/692489939e9744819b987e724b48d280/users/1ecd6c1b27a94d19b0ff6cb1db9f0ef2/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:47.204653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f171182-ce58-4a85-8f1e-9ca8c6930d6e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:47.205027 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f171182-ce58-4a85-8f1e-9ca8c6930d6e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:47.205308 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f171182-ce58-4a85-8f1e-9ca8c6930d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:47.236835 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-1f171182-ce58-4a85-8f1e-9ca8c6930d6e None None] MFA Rules not processed for user `1ecd6c1b27a94d19b0ff6cb1db9f0ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:47.238061 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1f171182-ce58-4a85-8f1e-9ca8c6930d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:47.306216 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1390/2791] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:47 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 21:38:47.316131 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfefa6a-de35-45b0-957e-bc96b3131d9b admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:47.318148 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-4bfefa6a-de35-45b0-957e-bc96b3131d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:47.375561 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfefa6a-de35-45b0-957e-bc96b3131d9b admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:47.379429 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b57514-822a-4098-b0ed-824b46c3f45b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:47.380053 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b57514-822a-4098-b0ed-824b46c3f45b service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:47.380326 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b57514-822a-4098-b0ed-824b46c3f45b service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:47.380595 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b57514-822a-4098-b0ed-824b46c3f45b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:47.389300 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b57514-822a-4098-b0ed-824b46c3f45b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:47.390789 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b57514-822a-4098-b0ed-824b46c3f45b service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:47.399834 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1402/2792] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:38:47 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:38:47.523226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f171182-ce58-4a85-8f1e-9ca8c6930d6e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:47.593478 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f171182-ce58-4a85-8f1e-9ca8c6930d6e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:47.599473 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08370bf-3c76-4a54-a69c-049b8972974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:47.600372 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08370bf-3c76-4a54-a69c-049b8972974c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:47.600704 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08370bf-3c76-4a54-a69c-049b8972974c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:47.600931 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08370bf-3c76-4a54-a69c-049b8972974c admin admin] PATH_INFO: `/v3/users/76a7dbabb42f4a5d819be44d70b5acb4` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:47.602150 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08370bf-3c76-4a54-a69c-049b8972974c admin admin] RBAC: Authorizing `identity:delete_user(user_id=76a7dbabb42f4a5d819be44d70b5acb4)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:47.604081 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08370bf-3c76-4a54-a69c-049b8972974c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:47.654060 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e08370bf-3c76-4a54-a69c-049b8972974c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76a7dbabb42f4a5d819be44d70b5acb4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:47.661655 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e08370bf-3c76-4a54-a69c-049b8972974c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76a7dbabb42f4a5d819be44d70b5acb4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:47.675042 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e08370bf-3c76-4a54-a69c-049b8972974c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76a7dbabb42f4a5d819be44d70b5acb4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:47.676014 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e08370bf-3c76-4a54-a69c-049b8972974c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76a7dbabb42f4a5d819be44d70b5acb4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:47.684090 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e08370bf-3c76-4a54-a69c-049b8972974c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76a7dbabb42f4a5d819be44d70b5acb4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:47.689969 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1391/2793] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:38:47 2022] DELETE /identity/v3/users/76a7dbabb42f4a5d819be44d70b5acb4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:47.694566 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c72476-83fe-4010-8bf5-76c83945050d None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:47.694840 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c72476-83fe-4010-8bf5-76c83945050d None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:47.695111 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c72476-83fe-4010-8bf5-76c83945050d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:47.713163 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-c4c72476-83fe-4010-8bf5-76c83945050d None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:47.714385 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-c4c72476-83fe-4010-8bf5-76c83945050d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:47.779823 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1403/2794] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:47.791758 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08370bf-3c76-4a54-a69c-049b8972974c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:47.793287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e08370bf-3c76-4a54-a69c-049b8972974c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:47.849278 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08370bf-3c76-4a54-a69c-049b8972974c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:47.853799 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b0db9-997b-4bca-adad-194c1e118807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:47.854428 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b0db9-997b-4bca-adad-194c1e118807 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:47.854702 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b0db9-997b-4bca-adad-194c1e118807 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:47.854965 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b0db9-997b-4bca-adad-194c1e118807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:47.864533 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b0db9-997b-4bca-adad-194c1e118807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:47.865978 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b0db9-997b-4bca-adad-194c1e118807 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:47.875523 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1392/2795] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:38:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 21:38:48.147940 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c72476-83fe-4010-8bf5-76c83945050d None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:48.149514 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-c4c72476-83fe-4010-8bf5-76c83945050d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:48.161853 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c72476-83fe-4010-8bf5-76c83945050d None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:48.166493 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727b96f-c75b-4254-90ee-071676bdb5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:48.167349 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727b96f-c75b-4254-90ee-071676bdb5ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:48.167627 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727b96f-c75b-4254-90ee-071676bdb5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:48.167898 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727b96f-c75b-4254-90ee-071676bdb5ae admin admin] PATH_INFO: `/v3/projects/5712d0e340e34ebfa9e23c1876968dd6` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:48.169168 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727b96f-c75b-4254-90ee-071676bdb5ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=5712d0e340e34ebfa9e23c1876968dd6)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:48.171086 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727b96f-c75b-4254-90ee-071676bdb5ae admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:48.218260 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0727b96f-c75b-4254-90ee-071676bdb5ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5712d0e340e34ebfa9e23c1876968dd6', 'request_id': 'req-0727b96f-c75b-4254-90ee-071676bdb5ae'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:48.224490 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0727b96f-c75b-4254-90ee-071676bdb5ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5712d0e340e34ebfa9e23c1876968dd6', 'request_id': 'req-0727b96f-c75b-4254-90ee-071676bdb5ae'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:48.230727 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0727b96f-c75b-4254-90ee-071676bdb5ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5712d0e340e34ebfa9e23c1876968dd6', 'request_id': 'req-0727b96f-c75b-4254-90ee-071676bdb5ae'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:48.244541 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0727b96f-c75b-4254-90ee-071676bdb5ae admin admin] The token cache is being invalidate because project 5712d0e340e34ebfa9e23c1876968dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:38:48.244824 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0727b96f-c75b-4254-90ee-071676bdb5ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:48.245540 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-0727b96f-c75b-4254-90ee-071676bdb5ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:48.247497 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1404/2796] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:38:48 2022] DELETE /identity/v3/projects/5712d0e340e34ebfa9e23c1876968dd6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:48.252652 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b0db9-997b-4bca-adad-194c1e118807 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:48.262820 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b0db9-997b-4bca-adad-194c1e118807 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:48.328457 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ee038-2482-4602-8eae-20d6e48f1d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:48.329326 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ee038-2482-4602-8eae-20d6e48f1d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:48.329636 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ee038-2482-4602-8eae-20d6e48f1d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:48.329929 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ee038-2482-4602-8eae-20d6e48f1d4b admin admin] PATH_INFO: `/v3/users/1ecd6c1b27a94d19b0ff6cb1db9f0ef2` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:48.331219 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ee038-2482-4602-8eae-20d6e48f1d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ecd6c1b27a94d19b0ff6cb1db9f0ef2)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:48.333162 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ee038-2482-4602-8eae-20d6e48f1d4b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:48.381706 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9d7ee038-2482-4602-8eae-20d6e48f1d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ecd6c1b27a94d19b0ff6cb1db9f0ef2'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:48.388394 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9d7ee038-2482-4602-8eae-20d6e48f1d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ecd6c1b27a94d19b0ff6cb1db9f0ef2'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:48.399951 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9d7ee038-2482-4602-8eae-20d6e48f1d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ecd6c1b27a94d19b0ff6cb1db9f0ef2'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:48.400574 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9d7ee038-2482-4602-8eae-20d6e48f1d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ecd6c1b27a94d19b0ff6cb1db9f0ef2'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:48.409746 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9d7ee038-2482-4602-8eae-20d6e48f1d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ecd6c1b27a94d19b0ff6cb1db9f0ef2'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:48.418387 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1393/2797] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:38:48 2022] DELETE /identity/v3/users/1ecd6c1b27a94d19b0ff6cb1db9f0ef2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 21:38:48.694048 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727b96f-c75b-4254-90ee-071676bdb5ae admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:48.695559 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-0727b96f-c75b-4254-90ee-071676bdb5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:48.709749 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727b96f-c75b-4254-90ee-071676bdb5ae admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:48.780679 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151f682-8dfd-4800-94c9-976cef9aeda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:48.781749 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151f682-8dfd-4800-94c9-976cef9aeda7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:48.782101 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151f682-8dfd-4800-94c9-976cef9aeda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:48.782369 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151f682-8dfd-4800-94c9-976cef9aeda7 admin admin] PATH_INFO: `/v3/projects/692489939e9744819b987e724b48d280` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:48.783612 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151f682-8dfd-4800-94c9-976cef9aeda7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=692489939e9744819b987e724b48d280)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:48.785593 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151f682-8dfd-4800-94c9-976cef9aeda7 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:48.832303 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b151f682-8dfd-4800-94c9-976cef9aeda7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '692489939e9744819b987e724b48d280', 'request_id': 'req-b151f682-8dfd-4800-94c9-976cef9aeda7'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:48.838059 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b151f682-8dfd-4800-94c9-976cef9aeda7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '692489939e9744819b987e724b48d280', 'request_id': 'req-b151f682-8dfd-4800-94c9-976cef9aeda7'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:48.844664 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b151f682-8dfd-4800-94c9-976cef9aeda7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '692489939e9744819b987e724b48d280', 'request_id': 'req-b151f682-8dfd-4800-94c9-976cef9aeda7'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:48.858812 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b151f682-8dfd-4800-94c9-976cef9aeda7 admin admin] The token cache is being invalidate because project 692489939e9744819b987e724b48d280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:38:48.859093 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b151f682-8dfd-4800-94c9-976cef9aeda7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:48.859778 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-b151f682-8dfd-4800-94c9-976cef9aeda7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:48.861411 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1405/2798] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:38:48 2022] DELETE /identity/v3/projects/692489939e9744819b987e724b48d280 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:48.866568 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3c84e-884d-428d-8b55-df93853da479 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:48.866875 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3c84e-884d-428d-8b55-df93853da479 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:48.867144 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3c84e-884d-428d-8b55-df93853da479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:48.890228 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-dcd3c84e-884d-428d-8b55-df93853da479 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:48.891477 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-dcd3c84e-884d-428d-8b55-df93853da479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:48.952979 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1394/2799] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:48.961091 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f14089-625e-4d5d-9ea6-6225f58fb304 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:48.961374 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f14089-625e-4d5d-9ea6-6225f58fb304 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:48.961679 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f14089-625e-4d5d-9ea6-6225f58fb304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:48.981634 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-17f14089-625e-4d5d-9ea6-6225f58fb304 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:48.982836 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-17f14089-625e-4d5d-9ea6-6225f58fb304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:48.991439 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1406/2800] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:48.995709 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3c84e-884d-428d-8b55-df93853da479 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:49.005849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3c84e-884d-428d-8b55-df93853da479 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:49.010454 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0c35c-7417-4cdd-96a7-0ea6d2def4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:49.011108 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0c35c-7417-4cdd-96a7-0ea6d2def4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:49.011374 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0c35c-7417-4cdd-96a7-0ea6d2def4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:49.011638 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0c35c-7417-4cdd-96a7-0ea6d2def4a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:49.012360 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0c35c-7417-4cdd-96a7-0ea6d2def4a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:38:49.012659 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0c35c-7417-4cdd-96a7-0ea6d2def4a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:49.014266 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0c35c-7417-4cdd-96a7-0ea6d2def4a5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:49.025929 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1395/2801] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:38:49.030135 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f14089-625e-4d5d-9ea6-6225f58fb304 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:49.039246 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f14089-625e-4d5d-9ea6-6225f58fb304 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:49.045131 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4ffcd-6035-46e5-8492-e5d1ad67f85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:49.045837 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4ffcd-6035-46e5-8492-e5d1ad67f85d admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:49.046188 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4ffcd-6035-46e5-8492-e5d1ad67f85d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:49.046811 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4ffcd-6035-46e5-8492-e5d1ad67f85d admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:49.047567 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4ffcd-6035-46e5-8492-e5d1ad67f85d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:49.049503 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4ffcd-6035-46e5-8492-e5d1ad67f85d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:49.078389 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1407/2802] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:38:49 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:38:49.082648 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0c35c-7417-4cdd-96a7-0ea6d2def4a5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:49.092693 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0c35c-7417-4cdd-96a7-0ea6d2def4a5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:49.150586 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45eab75-d9c5-4824-92b8-a11adc7228ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:49.151244 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45eab75-d9c5-4824-92b8-a11adc7228ef admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:49.151529 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45eab75-d9c5-4824-92b8-a11adc7228ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:49.151801 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45eab75-d9c5-4824-92b8-a11adc7228ef admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:49.152489 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45eab75-d9c5-4824-92b8-a11adc7228ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:49.154433 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45eab75-d9c5-4824-92b8-a11adc7228ef admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:49.178116 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1396/2803] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:38:49 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:38:49.182758 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4ffcd-6035-46e5-8492-e5d1ad67f85d admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:49.193571 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4ffcd-6035-46e5-8492-e5d1ad67f85d admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:49.199398 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87e52a-67bc-4371-8445-e5004ecd3d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:49.200083 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87e52a-67bc-4371-8445-e5004ecd3d06 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:49.200351 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87e52a-67bc-4371-8445-e5004ecd3d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:49.200610 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87e52a-67bc-4371-8445-e5004ecd3d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:49.201333 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87e52a-67bc-4371-8445-e5004ecd3d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:49.203089 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87e52a-67bc-4371-8445-e5004ecd3d06 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:49.213514 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1408/2804] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:38:49.219284 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45eab75-d9c5-4824-92b8-a11adc7228ef admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:49.234094 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45eab75-d9c5-4824-92b8-a11adc7228ef admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:49.241933 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eec65a-bb91-4200-894c-1f542a93287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:49.242583 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eec65a-bb91-4200-894c-1f542a93287a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:49.242857 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eec65a-bb91-4200-894c-1f542a93287a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:49.243120 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eec65a-bb91-4200-894c-1f542a93287a admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:49.243854 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eec65a-bb91-4200-894c-1f542a93287a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:49.245467 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eec65a-bb91-4200-894c-1f542a93287a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:49.256113 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1397/2805] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:38:49.260347 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87e52a-67bc-4371-8445-e5004ecd3d06 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:49.270513 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87e52a-67bc-4371-8445-e5004ecd3d06 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:49.276211 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d12d7-6730-402c-882b-4b3900893742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:49.277072 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d12d7-6730-402c-882b-4b3900893742 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:49.277381 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d12d7-6730-402c-882b-4b3900893742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:49.277643 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d12d7-6730-402c-882b-4b3900893742 admin admin] PATH_INFO: `/v3/projects/7f655e8babac42bb9b1eb14f15ac1a45/users/cd03d785396243fdaaca950e3956b854/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:49.292440 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d12d7-6730-402c-882b-4b3900893742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f655e8babac42bb9b1eb14f15ac1a45, user_id=cd03d785396243fdaaca950e3956b854, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:49.295094 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d12d7-6730-402c-882b-4b3900893742 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:49.311217 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1409/2806] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:38:49 2022] PUT /identity/v3/projects/7f655e8babac42bb9b1eb14f15ac1a45/users/cd03d785396243fdaaca950e3956b854/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:49.322735 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441baa98-d5d1-46b4-8f45-4223abf72794 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:49.323040 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441baa98-d5d1-46b4-8f45-4223abf72794 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:49.323311 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441baa98-d5d1-46b4-8f45-4223abf72794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:49.363759 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-441baa98-d5d1-46b4-8f45-4223abf72794 None None] MFA Rules not processed for user `cd03d785396243fdaaca950e3956b854`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:49.365787 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-441baa98-d5d1-46b4-8f45-4223abf72794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:49.437783 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1398/2807] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:49.442556 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d12d7-6730-402c-882b-4b3900893742 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:49.505689 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d12d7-6730-402c-882b-4b3900893742 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:49.510716 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52560f31-5b1c-4465-bc1e-fd82de634a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:49.511366 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52560f31-5b1c-4465-bc1e-fd82de634a82 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:49.511654 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52560f31-5b1c-4465-bc1e-fd82de634a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:49.511921 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52560f31-5b1c-4465-bc1e-fd82de634a82 admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:49.512623 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52560f31-5b1c-4465-bc1e-fd82de634a82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:49.514552 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52560f31-5b1c-4465-bc1e-fd82de634a82 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:49.540918 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1410/2808] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:38:49 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:38:49.545141 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441baa98-d5d1-46b4-8f45-4223abf72794 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:49.556842 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441baa98-d5d1-46b4-8f45-4223abf72794 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:49.614658 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9076f56-28ef-43de-820e-4f632b0e1566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:49.615289 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9076f56-28ef-43de-820e-4f632b0e1566 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:49.615588 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9076f56-28ef-43de-820e-4f632b0e1566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:49.615861 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9076f56-28ef-43de-820e-4f632b0e1566 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:49.616554 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9076f56-28ef-43de-820e-4f632b0e1566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:49.618510 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9076f56-28ef-43de-820e-4f632b0e1566 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:49.641298 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1399/2809] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:38:49 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:38:49.645328 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52560f31-5b1c-4465-bc1e-fd82de634a82 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:49.655775 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52560f31-5b1c-4465-bc1e-fd82de634a82 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:49.661980 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cb9d5-5434-4126-9d2a-09b9eed11973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:49.662636 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cb9d5-5434-4126-9d2a-09b9eed11973 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:49.662914 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cb9d5-5434-4126-9d2a-09b9eed11973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:49.663180 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cb9d5-5434-4126-9d2a-09b9eed11973 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:49.663905 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cb9d5-5434-4126-9d2a-09b9eed11973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:49.665531 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cb9d5-5434-4126-9d2a-09b9eed11973 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:49.679604 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1411/2810] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:38:49.683970 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9076f56-28ef-43de-820e-4f632b0e1566 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:49.695222 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9076f56-28ef-43de-820e-4f632b0e1566 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:49.700963 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6b779-42b1-493d-b960-0578d3094b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:49.702147 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6b779-42b1-493d-b960-0578d3094b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:49.702400 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6b779-42b1-493d-b960-0578d3094b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:49.702670 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6b779-42b1-493d-b960-0578d3094b8c admin admin] PATH_INFO: `/v3/projects/8ec4689eb96947e2b557cb005cccb57a/users/b961cba4b4d942dc9d8975d461979347/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:49.729127 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6b779-42b1-493d-b960-0578d3094b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec4689eb96947e2b557cb005cccb57a, user_id=b961cba4b4d942dc9d8975d461979347, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:49.733175 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6b779-42b1-493d-b960-0578d3094b8c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:49.752006 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1400/2811] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:38:49 2022] PUT /identity/v3/projects/8ec4689eb96947e2b557cb005cccb57a/users/b961cba4b4d942dc9d8975d461979347/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:49.756083 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cb9d5-5434-4126-9d2a-09b9eed11973 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:49.768577 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cb9d5-5434-4126-9d2a-09b9eed11973 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:49.825125 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd911034-b2ef-4c0b-ae6c-0999a2cee80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:49.825825 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd911034-b2ef-4c0b-ae6c-0999a2cee80d admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:49.826103 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd911034-b2ef-4c0b-ae6c-0999a2cee80d admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:49.826374 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd911034-b2ef-4c0b-ae6c-0999a2cee80d admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:49.827217 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd911034-b2ef-4c0b-ae6c-0999a2cee80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:49.828784 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd911034-b2ef-4c0b-ae6c-0999a2cee80d admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:49.839088 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1412/2812] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:38:49.843458 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6b779-42b1-493d-b960-0578d3094b8c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:49.854702 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6b779-42b1-493d-b960-0578d3094b8c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:49.860045 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968c9a7-33a2-49e7-ba33-62474d00adae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:49.862044 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968c9a7-33a2-49e7-ba33-62474d00adae admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:49.862166 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968c9a7-33a2-49e7-ba33-62474d00adae admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:49.862440 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968c9a7-33a2-49e7-ba33-62474d00adae admin admin] PATH_INFO: `/v3/projects/8ec4689eb96947e2b557cb005cccb57a/users/b961cba4b4d942dc9d8975d461979347/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:49.864517 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968c9a7-33a2-49e7-ba33-62474d00adae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec4689eb96947e2b557cb005cccb57a, user_id=b961cba4b4d942dc9d8975d461979347, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:49.867550 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968c9a7-33a2-49e7-ba33-62474d00adae admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:49.878534 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1401/2813] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:38:49 2022] PUT /identity/v3/projects/8ec4689eb96947e2b557cb005cccb57a/users/b961cba4b4d942dc9d8975d461979347/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:49.889329 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a944c4-e8ab-49b7-ae0f-f985e1c46de0 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:49.889781 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a944c4-e8ab-49b7-ae0f-f985e1c46de0 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:49.889982 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a944c4-e8ab-49b7-ae0f-f985e1c46de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:49.916632 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-51a944c4-e8ab-49b7-ae0f-f985e1c46de0 None None] MFA Rules not processed for user `b961cba4b4d942dc9d8975d461979347`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:49.917861 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-51a944c4-e8ab-49b7-ae0f-f985e1c46de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:49.984929 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1413/2814] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:49.996899 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968c9a7-33a2-49e7-ba33-62474d00adae admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:49.999070 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3968c9a7-33a2-49e7-ba33-62474d00adae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:50.058547 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968c9a7-33a2-49e7-ba33-62474d00adae admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:50.062653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0dd5fe-0363-4feb-bfe4-a9f4b585307d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:50.063374 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dd5fe-0363-4feb-bfe4-a9f4b585307d service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:50.063654 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dd5fe-0363-4feb-bfe4-a9f4b585307d service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:50.063922 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dd5fe-0363-4feb-bfe4-a9f4b585307d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:50.073682 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0dd5fe-0363-4feb-bfe4-a9f4b585307d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:50.075375 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0dd5fe-0363-4feb-bfe4-a9f4b585307d service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:50.085464 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1402/2815] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:38:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:38:50.112705 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a944c4-e8ab-49b7-ae0f-f985e1c46de0 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:50.173798 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a944c4-e8ab-49b7-ae0f-f985e1c46de0 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:50.179081 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8196272-80c2-4ade-8f52-544b4c13f613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:50.179938 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8196272-80c2-4ade-8f52-544b4c13f613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:50.180214 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8196272-80c2-4ade-8f52-544b4c13f613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:50.180484 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8196272-80c2-4ade-8f52-544b4c13f613 admin admin] PATH_INFO: `/v3/users/cd03d785396243fdaaca950e3956b854` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:50.181745 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8196272-80c2-4ade-8f52-544b4c13f613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd03d785396243fdaaca950e3956b854)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:50.183643 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8196272-80c2-4ade-8f52-544b4c13f613 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:50.232107 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d8196272-80c2-4ade-8f52-544b4c13f613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd03d785396243fdaaca950e3956b854'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:50.240091 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d8196272-80c2-4ade-8f52-544b4c13f613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd03d785396243fdaaca950e3956b854'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:50.254063 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d8196272-80c2-4ade-8f52-544b4c13f613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd03d785396243fdaaca950e3956b854'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:50.254920 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d8196272-80c2-4ade-8f52-544b4c13f613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd03d785396243fdaaca950e3956b854'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:50.255692 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-d8196272-80c2-4ade-8f52-544b4c13f613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd03d785396243fdaaca950e3956b854'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:50.269963 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1414/2816] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:38:50 2022] DELETE /identity/v3/users/cd03d785396243fdaaca950e3956b854 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:50.275010 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b5d49-32bd-417b-8471-d56368be891d None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:50.275535 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b5d49-32bd-417b-8471-d56368be891d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:50.275535 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b5d49-32bd-417b-8471-d56368be891d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:50.293819 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-247b5d49-32bd-417b-8471-d56368be891d None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:50.295017 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-247b5d49-32bd-417b-8471-d56368be891d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:50.355297 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1403/2817] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:50.366518 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8196272-80c2-4ade-8f52-544b4c13f613 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:50.368141 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d8196272-80c2-4ade-8f52-544b4c13f613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:50.425857 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8196272-80c2-4ade-8f52-544b4c13f613 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:50.430714 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7d207-909a-4490-b216-34ce32f93592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:50.431407 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7d207-909a-4490-b216-34ce32f93592 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:50.431679 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7d207-909a-4490-b216-34ce32f93592 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:50.431949 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7d207-909a-4490-b216-34ce32f93592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:50.441406 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7d207-909a-4490-b216-34ce32f93592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:50.442831 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7d207-909a-4490-b216-34ce32f93592 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:50.452360 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1415/2818] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:38:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:38:50.717310 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b5d49-32bd-417b-8471-d56368be891d None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:50.718739 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-247b5d49-32bd-417b-8471-d56368be891d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:50.731426 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b5d49-32bd-417b-8471-d56368be891d None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:50.737759 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c04f17-0db6-4617-96db-c9e346a36edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:50.738914 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c04f17-0db6-4617-96db-c9e346a36edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:50.739250 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c04f17-0db6-4617-96db-c9e346a36edf admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:50.739740 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c04f17-0db6-4617-96db-c9e346a36edf admin admin] PATH_INFO: `/v3/projects/7f655e8babac42bb9b1eb14f15ac1a45` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:50.743744 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c04f17-0db6-4617-96db-c9e346a36edf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f655e8babac42bb9b1eb14f15ac1a45)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:50.746107 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c04f17-0db6-4617-96db-c9e346a36edf admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:50.797940 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d5c04f17-0db6-4617-96db-c9e346a36edf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f655e8babac42bb9b1eb14f15ac1a45', 'request_id': 'req-d5c04f17-0db6-4617-96db-c9e346a36edf'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:50.804584 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d5c04f17-0db6-4617-96db-c9e346a36edf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f655e8babac42bb9b1eb14f15ac1a45', 'request_id': 'req-d5c04f17-0db6-4617-96db-c9e346a36edf'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:50.811497 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d5c04f17-0db6-4617-96db-c9e346a36edf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f655e8babac42bb9b1eb14f15ac1a45', 'request_id': 'req-d5c04f17-0db6-4617-96db-c9e346a36edf'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:50.824824 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d5c04f17-0db6-4617-96db-c9e346a36edf admin admin] The token cache is being invalidate because project 7f655e8babac42bb9b1eb14f15ac1a45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:38:50.825098 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d5c04f17-0db6-4617-96db-c9e346a36edf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:50.825722 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d5c04f17-0db6-4617-96db-c9e346a36edf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:50.827223 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1404/2819] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:38:50 2022] DELETE /identity/v3/projects/7f655e8babac42bb9b1eb14f15ac1a45 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:50.831306 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7d207-909a-4490-b216-34ce32f93592 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:50.841232 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7d207-909a-4490-b216-34ce32f93592 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:50.908395 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c831b-477f-4600-8dbf-03086bb3e551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:50.909180 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c831b-477f-4600-8dbf-03086bb3e551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:50.909492 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c831b-477f-4600-8dbf-03086bb3e551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:50.909758 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c831b-477f-4600-8dbf-03086bb3e551 admin admin] PATH_INFO: `/v3/users/b961cba4b4d942dc9d8975d461979347` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:50.910999 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c831b-477f-4600-8dbf-03086bb3e551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b961cba4b4d942dc9d8975d461979347)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:50.912930 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c831b-477f-4600-8dbf-03086bb3e551 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:50.934289 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c04f17-0db6-4617-96db-c9e346a36edf admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:50.935808 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d5c04f17-0db6-4617-96db-c9e346a36edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:50.948596 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c04f17-0db6-4617-96db-c9e346a36edf admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:50.953505 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196d936-a192-4723-8b59-21a6086ade5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:50.954388 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196d936-a192-4723-8b59-21a6086ade5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:50.954665 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196d936-a192-4723-8b59-21a6086ade5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:50.954929 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196d936-a192-4723-8b59-21a6086ade5f admin admin] PATH_INFO: `/v3/users/ed36955ebbe14443b2a6eb74cd184dcc` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:50.956162 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196d936-a192-4723-8b59-21a6086ade5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed36955ebbe14443b2a6eb74cd184dcc)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:50.958097 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196d936-a192-4723-8b59-21a6086ade5f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:50.961579 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ae4c831b-477f-4600-8dbf-03086bb3e551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b961cba4b4d942dc9d8975d461979347'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:50.968256 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ae4c831b-477f-4600-8dbf-03086bb3e551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b961cba4b4d942dc9d8975d461979347'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:50.980451 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ae4c831b-477f-4600-8dbf-03086bb3e551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b961cba4b4d942dc9d8975d461979347'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:50.981693 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ae4c831b-477f-4600-8dbf-03086bb3e551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b961cba4b4d942dc9d8975d461979347'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:50.982415 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-ae4c831b-477f-4600-8dbf-03086bb3e551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b961cba4b4d942dc9d8975d461979347'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:50.996436 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1416/2820] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:38:50 2022] DELETE /identity/v3/users/b961cba4b4d942dc9d8975d461979347 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:51.006452 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0196d936-a192-4723-8b59-21a6086ade5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed36955ebbe14443b2a6eb74cd184dcc'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:51.012969 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0196d936-a192-4723-8b59-21a6086ade5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed36955ebbe14443b2a6eb74cd184dcc'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:51.024258 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0196d936-a192-4723-8b59-21a6086ade5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed36955ebbe14443b2a6eb74cd184dcc'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:51.024965 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0196d936-a192-4723-8b59-21a6086ade5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed36955ebbe14443b2a6eb74cd184dcc'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:51.034061 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0196d936-a192-4723-8b59-21a6086ade5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed36955ebbe14443b2a6eb74cd184dcc'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:51.040497 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1405/2821] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:38:50 2022] DELETE /identity/v3/users/ed36955ebbe14443b2a6eb74cd184dcc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:51.045305 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6542d7-2bbd-4b84-9d3f-f074948572b3 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:51.045576 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6542d7-2bbd-4b84-9d3f-f074948572b3 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:51.045904 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6542d7-2bbd-4b84-9d3f-f074948572b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:51.065000 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-7a6542d7-2bbd-4b84-9d3f-f074948572b3 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:51.066575 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-7a6542d7-2bbd-4b84-9d3f-f074948572b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:51.124911 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1417/2822] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:51.136071 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196d936-a192-4723-8b59-21a6086ade5f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:51.137672 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0196d936-a192-4723-8b59-21a6086ade5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:51.207106 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196d936-a192-4723-8b59-21a6086ade5f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:51.210907 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a2d76-f58f-453a-9641-9e92cd3822b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:51.211904 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a2d76-f58f-453a-9641-9e92cd3822b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:51.211904 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a2d76-f58f-453a-9641-9e92cd3822b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:51.212111 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a2d76-f58f-453a-9641-9e92cd3822b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:51.221089 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a2d76-f58f-453a-9641-9e92cd3822b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:51.222563 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a2d76-f58f-453a-9641-9e92cd3822b0 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:51.231810 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1406/2823] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:38:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:38:51.274398 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6542d7-2bbd-4b84-9d3f-f074948572b3 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:51.276147 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-7a6542d7-2bbd-4b84-9d3f-f074948572b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:51.296855 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6542d7-2bbd-4b84-9d3f-f074948572b3 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:51.302600 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56858009-eec5-4382-aadc-917304919520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:51.303516 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56858009-eec5-4382-aadc-917304919520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:51.303775 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56858009-eec5-4382-aadc-917304919520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:51.304059 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56858009-eec5-4382-aadc-917304919520 admin admin] PATH_INFO: `/v3/projects/8ec4689eb96947e2b557cb005cccb57a` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:51.305268 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56858009-eec5-4382-aadc-917304919520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ec4689eb96947e2b557cb005cccb57a)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:51.307386 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56858009-eec5-4382-aadc-917304919520 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:51.354351 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-56858009-eec5-4382-aadc-917304919520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ec4689eb96947e2b557cb005cccb57a', 'request_id': 'req-56858009-eec5-4382-aadc-917304919520'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:51.359842 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-56858009-eec5-4382-aadc-917304919520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ec4689eb96947e2b557cb005cccb57a', 'request_id': 'req-56858009-eec5-4382-aadc-917304919520'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:51.366060 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-56858009-eec5-4382-aadc-917304919520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ec4689eb96947e2b557cb005cccb57a', 'request_id': 'req-56858009-eec5-4382-aadc-917304919520'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:51.384159 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-56858009-eec5-4382-aadc-917304919520 admin admin] The token cache is being invalidate because project 8ec4689eb96947e2b557cb005cccb57a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:38:51.384775 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-56858009-eec5-4382-aadc-917304919520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:51.385028 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-56858009-eec5-4382-aadc-917304919520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:51.386903 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1418/2824] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:38:51 2022] DELETE /identity/v3/projects/8ec4689eb96947e2b557cb005cccb57a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:51.392276 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2c07b-8c6b-4513-bcb2-07993ec010b1 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:51.392276 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2c07b-8c6b-4513-bcb2-07993ec010b1 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:51.392802 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2c07b-8c6b-4513-bcb2-07993ec010b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:51.409905 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-79f2c07b-8c6b-4513-bcb2-07993ec010b1 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:51.411106 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-79f2c07b-8c6b-4513-bcb2-07993ec010b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:51.469535 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1407/2825] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:51.477131 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56abd2-8388-4fd7-8ff9-244ffd948886 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:51.477444 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56abd2-8388-4fd7-8ff9-244ffd948886 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:51.477718 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56abd2-8388-4fd7-8ff9-244ffd948886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:51.496554 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-1a56abd2-8388-4fd7-8ff9-244ffd948886 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:51.497793 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-1a56abd2-8388-4fd7-8ff9-244ffd948886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:51.502348 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2c07b-8c6b-4513-bcb2-07993ec010b1 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:51.503979 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-79f2c07b-8c6b-4513-bcb2-07993ec010b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:51.511688 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1419/2826] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:51.512575 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56abd2-8388-4fd7-8ff9-244ffd948886 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:51.521739 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56abd2-8388-4fd7-8ff9-244ffd948886 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:51.526217 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2c07b-8c6b-4513-bcb2-07993ec010b1 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:51.530496 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c46a8c-5986-4cec-891f-039af05746ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:51.531169 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c46a8c-5986-4cec-891f-039af05746ac admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:51.531438 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c46a8c-5986-4cec-891f-039af05746ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:51.531607 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dca0c-512a-4b0b-a8ec-356d06ffb0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:51.531725 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c46a8c-5986-4cec-891f-039af05746ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:51.532531 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c46a8c-5986-4cec-891f-039af05746ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:38:51.532632 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dca0c-512a-4b0b-a8ec-356d06ffb0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:51.532806 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dca0c-512a-4b0b-a8ec-356d06ffb0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:51.532901 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c46a8c-5986-4cec-891f-039af05746ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:51.533077 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dca0c-512a-4b0b-a8ec-356d06ffb0a1 admin admin] PATH_INFO: `/v3/projects/3a2a1b1299c240089cbb3b803e67352e` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:51.534389 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0dca0c-512a-4b0b-a8ec-356d06ffb0a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2a1b1299c240089cbb3b803e67352e)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:51.534595 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c46a8c-5986-4cec-891f-039af05746ac admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:51.536442 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0dca0c-512a-4b0b-a8ec-356d06ffb0a1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:51.548119 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1420/2827] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:38:51.554287 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c46a8c-5986-4cec-891f-039af05746ac admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:51.563917 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c46a8c-5986-4cec-891f-039af05746ac admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:51.569833 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47032918-3547-4eac-ad55-c00623103faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:51.570482 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47032918-3547-4eac-ad55-c00623103faa admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:51.570785 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47032918-3547-4eac-ad55-c00623103faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:51.571053 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47032918-3547-4eac-ad55-c00623103faa admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:51.571745 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47032918-3547-4eac-ad55-c00623103faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:51.573813 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47032918-3547-4eac-ad55-c00623103faa admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:51.585532 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4f0dca0c-512a-4b0b-a8ec-356d06ffb0a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2a1b1299c240089cbb3b803e67352e', 'request_id': 'req-4f0dca0c-512a-4b0b-a8ec-356d06ffb0a1'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:51.590903 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4f0dca0c-512a-4b0b-a8ec-356d06ffb0a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2a1b1299c240089cbb3b803e67352e', 'request_id': 'req-4f0dca0c-512a-4b0b-a8ec-356d06ffb0a1'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:51.597163 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4f0dca0c-512a-4b0b-a8ec-356d06ffb0a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2a1b1299c240089cbb3b803e67352e', 'request_id': 'req-4f0dca0c-512a-4b0b-a8ec-356d06ffb0a1'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:51.601017 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1421/2828] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:38:51 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:38:51.605226 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47032918-3547-4eac-ad55-c00623103faa admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:51.613034 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4f0dca0c-512a-4b0b-a8ec-356d06ffb0a1 admin admin] The token cache is being invalidate because project 3a2a1b1299c240089cbb3b803e67352e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:38:51.613315 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4f0dca0c-512a-4b0b-a8ec-356d06ffb0a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:51.613999 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4f0dca0c-512a-4b0b-a8ec-356d06ffb0a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:51.615703 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1408/2829] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:38:51 2022] DELETE /identity/v3/projects/3a2a1b1299c240089cbb3b803e67352e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 21:38:51.668451 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47032918-3547-4eac-ad55-c00623103faa admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:51.674243 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ffea4-be84-437d-98fd-1cea27564552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:51.674942 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ffea4-be84-437d-98fd-1cea27564552 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:51.675224 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ffea4-be84-437d-98fd-1cea27564552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:51.675484 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ffea4-be84-437d-98fd-1cea27564552 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:51.676218 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ffea4-be84-437d-98fd-1cea27564552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:51.678227 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ffea4-be84-437d-98fd-1cea27564552 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:51.701235 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1422/2830] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:38:51 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 21:38:51.705730 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dca0c-512a-4b0b-a8ec-356d06ffb0a1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:51.707414 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4f0dca0c-512a-4b0b-a8ec-356d06ffb0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:51.777394 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dca0c-512a-4b0b-a8ec-356d06ffb0a1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:51.783198 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445a4e3-68bf-4d64-b2dc-2a9107b935cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:51.783889 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445a4e3-68bf-4d64-b2dc-2a9107b935cd admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:51.784174 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445a4e3-68bf-4d64-b2dc-2a9107b935cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:51.784441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445a4e3-68bf-4d64-b2dc-2a9107b935cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:51.785183 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445a4e3-68bf-4d64-b2dc-2a9107b935cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:51.786818 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445a4e3-68bf-4d64-b2dc-2a9107b935cd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:51.798227 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1409/2831] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:38:51.802438 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ffea4-be84-437d-98fd-1cea27564552 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:51.812795 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ffea4-be84-437d-98fd-1cea27564552 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:51.817939 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3fa0e-8d8d-43f9-9079-b7396b9c6cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:51.818702 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3fa0e-8d8d-43f9-9079-b7396b9c6cee admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:51.819065 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3fa0e-8d8d-43f9-9079-b7396b9c6cee admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:51.819432 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3fa0e-8d8d-43f9-9079-b7396b9c6cee admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:51.820235 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3fa0e-8d8d-43f9-9079-b7396b9c6cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:51.822030 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3fa0e-8d8d-43f9-9079-b7396b9c6cee admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:51.832911 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1423/2832] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:38:51.837278 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445a4e3-68bf-4d64-b2dc-2a9107b935cd admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:51.847411 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445a4e3-68bf-4d64-b2dc-2a9107b935cd admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:51.852287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16aaea-56cf-4eea-a3f7-6add56a38310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:51.853156 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16aaea-56cf-4eea-a3f7-6add56a38310 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:51.853478 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16aaea-56cf-4eea-a3f7-6add56a38310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:51.853746 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16aaea-56cf-4eea-a3f7-6add56a38310 admin admin] PATH_INFO: `/v3/projects/10200a136a774a94b2538d92fb58b515/users/cd9e2f6d47a5465ba9b4353b4136fdfe/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:51.868725 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16aaea-56cf-4eea-a3f7-6add56a38310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10200a136a774a94b2538d92fb58b515, user_id=cd9e2f6d47a5465ba9b4353b4136fdfe, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:51.871458 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16aaea-56cf-4eea-a3f7-6add56a38310 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:51.888087 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1410/2833] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:38:51 2022] PUT /identity/v3/projects/10200a136a774a94b2538d92fb58b515/users/cd9e2f6d47a5465ba9b4353b4136fdfe/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:51.899332 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87f42c-86ff-4292-8925-f268351f0c12 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:51.899614 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87f42c-86ff-4292-8925-f268351f0c12 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:51.899880 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87f42c-86ff-4292-8925-f268351f0c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:51.926340 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-8b87f42c-86ff-4292-8925-f268351f0c12 None None] MFA Rules not processed for user `cd9e2f6d47a5465ba9b4353b4136fdfe`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:51.927503 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-8b87f42c-86ff-4292-8925-f268351f0c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:52.002750 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1424/2834] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:52.009522 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16aaea-56cf-4eea-a3f7-6add56a38310 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:52.073969 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16aaea-56cf-4eea-a3f7-6add56a38310 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:52.079320 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6ee47-6e30-4eca-8c92-e605d3ce72b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:52.079968 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6ee47-6e30-4eca-8c92-e605d3ce72b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:52.080245 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6ee47-6e30-4eca-8c92-e605d3ce72b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:52.080521 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6ee47-6e30-4eca-8c92-e605d3ce72b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:52.081214 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6ee47-6e30-4eca-8c92-e605d3ce72b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:52.083151 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6ee47-6e30-4eca-8c92-e605d3ce72b6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:52.111837 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1411/2835] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:38:52 2022] POST /identity/v3/projects => generated 391 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:38:52.116160 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87f42c-86ff-4292-8925-f268351f0c12 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:52.126870 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87f42c-86ff-4292-8925-f268351f0c12 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:52.189890 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7309c-d1fa-46e7-94dc-1d1802d31fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:52.190548 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7309c-d1fa-46e7-94dc-1d1802d31fcb admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:52.190830 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7309c-d1fa-46e7-94dc-1d1802d31fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:52.191098 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7309c-d1fa-46e7-94dc-1d1802d31fcb admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:52.191802 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7309c-d1fa-46e7-94dc-1d1802d31fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:52.193794 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7309c-d1fa-46e7-94dc-1d1802d31fcb admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:52.214892 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1425/2836] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:38:52 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 21:38:52.218984 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6ee47-6e30-4eca-8c92-e605d3ce72b6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:52.229149 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6ee47-6e30-4eca-8c92-e605d3ce72b6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:52.234027 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28205057-24ac-4e2c-9ee5-2f2191596b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:52.234677 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28205057-24ac-4e2c-9ee5-2f2191596b36 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:52.234977 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28205057-24ac-4e2c-9ee5-2f2191596b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:52.235259 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28205057-24ac-4e2c-9ee5-2f2191596b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:52.235991 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28205057-24ac-4e2c-9ee5-2f2191596b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:52.237741 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28205057-24ac-4e2c-9ee5-2f2191596b36 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:52.248654 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1412/2837] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:38:52.252680 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7309c-d1fa-46e7-94dc-1d1802d31fcb admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:52.263023 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7309c-d1fa-46e7-94dc-1d1802d31fcb admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:52.267920 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e173e52-06ad-42c5-9dd4-832461ad3044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:52.268788 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e173e52-06ad-42c5-9dd4-832461ad3044 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:52.269087 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e173e52-06ad-42c5-9dd4-832461ad3044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:52.269342 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e173e52-06ad-42c5-9dd4-832461ad3044 admin admin] PATH_INFO: `/v3/projects/52ceb9c268a6419480832d9d11bb4eca/users/d4b87d5acc8f44fd9b63a61f969a9925/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:52.284021 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e173e52-06ad-42c5-9dd4-832461ad3044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ceb9c268a6419480832d9d11bb4eca, user_id=d4b87d5acc8f44fd9b63a61f969a9925, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:52.287081 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e173e52-06ad-42c5-9dd4-832461ad3044 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:52.301483 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1426/2838] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:38:52 2022] PUT /identity/v3/projects/52ceb9c268a6419480832d9d11bb4eca/users/d4b87d5acc8f44fd9b63a61f969a9925/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:52.305232 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28205057-24ac-4e2c-9ee5-2f2191596b36 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:52.316843 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28205057-24ac-4e2c-9ee5-2f2191596b36 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:52.379919 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1d065-2136-4f8a-8618-f02070ee4977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:52.380504 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1d065-2136-4f8a-8618-f02070ee4977 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:52.380789 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1d065-2136-4f8a-8618-f02070ee4977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:52.381055 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1d065-2136-4f8a-8618-f02070ee4977 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:52.381825 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1d065-2136-4f8a-8618-f02070ee4977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:52.383458 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1d065-2136-4f8a-8618-f02070ee4977 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:52.394066 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1413/2839] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:38:52.399563 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e173e52-06ad-42c5-9dd4-832461ad3044 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:52.410677 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e173e52-06ad-42c5-9dd4-832461ad3044 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:52.415780 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07451d79-b9a5-4cc7-9e01-c1adeaaa5c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:52.416651 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07451d79-b9a5-4cc7-9e01-c1adeaaa5c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:52.416885 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07451d79-b9a5-4cc7-9e01-c1adeaaa5c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:52.417216 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07451d79-b9a5-4cc7-9e01-c1adeaaa5c02 admin admin] PATH_INFO: `/v3/projects/52ceb9c268a6419480832d9d11bb4eca/users/d4b87d5acc8f44fd9b63a61f969a9925/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:52.419224 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07451d79-b9a5-4cc7-9e01-c1adeaaa5c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ceb9c268a6419480832d9d11bb4eca, user_id=d4b87d5acc8f44fd9b63a61f969a9925, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:52.422233 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07451d79-b9a5-4cc7-9e01-c1adeaaa5c02 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:52.433790 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1427/2840] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:38:52 2022] PUT /identity/v3/projects/52ceb9c268a6419480832d9d11bb4eca/users/d4b87d5acc8f44fd9b63a61f969a9925/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:52.444203 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3e0a1-813b-46be-9cfc-57ff7b367597 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:52.444476 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3e0a1-813b-46be-9cfc-57ff7b367597 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:52.444763 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3e0a1-813b-46be-9cfc-57ff7b367597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:52.476508 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-72c3e0a1-813b-46be-9cfc-57ff7b367597 None None] MFA Rules not processed for user `d4b87d5acc8f44fd9b63a61f969a9925`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:52.478171 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-72c3e0a1-813b-46be-9cfc-57ff7b367597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:52.551384 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1414/2841] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:52.561215 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07451d79-b9a5-4cc7-9e01-c1adeaaa5c02 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:52.563148 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-07451d79-b9a5-4cc7-9e01-c1adeaaa5c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:52.619830 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07451d79-b9a5-4cc7-9e01-c1adeaaa5c02 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:52.624192 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66fe10-47ce-43ac-b7d5-b4644a0a7a16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:52.624820 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66fe10-47ce-43ac-b7d5-b4644a0a7a16 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:52.625100 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66fe10-47ce-43ac-b7d5-b4644a0a7a16 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:52.625399 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66fe10-47ce-43ac-b7d5-b4644a0a7a16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:52.635112 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66fe10-47ce-43ac-b7d5-b4644a0a7a16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:52.636498 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66fe10-47ce-43ac-b7d5-b4644a0a7a16 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:52.645674 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1428/2842] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:38:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:38:52.689755 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3e0a1-813b-46be-9cfc-57ff7b367597 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:52.691413 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-72c3e0a1-813b-46be-9cfc-57ff7b367597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:52.704150 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3e0a1-813b-46be-9cfc-57ff7b367597 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:52.708167 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1b8e0-f255-4b3e-9536-271752967c8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:52.708806 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1b8e0-f255-4b3e-9536-271752967c8d service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:52.709126 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1b8e0-f255-4b3e-9536-271752967c8d service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:52.709392 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1b8e0-f255-4b3e-9536-271752967c8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:52.769272 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1b8e0-f255-4b3e-9536-271752967c8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:52.770769 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1b8e0-f255-4b3e-9536-271752967c8d service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:52.780340 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1415/2843] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:38:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:38:56.045534 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66fe10-47ce-43ac-b7d5-b4644a0a7a16 service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:56.115794 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66fe10-47ce-43ac-b7d5-b4644a0a7a16 service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:56.120698 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324525ea-7c82-4be3-8734-1e2abf152f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:56.121590 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324525ea-7c82-4be3-8734-1e2abf152f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:56.121866 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324525ea-7c82-4be3-8734-1e2abf152f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:56.122138 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324525ea-7c82-4be3-8734-1e2abf152f45 admin admin] PATH_INFO: `/v3/users/cd9e2f6d47a5465ba9b4353b4136fdfe` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:56.123362 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324525ea-7c82-4be3-8734-1e2abf152f45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd9e2f6d47a5465ba9b4353b4136fdfe)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:56.125267 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324525ea-7c82-4be3-8734-1e2abf152f45 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:56.181192 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-324525ea-7c82-4be3-8734-1e2abf152f45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd9e2f6d47a5465ba9b4353b4136fdfe'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:56.189768 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-324525ea-7c82-4be3-8734-1e2abf152f45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd9e2f6d47a5465ba9b4353b4136fdfe'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:56.203150 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-324525ea-7c82-4be3-8734-1e2abf152f45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd9e2f6d47a5465ba9b4353b4136fdfe'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:56.203885 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-324525ea-7c82-4be3-8734-1e2abf152f45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd9e2f6d47a5465ba9b4353b4136fdfe'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:56.204543 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-324525ea-7c82-4be3-8734-1e2abf152f45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd9e2f6d47a5465ba9b4353b4136fdfe'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:56.218568 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1429/2844] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:38:56 2022] DELETE /identity/v3/users/cd9e2f6d47a5465ba9b4353b4136fdfe => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:56.223489 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cccae6-a4ab-4307-920f-fb84fc4c24e5 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:56.223977 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cccae6-a4ab-4307-920f-fb84fc4c24e5 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:56.224069 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cccae6-a4ab-4307-920f-fb84fc4c24e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:56.241861 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-19cccae6-a4ab-4307-920f-fb84fc4c24e5 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:56.243044 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-19cccae6-a4ab-4307-920f-fb84fc4c24e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:56.305847 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1416/2845] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:56.318009 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324525ea-7c82-4be3-8734-1e2abf152f45 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:56.320315 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-324525ea-7c82-4be3-8734-1e2abf152f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:56.384082 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324525ea-7c82-4be3-8734-1e2abf152f45 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:56.388722 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213a939-c500-413c-bb4d-48ba5abc9556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:56.389339 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213a939-c500-413c-bb4d-48ba5abc9556 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:56.389649 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213a939-c500-413c-bb4d-48ba5abc9556 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:56.389914 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213a939-c500-413c-bb4d-48ba5abc9556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:56.400943 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213a939-c500-413c-bb4d-48ba5abc9556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:56.402393 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213a939-c500-413c-bb4d-48ba5abc9556 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:56.412587 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1430/2846] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:38:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:38:56.688844 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cccae6-a4ab-4307-920f-fb84fc4c24e5 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:56.690465 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-19cccae6-a4ab-4307-920f-fb84fc4c24e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:56.703737 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cccae6-a4ab-4307-920f-fb84fc4c24e5 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:56.708779 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60877c-4252-4429-8b42-3e1f4fe752ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:56.709712 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60877c-4252-4429-8b42-3e1f4fe752ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:56.709960 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60877c-4252-4429-8b42-3e1f4fe752ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:56.710209 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60877c-4252-4429-8b42-3e1f4fe752ae admin admin] PATH_INFO: `/v3/projects/10200a136a774a94b2538d92fb58b515` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:56.711402 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60877c-4252-4429-8b42-3e1f4fe752ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=10200a136a774a94b2538d92fb58b515)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:56.713308 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60877c-4252-4429-8b42-3e1f4fe752ae admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:56.762976 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4a60877c-4252-4429-8b42-3e1f4fe752ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10200a136a774a94b2538d92fb58b515', 'request_id': 'req-4a60877c-4252-4429-8b42-3e1f4fe752ae'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:56.768853 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4a60877c-4252-4429-8b42-3e1f4fe752ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10200a136a774a94b2538d92fb58b515', 'request_id': 'req-4a60877c-4252-4429-8b42-3e1f4fe752ae'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:56.775314 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4a60877c-4252-4429-8b42-3e1f4fe752ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10200a136a774a94b2538d92fb58b515', 'request_id': 'req-4a60877c-4252-4429-8b42-3e1f4fe752ae'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:56.788933 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4a60877c-4252-4429-8b42-3e1f4fe752ae admin admin] The token cache is being invalidate because project 10200a136a774a94b2538d92fb58b515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:38:56.789218 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4a60877c-4252-4429-8b42-3e1f4fe752ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:56.789880 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4a60877c-4252-4429-8b42-3e1f4fe752ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:56.791380 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1417/2847] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:38:56 2022] DELETE /identity/v3/projects/10200a136a774a94b2538d92fb58b515 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:56.795543 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213a939-c500-413c-bb4d-48ba5abc9556 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:56.806028 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213a939-c500-413c-bb4d-48ba5abc9556 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:56.865184 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd82737-e248-493b-b30d-66652d3f450a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:56.866086 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd82737-e248-493b-b30d-66652d3f450a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:56.866360 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd82737-e248-493b-b30d-66652d3f450a admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:56.866648 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd82737-e248-493b-b30d-66652d3f450a admin admin] PATH_INFO: `/v3/users/d4b87d5acc8f44fd9b63a61f969a9925` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:56.867899 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd82737-e248-493b-b30d-66652d3f450a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b87d5acc8f44fd9b63a61f969a9925)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:56.869839 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd82737-e248-493b-b30d-66652d3f450a admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:56.919370 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-3fd82737-e248-493b-b30d-66652d3f450a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b87d5acc8f44fd9b63a61f969a9925'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:56.929966 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-3fd82737-e248-493b-b30d-66652d3f450a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b87d5acc8f44fd9b63a61f969a9925'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:56.945406 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-3fd82737-e248-493b-b30d-66652d3f450a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b87d5acc8f44fd9b63a61f969a9925'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:56.946326 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-3fd82737-e248-493b-b30d-66652d3f450a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b87d5acc8f44fd9b63a61f969a9925'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:56.947206 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-3fd82737-e248-493b-b30d-66652d3f450a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b87d5acc8f44fd9b63a61f969a9925'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:56.962568 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1431/2848] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:38:56 2022] DELETE /identity/v3/users/d4b87d5acc8f44fd9b63a61f969a9925 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:57.240412 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60877c-4252-4429-8b42-3e1f4fe752ae admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:57.242087 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4a60877c-4252-4429-8b42-3e1f4fe752ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:57.256601 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60877c-4252-4429-8b42-3e1f4fe752ae admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:57.312287 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5319d-c913-461e-a7e5-23eace97ef14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:57.313144 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5319d-c913-461e-a7e5-23eace97ef14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:57.313416 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5319d-c913-461e-a7e5-23eace97ef14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:57.313675 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5319d-c913-461e-a7e5-23eace97ef14 admin admin] PATH_INFO: `/v3/projects/52ceb9c268a6419480832d9d11bb4eca` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:57.314892 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5319d-c913-461e-a7e5-23eace97ef14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ceb9c268a6419480832d9d11bb4eca)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:57.316825 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5319d-c913-461e-a7e5-23eace97ef14 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:57.364301 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-bdf5319d-c913-461e-a7e5-23eace97ef14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ceb9c268a6419480832d9d11bb4eca', 'request_id': 'req-bdf5319d-c913-461e-a7e5-23eace97ef14'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:57.369833 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-bdf5319d-c913-461e-a7e5-23eace97ef14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ceb9c268a6419480832d9d11bb4eca', 'request_id': 'req-bdf5319d-c913-461e-a7e5-23eace97ef14'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:57.375828 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-bdf5319d-c913-461e-a7e5-23eace97ef14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ceb9c268a6419480832d9d11bb4eca', 'request_id': 'req-bdf5319d-c913-461e-a7e5-23eace97ef14'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:57.390167 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-bdf5319d-c913-461e-a7e5-23eace97ef14 admin admin] The token cache is being invalidate because project 52ceb9c268a6419480832d9d11bb4eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:38:57.390441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-bdf5319d-c913-461e-a7e5-23eace97ef14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:57.391082 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-bdf5319d-c913-461e-a7e5-23eace97ef14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:38:57.392592 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1418/2849] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:38:57 2022] DELETE /identity/v3/projects/52ceb9c268a6419480832d9d11bb4eca => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:57.397911 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f1f5f-99f9-47b4-9402-dbe750f52ee3 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:57.398387 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f1f5f-99f9-47b4-9402-dbe750f52ee3 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:57.398472 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f1f5f-99f9-47b4-9402-dbe750f52ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:57.417130 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-d22f1f5f-99f9-47b4-9402-dbe750f52ee3 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:57.418364 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-d22f1f5f-99f9-47b4-9402-dbe750f52ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:57.480119 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1432/2850] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:57.535990 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48001513-a180-4bf1-a15a-4146c727ce22 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:57.536184 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48001513-a180-4bf1-a15a-4146c727ce22 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:57.536427 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48001513-a180-4bf1-a15a-4146c727ce22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:57.556175 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-48001513-a180-4bf1-a15a-4146c727ce22 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:57.557382 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-48001513-a180-4bf1-a15a-4146c727ce22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:57.565958 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1419/2851] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:57.570402 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f1f5f-99f9-47b4-9402-dbe750f52ee3 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:57.580232 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f1f5f-99f9-47b4-9402-dbe750f52ee3 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:57.585810 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ab2a2-646f-4512-a2f9-11e53e83295f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:57.586464 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ab2a2-646f-4512-a2f9-11e53e83295f admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:57.586736 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ab2a2-646f-4512-a2f9-11e53e83295f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:57.587035 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ab2a2-646f-4512-a2f9-11e53e83295f admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:57.587763 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ab2a2-646f-4512-a2f9-11e53e83295f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:38:57.588060 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ab2a2-646f-4512-a2f9-11e53e83295f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:57.589710 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ab2a2-646f-4512-a2f9-11e53e83295f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:57.601737 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1433/2852] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:38:57.606631 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48001513-a180-4bf1-a15a-4146c727ce22 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:57.620466 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48001513-a180-4bf1-a15a-4146c727ce22 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:57.627813 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59de288-d6ed-42ab-8fbd-6ffd59f260f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:57.628533 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59de288-d6ed-42ab-8fbd-6ffd59f260f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:57.629135 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59de288-d6ed-42ab-8fbd-6ffd59f260f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:57.629474 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59de288-d6ed-42ab-8fbd-6ffd59f260f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:57.630171 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59de288-d6ed-42ab-8fbd-6ffd59f260f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:57.632034 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59de288-d6ed-42ab-8fbd-6ffd59f260f4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:57.659753 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1420/2853] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:38:57 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:38:57.664097 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ab2a2-646f-4512-a2f9-11e53e83295f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:57.674512 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ab2a2-646f-4512-a2f9-11e53e83295f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:57.731260 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baec0f8-0b1f-4c72-90ad-6cb20c5f74ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:57.731922 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baec0f8-0b1f-4c72-90ad-6cb20c5f74ae admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:57.732193 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baec0f8-0b1f-4c72-90ad-6cb20c5f74ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:57.732457 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baec0f8-0b1f-4c72-90ad-6cb20c5f74ae admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:57.733135 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baec0f8-0b1f-4c72-90ad-6cb20c5f74ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:57.735084 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baec0f8-0b1f-4c72-90ad-6cb20c5f74ae admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:57.764468 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1434/2854] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:38:57 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 21:38:57.768953 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59de288-d6ed-42ab-8fbd-6ffd59f260f4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:57.779603 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59de288-d6ed-42ab-8fbd-6ffd59f260f4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:57.784958 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f968e23-6b06-41d1-b104-0ec34d13dcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:57.785633 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f968e23-6b06-41d1-b104-0ec34d13dcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:57.785908 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f968e23-6b06-41d1-b104-0ec34d13dcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:57.786218 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f968e23-6b06-41d1-b104-0ec34d13dcd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:57.786912 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f968e23-6b06-41d1-b104-0ec34d13dcd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:57.788495 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f968e23-6b06-41d1-b104-0ec34d13dcd8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:57.799677 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1421/2855] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:38:57.803656 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baec0f8-0b1f-4c72-90ad-6cb20c5f74ae admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:57.813988 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baec0f8-0b1f-4c72-90ad-6cb20c5f74ae admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:57.819392 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0735f73-9967-4ecb-b67d-4e000afdfbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:57.820045 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0735f73-9967-4ecb-b67d-4e000afdfbce admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:57.820325 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0735f73-9967-4ecb-b67d-4e000afdfbce admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:57.820594 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0735f73-9967-4ecb-b67d-4e000afdfbce admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:57.821326 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0735f73-9967-4ecb-b67d-4e000afdfbce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:57.822955 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0735f73-9967-4ecb-b67d-4e000afdfbce admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:57.833211 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1435/2856] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:38:57.839283 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f968e23-6b06-41d1-b104-0ec34d13dcd8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:57.855692 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f968e23-6b06-41d1-b104-0ec34d13dcd8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:57.864171 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dd76a-694f-4d2e-9a94-70873d55e880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:57.865257 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dd76a-694f-4d2e-9a94-70873d55e880 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:57.865562 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dd76a-694f-4d2e-9a94-70873d55e880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:57.865829 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dd76a-694f-4d2e-9a94-70873d55e880 admin admin] PATH_INFO: `/v3/projects/fd5c14422d9d472bb7b5d06c19f4b428/users/622bee1c5c8a4554a2be8e1d1ae1f205/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:57.891977 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8dd76a-694f-4d2e-9a94-70873d55e880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd5c14422d9d472bb7b5d06c19f4b428, user_id=622bee1c5c8a4554a2be8e1d1ae1f205, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:57.895225 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8dd76a-694f-4d2e-9a94-70873d55e880 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:57.914882 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1422/2857] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:38:57 2022] PUT /identity/v3/projects/fd5c14422d9d472bb7b5d06c19f4b428/users/622bee1c5c8a4554a2be8e1d1ae1f205/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:57.922036 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d54c2e-170d-405c-8776-165bf66f86f5 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:57.922381 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d54c2e-170d-405c-8776-165bf66f86f5 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:57.922672 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d54c2e-170d-405c-8776-165bf66f86f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:57.942624 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-e3d54c2e-170d-405c-8776-165bf66f86f5 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:57.943822 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-e3d54c2e-170d-405c-8776-165bf66f86f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:58.001187 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1436/2858] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:58.011233 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dd76a-694f-4d2e-9a94-70873d55e880 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:58.012982 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-fc8dd76a-694f-4d2e-9a94-70873d55e880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:58.070170 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dd76a-694f-4d2e-9a94-70873d55e880 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:58.074323 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571ce11-4905-4e2f-aa33-5a055cf1d3fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:58.074947 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571ce11-4905-4e2f-aa33-5a055cf1d3fb service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:58.075221 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571ce11-4905-4e2f-aa33-5a055cf1d3fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:58.075483 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571ce11-4905-4e2f-aa33-5a055cf1d3fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:58.085126 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571ce11-4905-4e2f-aa33-5a055cf1d3fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:58.086561 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571ce11-4905-4e2f-aa33-5a055cf1d3fb service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:58.095795 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1423/2859] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:38:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:38:58.707647 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c999621-9bd4-45cd-a8f1-67cd81ea9d4e None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:58.708193 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c999621-9bd4-45cd-a8f1-67cd81ea9d4e None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:58.708193 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c999621-9bd4-45cd-a8f1-67cd81ea9d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:58.734938 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-1c999621-9bd4-45cd-a8f1-67cd81ea9d4e None None] MFA Rules not processed for user `622bee1c5c8a4554a2be8e1d1ae1f205`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:58.736146 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-1c999621-9bd4-45cd-a8f1-67cd81ea9d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:58.801454 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1437/2860] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:58.805987 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571ce11-4905-4e2f-aa33-5a055cf1d3fb service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:58.815824 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571ce11-4905-4e2f-aa33-5a055cf1d3fb service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:58.820499 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3933ab-be7e-40e6-9fde-a53834b086fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:58.821141 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3933ab-be7e-40e6-9fde-a53834b086fe admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:58.821441 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3933ab-be7e-40e6-9fde-a53834b086fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:58.821709 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3933ab-be7e-40e6-9fde-a53834b086fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:58.822418 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3933ab-be7e-40e6-9fde-a53834b086fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:58.824331 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3933ab-be7e-40e6-9fde-a53834b086fe admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:58.849556 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1424/2861] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:38:58 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 21:38:58.854112 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c999621-9bd4-45cd-a8f1-67cd81ea9d4e None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:58.864784 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c999621-9bd4-45cd-a8f1-67cd81ea9d4e None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:58.920260 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf149a9-7f22-4fcd-8ba1-9ec3713b064e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:58.920852 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf149a9-7f22-4fcd-8ba1-9ec3713b064e admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:58.921514 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf149a9-7f22-4fcd-8ba1-9ec3713b064e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:58.921782 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf149a9-7f22-4fcd-8ba1-9ec3713b064e admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:58.922495 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf149a9-7f22-4fcd-8ba1-9ec3713b064e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:58.924361 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf149a9-7f22-4fcd-8ba1-9ec3713b064e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:58.946851 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1438/2862] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:38:58 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:38:58.950963 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3933ab-be7e-40e6-9fde-a53834b086fe admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:58.962954 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3933ab-be7e-40e6-9fde-a53834b086fe admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:58.968852 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87de66-0087-46a7-a966-b45136a72ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:58.969552 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87de66-0087-46a7-a966-b45136a72ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:58.969829 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87de66-0087-46a7-a966-b45136a72ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:58.970100 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87de66-0087-46a7-a966-b45136a72ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:58.970828 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87de66-0087-46a7-a966-b45136a72ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:58.972539 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87de66-0087-46a7-a966-b45136a72ff2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:58.983952 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1425/2863] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:38:58.988452 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf149a9-7f22-4fcd-8ba1-9ec3713b064e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:58.998946 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf149a9-7f22-4fcd-8ba1-9ec3713b064e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:59.005039 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473beac-4c7b-4d49-9c72-70562a1343c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:59.005948 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473beac-4c7b-4d49-9c72-70562a1343c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:59.006226 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473beac-4c7b-4d49-9c72-70562a1343c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:59.006494 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473beac-4c7b-4d49-9c72-70562a1343c3 admin admin] PATH_INFO: `/v3/projects/388ef2feb5274851ad8f16eec500a76c/users/30afacbf35ac463aa1b286a605736e83/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:59.021460 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473beac-4c7b-4d49-9c72-70562a1343c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=388ef2feb5274851ad8f16eec500a76c, user_id=30afacbf35ac463aa1b286a605736e83, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:59.024088 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473beac-4c7b-4d49-9c72-70562a1343c3 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:59.038615 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1439/2864] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:38:58 2022] PUT /identity/v3/projects/388ef2feb5274851ad8f16eec500a76c/users/30afacbf35ac463aa1b286a605736e83/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:59.042485 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87de66-0087-46a7-a966-b45136a72ff2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:59.053327 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87de66-0087-46a7-a966-b45136a72ff2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:59.111877 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54916f92-b5db-457b-bc02-7c03f25885b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:59.112529 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54916f92-b5db-457b-bc02-7c03f25885b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:59.112806 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54916f92-b5db-457b-bc02-7c03f25885b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:59.113075 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54916f92-b5db-457b-bc02-7c03f25885b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:59.113834 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54916f92-b5db-457b-bc02-7c03f25885b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:59.115414 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54916f92-b5db-457b-bc02-7c03f25885b0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:59.124880 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1426/2865] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:38:59.129444 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473beac-4c7b-4d49-9c72-70562a1343c3 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:59.140367 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473beac-4c7b-4d49-9c72-70562a1343c3 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:59.145720 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d042c-1e01-4f47-b9ed-ad777f5fd7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:59.146611 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d042c-1e01-4f47-b9ed-ad777f5fd7d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:59.146906 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d042c-1e01-4f47-b9ed-ad777f5fd7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:59.147171 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d042c-1e01-4f47-b9ed-ad777f5fd7d6 admin admin] PATH_INFO: `/v3/projects/388ef2feb5274851ad8f16eec500a76c/users/30afacbf35ac463aa1b286a605736e83/roles/e06447c1c62d465c9f9c58168be71ed8` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:59.149319 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d042c-1e01-4f47-b9ed-ad777f5fd7d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=388ef2feb5274851ad8f16eec500a76c, user_id=30afacbf35ac463aa1b286a605736e83, role_id=e06447c1c62d465c9f9c58168be71ed8)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:38:59.151952 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d042c-1e01-4f47-b9ed-ad777f5fd7d6 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:38:59.163519 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1440/2866] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:38:59 2022] PUT /identity/v3/projects/388ef2feb5274851ad8f16eec500a76c/users/30afacbf35ac463aa1b286a605736e83/roles/e06447c1c62d465c9f9c58168be71ed8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:38:59.777005 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cc3b5-dec9-49e8-a39e-5faa4431ec68 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:59.777427 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cc3b5-dec9-49e8-a39e-5faa4431ec68 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:59.777703 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cc3b5-dec9-49e8-a39e-5faa4431ec68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:38:59.806673 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-0c0cc3b5-dec9-49e8-a39e-5faa4431ec68 None None] MFA Rules not processed for user `30afacbf35ac463aa1b286a605736e83`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:38:59.807893 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0c0cc3b5-dec9-49e8-a39e-5faa4431ec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:59.877066 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1427/2867] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:38:59 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:38:59.887368 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d042c-1e01-4f47-b9ed-ad777f5fd7d6 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:38:59.889131 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-583d042c-1e01-4f47-b9ed-ad777f5fd7d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:38:59.949020 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d042c-1e01-4f47-b9ed-ad777f5fd7d6 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:38:59.952925 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be5ca5-4877-496f-8ca0-5bd4e11a973f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:38:59.953582 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be5ca5-4877-496f-8ca0-5bd4e11a973f service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:38:59.953863 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be5ca5-4877-496f-8ca0-5bd4e11a973f service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:38:59.954130 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be5ca5-4877-496f-8ca0-5bd4e11a973f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:00.011187 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be5ca5-4877-496f-8ca0-5bd4e11a973f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:00.012650 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be5ca5-4877-496f-8ca0-5bd4e11a973f service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:00.021874 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1441/2868] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:38:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:39:01.360556 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cc3b5-dec9-49e8-a39e-5faa4431ec68 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:01.362252 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0c0cc3b5-dec9-49e8-a39e-5faa4431ec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:01.374807 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cc3b5-dec9-49e8-a39e-5faa4431ec68 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:01.379269 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7ae23-f6f7-4e41-9256-7297f2787b27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:01.379893 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7ae23-f6f7-4e41-9256-7297f2787b27 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:01.380167 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7ae23-f6f7-4e41-9256-7297f2787b27 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:01.380428 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7ae23-f6f7-4e41-9256-7297f2787b27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:01.389275 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7ae23-f6f7-4e41-9256-7297f2787b27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:01.390723 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7ae23-f6f7-4e41-9256-7297f2787b27 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:01.400446 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1428/2869] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:39:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:39:08.365695 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be5ca5-4877-496f-8ca0-5bd4e11a973f service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:08.375183 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be5ca5-4877-496f-8ca0-5bd4e11a973f service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:08.379680 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e45328-43b3-44a0-a2b2-b7845b52ec0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:08.379980 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e45328-43b3-44a0-a2b2-b7845b52ec0a service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:08.380252 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e45328-43b3-44a0-a2b2-b7845b52ec0a service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:08.380514 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e45328-43b3-44a0-a2b2-b7845b52ec0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:08.382581 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-53e45328-43b3-44a0-a2b2-b7845b52ec0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:08.441931 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e45328-43b3-44a0-a2b2-b7845b52ec0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:08.443345 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e45328-43b3-44a0-a2b2-b7845b52ec0a service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:08.452407 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1442/2870] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:39:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:39:18.409440 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8bbe1-0d19-45a0-8175-68fbd17b23f2 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:18.409931 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8bbe1-0d19-45a0-8175-68fbd17b23f2 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:18.410034 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8bbe1-0d19-45a0-8175-68fbd17b23f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:18.429119 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-a0f8bbe1-0d19-45a0-8175-68fbd17b23f2 None None] MFA Rules not processed for user `4f847dd93a4348038e39859597386d15`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:39:18.430361 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a0f8bbe1-0d19-45a0-8175-68fbd17b23f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:18.437936 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1429/2871] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:39:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:39:18.472060 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e45328-43b3-44a0-a2b2-b7845b52ec0a service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:18.480458 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e45328-43b3-44a0-a2b2-b7845b52ec0a service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:18.483965 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9142d4f-8539-4241-b6e7-886953d10f3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:18.484591 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9142d4f-8539-4241-b6e7-886953d10f3f service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:18.484865 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9142d4f-8539-4241-b6e7-886953d10f3f service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:18.485125 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9142d4f-8539-4241-b6e7-886953d10f3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:18.486874 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-e9142d4f-8539-4241-b6e7-886953d10f3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:18.558884 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9142d4f-8539-4241-b6e7-886953d10f3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:18.560312 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9142d4f-8539-4241-b6e7-886953d10f3f service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:18.571774 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1443/2872] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:39:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:39:18.865585 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8bbe1-0d19-45a0-8175-68fbd17b23f2 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:18.925185 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8bbe1-0d19-45a0-8175-68fbd17b23f2 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:18.929192 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f6a11-9e1e-4ebf-a8ec-e97186a92dc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:18.929903 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f6a11-9e1e-4ebf-a8ec-e97186a92dc8 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:18.930174 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f6a11-9e1e-4ebf-a8ec-e97186a92dc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:18.930438 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f6a11-9e1e-4ebf-a8ec-e97186a92dc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:18.932400 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6e8f6a11-9e1e-4ebf-a8ec-e97186a92dc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:18.943407 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f6a11-9e1e-4ebf-a8ec-e97186a92dc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:18.944851 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f6a11-9e1e-4ebf-a8ec-e97186a92dc8 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:18.953025 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1430/2873] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:39:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:39:20.425715 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9142d4f-8539-4241-b6e7-886953d10f3f service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:20.427244 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-e9142d4f-8539-4241-b6e7-886953d10f3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:20.446393 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f6a11-9e1e-4ebf-a8ec-e97186a92dc8 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:20.455750 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f6a11-9e1e-4ebf-a8ec-e97186a92dc8 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:20.460108 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28133c0c-1eb8-4790-9be2-3be10f21583e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:20.460951 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28133c0c-1eb8-4790-9be2-3be10f21583e service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:20.461391 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28133c0c-1eb8-4790-9be2-3be10f21583e service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:20.461812 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28133c0c-1eb8-4790-9be2-3be10f21583e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:20.463838 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-28133c0c-1eb8-4790-9be2-3be10f21583e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:20.480672 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28133c0c-1eb8-4790-9be2-3be10f21583e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:20.482405 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28133c0c-1eb8-4790-9be2-3be10f21583e service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:20.495400 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1431/2874] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:39:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:39:20.508903 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9142d4f-8539-4241-b6e7-886953d10f3f service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:20.517502 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60f095-6479-4eae-8d00-dbc1f2c52916 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f05eb88abe24af4825259712b497d48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:20.518298 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60f095-6479-4eae-8d00-dbc1f2c52916 service placement] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:20.518532 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60f095-6479-4eae-8d00-dbc1f2c52916 service placement] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:20.518855 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60f095-6479-4eae-8d00-dbc1f2c52916 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:20.521200 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ba60f095-6479-4eae-8d00-dbc1f2c52916 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:20.541904 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60f095-6479-4eae-8d00-dbc1f2c52916 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:20.541904 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60f095-6479-4eae-8d00-dbc1f2c52916 service placement] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:20.556502 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1444/2875] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:39:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:39:20.827129 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28133c0c-1eb8-4790-9be2-3be10f21583e service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:20.891081 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28133c0c-1eb8-4790-9be2-3be10f21583e service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:20.896783 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4b2f3-3760-49a7-b0ba-8459de58da07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:20.897710 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4b2f3-3760-49a7-b0ba-8459de58da07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:20.897994 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4b2f3-3760-49a7-b0ba-8459de58da07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:20.898263 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4b2f3-3760-49a7-b0ba-8459de58da07 admin admin] PATH_INFO: `/v3/users/622bee1c5c8a4554a2be8e1d1ae1f205` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:20.899558 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4b2f3-3760-49a7-b0ba-8459de58da07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=622bee1c5c8a4554a2be8e1d1ae1f205)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:20.901512 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4b2f3-3760-49a7-b0ba-8459de58da07 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:20.951512 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e2d4b2f3-3760-49a7-b0ba-8459de58da07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '622bee1c5c8a4554a2be8e1d1ae1f205'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:20.958342 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e2d4b2f3-3760-49a7-b0ba-8459de58da07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '622bee1c5c8a4554a2be8e1d1ae1f205'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:20.971141 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e2d4b2f3-3760-49a7-b0ba-8459de58da07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '622bee1c5c8a4554a2be8e1d1ae1f205'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:20.971956 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e2d4b2f3-3760-49a7-b0ba-8459de58da07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '622bee1c5c8a4554a2be8e1d1ae1f205'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:20.981133 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e2d4b2f3-3760-49a7-b0ba-8459de58da07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '622bee1c5c8a4554a2be8e1d1ae1f205'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:20.987559 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1432/2876] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:39:20 2022] DELETE /identity/v3/users/622bee1c5c8a4554a2be8e1d1ae1f205 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 21:39:21.173753 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60f095-6479-4eae-8d00-dbc1f2c52916 service placement] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:21.189506 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60f095-6479-4eae-8d00-dbc1f2c52916 service placement] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:21.245365 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afce7f-a832-4576-8221-6eb8ee442ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:21.246246 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afce7f-a832-4576-8221-6eb8ee442ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:21.246512 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afce7f-a832-4576-8221-6eb8ee442ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:21.246776 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afce7f-a832-4576-8221-6eb8ee442ec3 admin admin] PATH_INFO: `/v3/projects/fd5c14422d9d472bb7b5d06c19f4b428` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:21.247956 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afce7f-a832-4576-8221-6eb8ee442ec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd5c14422d9d472bb7b5d06c19f4b428)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:21.249889 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afce7f-a832-4576-8221-6eb8ee442ec3 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:21.296009 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f1afce7f-a832-4576-8221-6eb8ee442ec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd5c14422d9d472bb7b5d06c19f4b428', 'request_id': 'req-f1afce7f-a832-4576-8221-6eb8ee442ec3'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:21.301862 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f1afce7f-a832-4576-8221-6eb8ee442ec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd5c14422d9d472bb7b5d06c19f4b428', 'request_id': 'req-f1afce7f-a832-4576-8221-6eb8ee442ec3'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:21.308947 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f1afce7f-a832-4576-8221-6eb8ee442ec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd5c14422d9d472bb7b5d06c19f4b428', 'request_id': 'req-f1afce7f-a832-4576-8221-6eb8ee442ec3'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:21.326791 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f1afce7f-a832-4576-8221-6eb8ee442ec3 admin admin] The token cache is being invalidate because project fd5c14422d9d472bb7b5d06c19f4b428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:39:21.327087 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f1afce7f-a832-4576-8221-6eb8ee442ec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:21.327714 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-f1afce7f-a832-4576-8221-6eb8ee442ec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:21.329367 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1445/2877] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:39:21 2022] DELETE /identity/v3/projects/fd5c14422d9d472bb7b5d06c19f4b428 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:39:21.333465 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4b2f3-3760-49a7-b0ba-8459de58da07 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:21.334987 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e2d4b2f3-3760-49a7-b0ba-8459de58da07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:21.347748 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4b2f3-3760-49a7-b0ba-8459de58da07 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:21.404044 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62bd38-088f-4a56-a1ef-8758b0ffbfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:21.404950 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62bd38-088f-4a56-a1ef-8758b0ffbfe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:21.405228 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62bd38-088f-4a56-a1ef-8758b0ffbfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:21.405530 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62bd38-088f-4a56-a1ef-8758b0ffbfe8 admin admin] PATH_INFO: `/v3/users/30afacbf35ac463aa1b286a605736e83` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:21.406743 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62bd38-088f-4a56-a1ef-8758b0ffbfe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30afacbf35ac463aa1b286a605736e83)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:21.408678 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62bd38-088f-4a56-a1ef-8758b0ffbfe8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:21.456985 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-fd62bd38-088f-4a56-a1ef-8758b0ffbfe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30afacbf35ac463aa1b286a605736e83'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:21.465387 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-fd62bd38-088f-4a56-a1ef-8758b0ffbfe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30afacbf35ac463aa1b286a605736e83'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:21.478799 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-fd62bd38-088f-4a56-a1ef-8758b0ffbfe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30afacbf35ac463aa1b286a605736e83'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:21.479596 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-fd62bd38-088f-4a56-a1ef-8758b0ffbfe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30afacbf35ac463aa1b286a605736e83'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:21.488181 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-fd62bd38-088f-4a56-a1ef-8758b0ffbfe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30afacbf35ac463aa1b286a605736e83'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:21.496056 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1433/2878] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:39:21 2022] DELETE /identity/v3/users/30afacbf35ac463aa1b286a605736e83 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:39:21.836155 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afce7f-a832-4576-8221-6eb8ee442ec3 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:21.837638 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-f1afce7f-a832-4576-8221-6eb8ee442ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:21.851210 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afce7f-a832-4576-8221-6eb8ee442ec3 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:21.914369 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b81e5d-d8da-4984-bb3b-671abf26b600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:21.916059 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b81e5d-d8da-4984-bb3b-671abf26b600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:21.916270 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b81e5d-d8da-4984-bb3b-671abf26b600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:21.916781 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b81e5d-d8da-4984-bb3b-671abf26b600 admin admin] PATH_INFO: `/v3/projects/388ef2feb5274851ad8f16eec500a76c` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:21.918037 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b81e5d-d8da-4984-bb3b-671abf26b600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=388ef2feb5274851ad8f16eec500a76c)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:21.920002 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b81e5d-d8da-4984-bb3b-671abf26b600 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:21.974286 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-27b81e5d-d8da-4984-bb3b-671abf26b600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '388ef2feb5274851ad8f16eec500a76c', 'request_id': 'req-27b81e5d-d8da-4984-bb3b-671abf26b600'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:21.980226 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-27b81e5d-d8da-4984-bb3b-671abf26b600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '388ef2feb5274851ad8f16eec500a76c', 'request_id': 'req-27b81e5d-d8da-4984-bb3b-671abf26b600'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:21.987360 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-27b81e5d-d8da-4984-bb3b-671abf26b600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '388ef2feb5274851ad8f16eec500a76c', 'request_id': 'req-27b81e5d-d8da-4984-bb3b-671abf26b600'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:22.002374 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-27b81e5d-d8da-4984-bb3b-671abf26b600 admin admin] The token cache is being invalidate because project 388ef2feb5274851ad8f16eec500a76c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:39:22.002374 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-27b81e5d-d8da-4984-bb3b-671abf26b600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:22.002835 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-27b81e5d-d8da-4984-bb3b-671abf26b600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:22.004545 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1446/2879] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:39:21 2022] DELETE /identity/v3/projects/388ef2feb5274851ad8f16eec500a76c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:39:22.009960 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40581bd-4d05-4712-b6dc-20caeb627f86 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:22.010350 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40581bd-4d05-4712-b6dc-20caeb627f86 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:22.010859 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40581bd-4d05-4712-b6dc-20caeb627f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:22.029162 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e40581bd-4d05-4712-b6dc-20caeb627f86 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:39:22.030560 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e40581bd-4d05-4712-b6dc-20caeb627f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:22.092106 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1434/2880] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:39:22.099667 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8f511-f48a-4145-920d-9804ab6d9274 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:22.099958 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8f511-f48a-4145-920d-9804ab6d9274 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:22.100233 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8f511-f48a-4145-920d-9804ab6d9274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:22.119151 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-b7c8f511-f48a-4145-920d-9804ab6d9274 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:39:22.120371 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-b7c8f511-f48a-4145-920d-9804ab6d9274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:22.128340 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1447/2881] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:39:22.132704 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40581bd-4d05-4712-b6dc-20caeb627f86 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:22.142617 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40581bd-4d05-4712-b6dc-20caeb627f86 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:22.147936 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266e300-b341-48a8-804b-7ed1150768c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:22.148761 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266e300-b341-48a8-804b-7ed1150768c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:22.149129 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266e300-b341-48a8-804b-7ed1150768c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:22.149529 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266e300-b341-48a8-804b-7ed1150768c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:22.150730 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266e300-b341-48a8-804b-7ed1150768c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:39:22.151163 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266e300-b341-48a8-804b-7ed1150768c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:22.152840 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266e300-b341-48a8-804b-7ed1150768c5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:22.166118 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1435/2882] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:39:22.171301 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8f511-f48a-4145-920d-9804ab6d9274 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:22.180826 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8f511-f48a-4145-920d-9804ab6d9274 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:22.185719 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2a25a-a2cf-4af0-8acd-c229e5486a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:22.186397 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2a25a-a2cf-4af0-8acd-c229e5486a9e admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:22.186669 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2a25a-a2cf-4af0-8acd-c229e5486a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:22.186954 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2a25a-a2cf-4af0-8acd-c229e5486a9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:22.187656 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2a25a-a2cf-4af0-8acd-c229e5486a9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:22.189615 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2a25a-a2cf-4af0-8acd-c229e5486a9e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:22.220173 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1448/2883] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:39:22 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:39:22.221729 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266e300-b341-48a8-804b-7ed1150768c5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:22.232239 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266e300-b341-48a8-804b-7ed1150768c5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:22.290067 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dc690-b5b2-46d4-85e8-4f35198c6819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:22.290821 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dc690-b5b2-46d4-85e8-4f35198c6819 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:22.291094 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dc690-b5b2-46d4-85e8-4f35198c6819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:22.291360 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dc690-b5b2-46d4-85e8-4f35198c6819 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:22.292078 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dc690-b5b2-46d4-85e8-4f35198c6819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:22.294034 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dc690-b5b2-46d4-85e8-4f35198c6819 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:22.320010 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1436/2884] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:39:22 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:39:22.321564 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2a25a-a2cf-4af0-8acd-c229e5486a9e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:22.332629 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2a25a-a2cf-4af0-8acd-c229e5486a9e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:22.337813 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679992b-6f49-4179-8aeb-837fbdeb9fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:22.338374 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679992b-6f49-4179-8aeb-837fbdeb9fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:22.338652 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679992b-6f49-4179-8aeb-837fbdeb9fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:22.338922 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679992b-6f49-4179-8aeb-837fbdeb9fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:22.339738 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679992b-6f49-4179-8aeb-837fbdeb9fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:22.341341 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679992b-6f49-4179-8aeb-837fbdeb9fa9 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:22.352837 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1449/2885] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:39:22.357030 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dc690-b5b2-46d4-85e8-4f35198c6819 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:22.367724 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dc690-b5b2-46d4-85e8-4f35198c6819 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:22.373106 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af1fba-86aa-4696-9ccf-991aba003312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:22.373830 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af1fba-86aa-4696-9ccf-991aba003312 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:22.374104 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af1fba-86aa-4696-9ccf-991aba003312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:22.374374 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af1fba-86aa-4696-9ccf-991aba003312 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:22.375107 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af1fba-86aa-4696-9ccf-991aba003312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:22.376690 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af1fba-86aa-4696-9ccf-991aba003312 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:22.390773 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1437/2886] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:39:22.392093 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679992b-6f49-4179-8aeb-837fbdeb9fa9 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:22.402717 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679992b-6f49-4179-8aeb-837fbdeb9fa9 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:22.407755 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b031271-3b3a-4694-894e-57e2ae2d263e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:22.408644 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b031271-3b3a-4694-894e-57e2ae2d263e admin admin] REQUEST_METHOD: `PUT` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:22.408922 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b031271-3b3a-4694-894e-57e2ae2d263e admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:22.409192 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b031271-3b3a-4694-894e-57e2ae2d263e admin admin] PATH_INFO: `/v3/projects/ec3b82f8cac242ffa484066358aa2909/users/ae5e9e11f50b4818aa3a24cdef921e7c/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:22.426221 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b031271-3b3a-4694-894e-57e2ae2d263e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec3b82f8cac242ffa484066358aa2909, user_id=ae5e9e11f50b4818aa3a24cdef921e7c, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:22.429025 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b031271-3b3a-4694-894e-57e2ae2d263e admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:22.443468 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1450/2887] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:39:22 2022] PUT /identity/v3/projects/ec3b82f8cac242ffa484066358aa2909/users/ae5e9e11f50b4818aa3a24cdef921e7c/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:39:22.454131 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e35fa-7123-4554-9cee-cbdf3afa63b1 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:22.454493 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e35fa-7123-4554-9cee-cbdf3afa63b1 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:22.454772 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e35fa-7123-4554-9cee-cbdf3afa63b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:22.483507 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-3d3e35fa-7123-4554-9cee-cbdf3afa63b1 None None] MFA Rules not processed for user `ae5e9e11f50b4818aa3a24cdef921e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:39:22.484683 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3d3e35fa-7123-4554-9cee-cbdf3afa63b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:22.574544 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1438/2888] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:39:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 21:39:22.584546 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b031271-3b3a-4694-894e-57e2ae2d263e admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:22.586506 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-3b031271-3b3a-4694-894e-57e2ae2d263e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:22.650305 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b031271-3b3a-4694-894e-57e2ae2d263e admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:22.654020 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59bc44-21b3-4f49-9d8e-bfd0de9d3538 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:22.654790 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59bc44-21b3-4f49-9d8e-bfd0de9d3538 service cinder] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:22.655087 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59bc44-21b3-4f49-9d8e-bfd0de9d3538 service cinder] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:22.655351 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59bc44-21b3-4f49-9d8e-bfd0de9d3538 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:22.664975 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59bc44-21b3-4f49-9d8e-bfd0de9d3538 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:22.666550 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59bc44-21b3-4f49-9d8e-bfd0de9d3538 service cinder] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:22.676288 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1451/2889] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:39:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:39:23.279849 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e35fa-7123-4554-9cee-cbdf3afa63b1 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:23.281700 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3d3e35fa-7123-4554-9cee-cbdf3afa63b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:23.364390 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e35fa-7123-4554-9cee-cbdf3afa63b1 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:23.370208 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85f812-9a20-4a09-b9cf-d6356c349f16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:23.370809 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85f812-9a20-4a09-b9cf-d6356c349f16 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:23.371077 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85f812-9a20-4a09-b9cf-d6356c349f16 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:23.371353 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85f812-9a20-4a09-b9cf-d6356c349f16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:23.373181 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-aa85f812-9a20-4a09-b9cf-d6356c349f16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:23.386337 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85f812-9a20-4a09-b9cf-d6356c349f16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:23.387934 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85f812-9a20-4a09-b9cf-d6356c349f16 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:23.399952 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1439/2890] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:39:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:39:36.929966 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59bc44-21b3-4f49-9d8e-bfd0de9d3538 service cinder] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:36.945588 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59bc44-21b3-4f49-9d8e-bfd0de9d3538 service cinder] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:36.951287 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb31540-68a5-4b1f-83d7-d086f94b180d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:36.951943 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb31540-68a5-4b1f-83d7-d086f94b180d service nova] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:36.952315 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb31540-68a5-4b1f-83d7-d086f94b180d service nova] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:36.952602 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb31540-68a5-4b1f-83d7-d086f94b180d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:36.954480 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-bcb31540-68a5-4b1f-83d7-d086f94b180d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:36.969017 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb31540-68a5-4b1f-83d7-d086f94b180d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:36.970624 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb31540-68a5-4b1f-83d7-d086f94b180d service nova] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:36.982043 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1452/2891] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:39:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:39:39.937225 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85f812-9a20-4a09-b9cf-d6356c349f16 service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:39.938814 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-aa85f812-9a20-4a09-b9cf-d6356c349f16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:40.007809 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85f812-9a20-4a09-b9cf-d6356c349f16 service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:40.011828 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08875b-ea7d-47e1-9f85-2bb154db06a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:40.012462 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08875b-ea7d-47e1-9f85-2bb154db06a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:40.012735 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08875b-ea7d-47e1-9f85-2bb154db06a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:40.013013 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08875b-ea7d-47e1-9f85-2bb154db06a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:40.014918 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ad08875b-ea7d-47e1-9f85-2bb154db06a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:40.076240 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad08875b-ea7d-47e1-9f85-2bb154db06a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:40.077698 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad08875b-ea7d-47e1-9f85-2bb154db06a9 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:40.087787 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1440/2892] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:39:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:39:43.202849 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb31540-68a5-4b1f-83d7-d086f94b180d service nova] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:43.203417 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08875b-ea7d-47e1-9f85-2bb154db06a9 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:43.212144 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08875b-ea7d-47e1-9f85-2bb154db06a9 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:43.212638 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb31540-68a5-4b1f-83d7-d086f94b180d service nova] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:43.216397 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b067294-ee23-479b-b5db-8a540bdffeae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:43.216642 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3819ea-ed4d-400b-8700-326dbd2a7851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:43.217026 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b067294-ee23-479b-b5db-8a540bdffeae service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:43.217276 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3819ea-ed4d-400b-8700-326dbd2a7851 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:43.217403 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b067294-ee23-479b-b5db-8a540bdffeae service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:43.217611 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3819ea-ed4d-400b-8700-326dbd2a7851 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:43.217806 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b067294-ee23-479b-b5db-8a540bdffeae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:43.217913 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3819ea-ed4d-400b-8700-326dbd2a7851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:43.219870 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-3b067294-ee23-479b-b5db-8a540bdffeae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:43.220071 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-fe3819ea-ed4d-400b-8700-326dbd2a7851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:43.230118 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b067294-ee23-479b-b5db-8a540bdffeae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:43.230254 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3819ea-ed4d-400b-8700-326dbd2a7851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:43.231550 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b067294-ee23-479b-b5db-8a540bdffeae service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:43.231653 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3819ea-ed4d-400b-8700-326dbd2a7851 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:43.239625 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1453/2894] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:39:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:39:43.239784 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1441/2894] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:39:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:39:48.452389 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b067294-ee23-479b-b5db-8a540bdffeae service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:48.527387 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b067294-ee23-479b-b5db-8a540bdffeae service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:48.532938 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c8fd6-2267-4692-8d5f-016c6900fe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:48.533844 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c8fd6-2267-4692-8d5f-016c6900fe83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:48.534120 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c8fd6-2267-4692-8d5f-016c6900fe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:48.534388 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c8fd6-2267-4692-8d5f-016c6900fe83 admin admin] PATH_INFO: `/v3/users/ae5e9e11f50b4818aa3a24cdef921e7c` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:48.535684 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c8fd6-2267-4692-8d5f-016c6900fe83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae5e9e11f50b4818aa3a24cdef921e7c)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:48.537635 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c8fd6-2267-4692-8d5f-016c6900fe83 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:48.589338 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-fb0c8fd6-2267-4692-8d5f-016c6900fe83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae5e9e11f50b4818aa3a24cdef921e7c'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:48.596714 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-fb0c8fd6-2267-4692-8d5f-016c6900fe83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae5e9e11f50b4818aa3a24cdef921e7c'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:48.607925 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-fb0c8fd6-2267-4692-8d5f-016c6900fe83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae5e9e11f50b4818aa3a24cdef921e7c'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:48.608613 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-fb0c8fd6-2267-4692-8d5f-016c6900fe83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae5e9e11f50b4818aa3a24cdef921e7c'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:48.609238 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-fb0c8fd6-2267-4692-8d5f-016c6900fe83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae5e9e11f50b4818aa3a24cdef921e7c'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:48.623276 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1454/2895] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:39:48 2022] DELETE /identity/v3/users/ae5e9e11f50b4818aa3a24cdef921e7c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:39:48.627959 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ba4b6-3b4c-4e26-bf34-965fde176f8d None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:48.628425 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ba4b6-3b4c-4e26-bf34-965fde176f8d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:48.628533 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ba4b6-3b4c-4e26-bf34-965fde176f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:48.646020 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-8a7ba4b6-3b4c-4e26-bf34-965fde176f8d None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:39:48.647188 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8a7ba4b6-3b4c-4e26-bf34-965fde176f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:48.706242 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1442/2896] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:39:48.717991 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c8fd6-2267-4692-8d5f-016c6900fe83 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:48.719488 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-fb0c8fd6-2267-4692-8d5f-016c6900fe83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:48.779939 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c8fd6-2267-4692-8d5f-016c6900fe83 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:48.783884 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb3a1f-5a59-46fa-a298-53f31eede71e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:48.784525 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb3a1f-5a59-46fa-a298-53f31eede71e service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:48.784800 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb3a1f-5a59-46fa-a298-53f31eede71e service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:48.785067 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb3a1f-5a59-46fa-a298-53f31eede71e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:48.794047 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb3a1f-5a59-46fa-a298-53f31eede71e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:48.795824 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb3a1f-5a59-46fa-a298-53f31eede71e service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:48.804980 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1455/2897] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:39:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:39:49.095938 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ba4b6-3b4c-4e26-bf34-965fde176f8d None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:49.097517 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8a7ba4b6-3b4c-4e26-bf34-965fde176f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:49.111270 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ba4b6-3b4c-4e26-bf34-965fde176f8d None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:49.117001 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5852aa5-1118-49fe-8168-9fb039ae516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:49.117898 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5852aa5-1118-49fe-8168-9fb039ae516a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:49.118166 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5852aa5-1118-49fe-8168-9fb039ae516a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:49.118440 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5852aa5-1118-49fe-8168-9fb039ae516a admin admin] PATH_INFO: `/v3/projects/ec3b82f8cac242ffa484066358aa2909` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:49.119897 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5852aa5-1118-49fe-8168-9fb039ae516a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec3b82f8cac242ffa484066358aa2909)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:49.121897 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5852aa5-1118-49fe-8168-9fb039ae516a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:49.177148 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a5852aa5-1118-49fe-8168-9fb039ae516a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec3b82f8cac242ffa484066358aa2909', 'request_id': 'req-a5852aa5-1118-49fe-8168-9fb039ae516a'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:49.182866 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a5852aa5-1118-49fe-8168-9fb039ae516a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec3b82f8cac242ffa484066358aa2909', 'request_id': 'req-a5852aa5-1118-49fe-8168-9fb039ae516a'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:49.189450 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a5852aa5-1118-49fe-8168-9fb039ae516a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec3b82f8cac242ffa484066358aa2909', 'request_id': 'req-a5852aa5-1118-49fe-8168-9fb039ae516a'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:49.203927 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a5852aa5-1118-49fe-8168-9fb039ae516a admin admin] The token cache is being invalidate because project ec3b82f8cac242ffa484066358aa2909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:39:49.204207 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a5852aa5-1118-49fe-8168-9fb039ae516a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:49.204847 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a5852aa5-1118-49fe-8168-9fb039ae516a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:39:49.206451 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1443/2898] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:39:49 2022] DELETE /identity/v3/projects/ec3b82f8cac242ffa484066358aa2909 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:39:49.211486 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54180a-c744-4dad-a08c-6f4331fc60e9 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:49.211790 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54180a-c744-4dad-a08c-6f4331fc60e9 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:49.212061 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54180a-c744-4dad-a08c-6f4331fc60e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:49.230371 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-ad54180a-c744-4dad-a08c-6f4331fc60e9 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:39:49.231545 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-ad54180a-c744-4dad-a08c-6f4331fc60e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:49.293463 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1456/2899] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:39:49.305992 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebd4a7-7e88-475a-87f3-465442fa828a None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:49.306271 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebd4a7-7e88-475a-87f3-465442fa828a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:49.306535 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebd4a7-7e88-475a-87f3-465442fa828a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:49.333487 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-3cebd4a7-7e88-475a-87f3-465442fa828a None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:39:49.334775 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3cebd4a7-7e88-475a-87f3-465442fa828a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:49.345581 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1444/2900] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:39:49.350322 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54180a-c744-4dad-a08c-6f4331fc60e9 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:49.364459 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54180a-c744-4dad-a08c-6f4331fc60e9 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:49.371091 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80321a-35fe-4f66-a1d5-2c4a7be049c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:49.371745 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80321a-35fe-4f66-a1d5-2c4a7be049c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:49.372004 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80321a-35fe-4f66-a1d5-2c4a7be049c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:49.372267 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80321a-35fe-4f66-a1d5-2c4a7be049c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:49.373133 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80321a-35fe-4f66-a1d5-2c4a7be049c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:39:49.373458 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80321a-35fe-4f66-a1d5-2c4a7be049c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:49.375055 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80321a-35fe-4f66-a1d5-2c4a7be049c2 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:49.387286 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1457/2901] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:39:49.391819 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebd4a7-7e88-475a-87f3-465442fa828a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:49.401385 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebd4a7-7e88-475a-87f3-465442fa828a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:49.407563 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4145089-24ca-49e3-97e9-968cd669805d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:49.408214 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4145089-24ca-49e3-97e9-968cd669805d admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:49.408492 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4145089-24ca-49e3-97e9-968cd669805d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:49.408757 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4145089-24ca-49e3-97e9-968cd669805d admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:49.409492 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4145089-24ca-49e3-97e9-968cd669805d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:49.411389 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4145089-24ca-49e3-97e9-968cd669805d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:49.439687 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1445/2902] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:39:49 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:39:49.443838 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80321a-35fe-4f66-a1d5-2c4a7be049c2 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:49.454204 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80321a-35fe-4f66-a1d5-2c4a7be049c2 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:49.513075 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b8092-fb14-453e-984d-5948fd84b27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:49.513779 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b8092-fb14-453e-984d-5948fd84b27f admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:49.514060 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b8092-fb14-453e-984d-5948fd84b27f admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:49.514339 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b8092-fb14-453e-984d-5948fd84b27f admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:49.515025 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b8092-fb14-453e-984d-5948fd84b27f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:49.516941 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b8092-fb14-453e-984d-5948fd84b27f admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:49.539977 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1458/2903] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:39:49 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:39:49.544598 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4145089-24ca-49e3-97e9-968cd669805d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:49.555983 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4145089-24ca-49e3-97e9-968cd669805d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:49.561545 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18e831-f943-4d7e-90d4-34d920b28ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:49.562206 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18e831-f943-4d7e-90d4-34d920b28ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:49.562484 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18e831-f943-4d7e-90d4-34d920b28ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:49.562752 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18e831-f943-4d7e-90d4-34d920b28ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:49.563492 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18e831-f943-4d7e-90d4-34d920b28ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:49.565083 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18e831-f943-4d7e-90d4-34d920b28ef5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:49.575882 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1446/2904] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:39:49.582624 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b8092-fb14-453e-984d-5948fd84b27f admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:49.597333 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b8092-fb14-453e-984d-5948fd84b27f admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:49.604726 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed081423-3597-4096-a4ef-20292875c6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:49.605687 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed081423-3597-4096-a4ef-20292875c6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:49.606071 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed081423-3597-4096-a4ef-20292875c6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:49.606432 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed081423-3597-4096-a4ef-20292875c6c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:49.607342 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed081423-3597-4096-a4ef-20292875c6c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:49.609790 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed081423-3597-4096-a4ef-20292875c6c0 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:49.622473 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1459/2905] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:39:49.628113 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18e831-f943-4d7e-90d4-34d920b28ef5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:49.641727 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18e831-f943-4d7e-90d4-34d920b28ef5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:49.647685 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09339d5-7bf1-428d-855a-1b950dccaf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:49.648692 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09339d5-7bf1-428d-855a-1b950dccaf1b admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:49.648963 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09339d5-7bf1-428d-855a-1b950dccaf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:49.649232 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09339d5-7bf1-428d-855a-1b950dccaf1b admin admin] PATH_INFO: `/v3/projects/3d6317fcc1e547eb9a4d5e31a27bad60/users/0657b1e7ed704207aa0697ca78588307/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:49.666435 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09339d5-7bf1-428d-855a-1b950dccaf1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d6317fcc1e547eb9a4d5e31a27bad60, user_id=0657b1e7ed704207aa0697ca78588307, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:49.669879 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09339d5-7bf1-428d-855a-1b950dccaf1b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:49.693931 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1447/2906] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:39:49 2022] PUT /identity/v3/projects/3d6317fcc1e547eb9a4d5e31a27bad60/users/0657b1e7ed704207aa0697ca78588307/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:39:49.704584 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2cec3-ce46-4c4a-b868-34a0b471d74a None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:49.704881 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2cec3-ce46-4c4a-b868-34a0b471d74a None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:49.705152 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2cec3-ce46-4c4a-b868-34a0b471d74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:49.732478 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-23f2cec3-ce46-4c4a-b868-34a0b471d74a None None] MFA Rules not processed for user `0657b1e7ed704207aa0697ca78588307`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:39:49.733731 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-23f2cec3-ce46-4c4a-b868-34a0b471d74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:49.808425 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1460/2907] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:39:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:39:49.824581 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09339d5-7bf1-428d-855a-1b950dccaf1b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:39:49.826474 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e09339d5-7bf1-428d-855a-1b950dccaf1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:39:49.886509 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09339d5-7bf1-428d-855a-1b950dccaf1b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:39:49.891622 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2844a60-4369-4f9a-9dfb-5deb366aa11a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '256860d94eb142c6b2175ae89f977e4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:39:49.892264 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2844a60-4369-4f9a-9dfb-5deb366aa11a service glance] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:39:49.892536 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2844a60-4369-4f9a-9dfb-5deb366aa11a service glance] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:39:49.892780 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2844a60-4369-4f9a-9dfb-5deb366aa11a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:39:49.904811 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2844a60-4369-4f9a-9dfb-5deb366aa11a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:39:49.906283 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2844a60-4369-4f9a-9dfb-5deb366aa11a service glance] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:39:49.915744 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1448/2908] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:39:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:40:26.025276 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2cec3-ce46-4c4a-b868-34a0b471d74a None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:40:26.096193 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2cec3-ce46-4c4a-b868-34a0b471d74a None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:40:26.101975 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1316e3-7ed4-44af-98b8-4e874e8a9623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:40:26.102843 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1316e3-7ed4-44af-98b8-4e874e8a9623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:40:26.103119 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1316e3-7ed4-44af-98b8-4e874e8a9623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:40:26.103381 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1316e3-7ed4-44af-98b8-4e874e8a9623 admin admin] PATH_INFO: `/v3/users/0657b1e7ed704207aa0697ca78588307` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:40:26.104696 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1316e3-7ed4-44af-98b8-4e874e8a9623 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0657b1e7ed704207aa0697ca78588307)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:40:26.106685 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1316e3-7ed4-44af-98b8-4e874e8a9623 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:40:26.167044 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-df1316e3-7ed4-44af-98b8-4e874e8a9623 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0657b1e7ed704207aa0697ca78588307'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:40:26.177808 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-df1316e3-7ed4-44af-98b8-4e874e8a9623 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0657b1e7ed704207aa0697ca78588307'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:40:26.191352 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-df1316e3-7ed4-44af-98b8-4e874e8a9623 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0657b1e7ed704207aa0697ca78588307'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:40:26.192167 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-df1316e3-7ed4-44af-98b8-4e874e8a9623 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0657b1e7ed704207aa0697ca78588307'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:40:26.192841 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-df1316e3-7ed4-44af-98b8-4e874e8a9623 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0657b1e7ed704207aa0697ca78588307'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:40:26.210459 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1461/2909] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:40:26 2022] DELETE /identity/v3/users/0657b1e7ed704207aa0697ca78588307 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:40:26.216354 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5487ecd-0912-4a35-87fc-a19e8bcf96fd None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:40:26.216860 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5487ecd-0912-4a35-87fc-a19e8bcf96fd None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:40:26.216964 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5487ecd-0912-4a35-87fc-a19e8bcf96fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:40:26.234783 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-c5487ecd-0912-4a35-87fc-a19e8bcf96fd None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:40:26.235964 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c5487ecd-0912-4a35-87fc-a19e8bcf96fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:40:26.305958 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1449/2910] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:40:26.315596 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1316e3-7ed4-44af-98b8-4e874e8a9623 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:40:26.317239 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-df1316e3-7ed4-44af-98b8-4e874e8a9623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:40:26.384513 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1316e3-7ed4-44af-98b8-4e874e8a9623 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:40:26.389626 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d7b22-5b00-4d27-9241-01530dbea510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:40:26.390276 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d7b22-5b00-4d27-9241-01530dbea510 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:40:26.390558 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d7b22-5b00-4d27-9241-01530dbea510 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:40:26.390823 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d7b22-5b00-4d27-9241-01530dbea510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:40:26.400945 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d7b22-5b00-4d27-9241-01530dbea510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:40:26.402407 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d7b22-5b00-4d27-9241-01530dbea510 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:40:26.412012 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1462/2911] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:40:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:40:26.691093 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5487ecd-0912-4a35-87fc-a19e8bcf96fd None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:40:26.692637 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c5487ecd-0912-4a35-87fc-a19e8bcf96fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:40:26.704797 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5487ecd-0912-4a35-87fc-a19e8bcf96fd None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:40:26.710984 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7dfb7-2331-4463-ae70-df14694a603d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:40:26.711993 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7dfb7-2331-4463-ae70-df14694a603d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:40:26.712130 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7dfb7-2331-4463-ae70-df14694a603d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:40:26.712394 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7dfb7-2331-4463-ae70-df14694a603d admin admin] PATH_INFO: `/v3/projects/3d6317fcc1e547eb9a4d5e31a27bad60` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:40:26.717378 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7dfb7-2331-4463-ae70-df14694a603d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d6317fcc1e547eb9a4d5e31a27bad60)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:40:26.717378 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7dfb7-2331-4463-ae70-df14694a603d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:40:26.764454 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-86c7dfb7-2331-4463-ae70-df14694a603d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d6317fcc1e547eb9a4d5e31a27bad60', 'request_id': 'req-86c7dfb7-2331-4463-ae70-df14694a603d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:40:26.769556 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-86c7dfb7-2331-4463-ae70-df14694a603d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d6317fcc1e547eb9a4d5e31a27bad60', 'request_id': 'req-86c7dfb7-2331-4463-ae70-df14694a603d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:40:26.775584 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-86c7dfb7-2331-4463-ae70-df14694a603d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d6317fcc1e547eb9a4d5e31a27bad60', 'request_id': 'req-86c7dfb7-2331-4463-ae70-df14694a603d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:40:26.795175 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-86c7dfb7-2331-4463-ae70-df14694a603d admin admin] The token cache is being invalidate because project 3d6317fcc1e547eb9a4d5e31a27bad60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:40:26.795524 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-86c7dfb7-2331-4463-ae70-df14694a603d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:40:26.796505 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-86c7dfb7-2331-4463-ae70-df14694a603d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:40:26.798754 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1450/2912] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:40:26 2022] DELETE /identity/v3/projects/3d6317fcc1e547eb9a4d5e31a27bad60 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:40:26.803918 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e418f-47c1-4dd0-a0b3-c4817e5a0a58 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:40:26.804272 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e418f-47c1-4dd0-a0b3-c4817e5a0a58 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:40:26.804546 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e418f-47c1-4dd0-a0b3-c4817e5a0a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:40:26.822695 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-e92e418f-47c1-4dd0-a0b3-c4817e5a0a58 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:40:26.823791 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-e92e418f-47c1-4dd0-a0b3-c4817e5a0a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:40:26.884349 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1463/2913] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:40:26.893114 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6c6db-ec37-450a-8dc2-5da49a56e82f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:40:26.893383 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6c6db-ec37-450a-8dc2-5da49a56e82f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:40:26.893699 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6c6db-ec37-450a-8dc2-5da49a56e82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:40:26.913401 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-8fe6c6db-ec37-450a-8dc2-5da49a56e82f None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:40:26.914619 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8fe6c6db-ec37-450a-8dc2-5da49a56e82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:40:26.925013 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1451/2914] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:40:26.929275 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e418f-47c1-4dd0-a0b3-c4817e5a0a58 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:40:26.940245 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e418f-47c1-4dd0-a0b3-c4817e5a0a58 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:40:26.947136 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08130cc-d03b-4b95-8723-dccc0a15a1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:40:26.947866 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08130cc-d03b-4b95-8723-dccc0a15a1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:40:26.948140 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08130cc-d03b-4b95-8723-dccc0a15a1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:40:26.948419 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08130cc-d03b-4b95-8723-dccc0a15a1d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:40:26.949128 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08130cc-d03b-4b95-8723-dccc0a15a1d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 21:40:26.949445 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08130cc-d03b-4b95-8723-dccc0a15a1d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:40:26.952375 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08130cc-d03b-4b95-8723-dccc0a15a1d1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:40:26.966129 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1464/2915] 10.222.0.31 () {58 vars in 1152 bytes} [Thu Feb 10 21:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 21:40:26.972962 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6c6db-ec37-450a-8dc2-5da49a56e82f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:40:26.987334 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6c6db-ec37-450a-8dc2-5da49a56e82f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:40:26.996277 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52018ced-6be3-4fbe-a992-4dc044a8edd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:40:26.997163 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52018ced-6be3-4fbe-a992-4dc044a8edd1 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:40:26.997472 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52018ced-6be3-4fbe-a992-4dc044a8edd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:40:26.997770 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52018ced-6be3-4fbe-a992-4dc044a8edd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:40:26.998472 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52018ced-6be3-4fbe-a992-4dc044a8edd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:40:27.000366 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52018ced-6be3-4fbe-a992-4dc044a8edd1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:40:27.033143 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1452/2916] 10.222.0.31 () {60 vars in 1152 bytes} [Thu Feb 10 21:40:26 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:40:27.037556 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08130cc-d03b-4b95-8723-dccc0a15a1d1 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:40:27.047764 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08130cc-d03b-4b95-8723-dccc0a15a1d1 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:40:27.107110 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541caed5-d88e-459d-8534-1931985cbd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:40:27.107691 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541caed5-d88e-459d-8534-1931985cbd28 admin admin] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:40:27.107966 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541caed5-d88e-459d-8534-1931985cbd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:40:27.108235 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541caed5-d88e-459d-8534-1931985cbd28 admin admin] PATH_INFO: `/v3/users` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:40:27.108905 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541caed5-d88e-459d-8534-1931985cbd28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:40:27.110808 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541caed5-d88e-459d-8534-1931985cbd28 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:40:27.133106 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1465/2917] 10.222.0.31 () {60 vars in 1143 bytes} [Thu Feb 10 21:40:27 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 21:40:27.137536 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52018ced-6be3-4fbe-a992-4dc044a8edd1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:40:27.148217 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52018ced-6be3-4fbe-a992-4dc044a8edd1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:40:27.153988 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd097cd-4751-4d43-b90e-bc6b5afb5fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:40:27.154675 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd097cd-4751-4d43-b90e-bc6b5afb5fec admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:40:27.154957 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd097cd-4751-4d43-b90e-bc6b5afb5fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:40:27.155226 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd097cd-4751-4d43-b90e-bc6b5afb5fec admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:40:27.155951 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd097cd-4751-4d43-b90e-bc6b5afb5fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:40:27.157577 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd097cd-4751-4d43-b90e-bc6b5afb5fec admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:40:27.168068 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1453/2918] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:40:27.172638 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541caed5-d88e-459d-8534-1931985cbd28 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:40:27.183199 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541caed5-d88e-459d-8534-1931985cbd28 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:40:27.189224 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455fe2a-3669-4db5-bb8c-e78cf6eed0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:40:27.189903 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455fe2a-3669-4db5-bb8c-e78cf6eed0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:40:27.190187 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455fe2a-3669-4db5-bb8c-e78cf6eed0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:40:27.190454 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455fe2a-3669-4db5-bb8c-e78cf6eed0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:40:27.191184 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455fe2a-3669-4db5-bb8c-e78cf6eed0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:40:27.192777 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455fe2a-3669-4db5-bb8c-e78cf6eed0a1 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:40:27.202935 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1466/2919] 10.222.0.31 () {58 vars in 1121 bytes} [Thu Feb 10 21:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 21:40:27.207081 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd097cd-4751-4d43-b90e-bc6b5afb5fec admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:40:27.217312 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd097cd-4751-4d43-b90e-bc6b5afb5fec admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:40:27.224498 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897deb1-78f4-4b6f-9c3c-112e79d7bb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:40:27.225383 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897deb1-78f4-4b6f-9c3c-112e79d7bb3a admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:40:27.225710 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897deb1-78f4-4b6f-9c3c-112e79d7bb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:40:27.225979 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897deb1-78f4-4b6f-9c3c-112e79d7bb3a admin admin] PATH_INFO: `/v3/projects/6566fcca508c468bab7745882221a700/users/6b0611445e56423ba8cfe1f053a10dd1/roles/80e0463ac1aa4ef2b3739b580669f095` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:40:27.241637 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897deb1-78f4-4b6f-9c3c-112e79d7bb3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6566fcca508c468bab7745882221a700, user_id=6b0611445e56423ba8cfe1f053a10dd1, role_id=80e0463ac1aa4ef2b3739b580669f095)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:40:27.244513 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897deb1-78f4-4b6f-9c3c-112e79d7bb3a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:40:27.267853 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1454/2920] 10.222.0.31 () {60 vars in 1482 bytes} [Thu Feb 10 21:40:27 2022] PUT /identity/v3/projects/6566fcca508c468bab7745882221a700/users/6b0611445e56423ba8cfe1f053a10dd1/roles/80e0463ac1aa4ef2b3739b580669f095 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:40:27.278278 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1200e1-9fb1-45ae-9350-54ed1aee7856 None None] REQUEST_METHOD: `POST` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:40:27.278560 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1200e1-9fb1-45ae-9350-54ed1aee7856 None None] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:40:27.278824 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1200e1-9fb1-45ae-9350-54ed1aee7856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:40:27.306152 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.auth.core [None req-cf1200e1-9fb1-45ae-9350-54ed1aee7856 None None] MFA Rules not processed for user `6b0611445e56423ba8cfe1f053a10dd1`. Rule list: `[]` (Enabled: `True`). {{(pid=79129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:40:27.307329 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-cf1200e1-9fb1-45ae-9350-54ed1aee7856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:40:27.374834 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1467/2921] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:40:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:40:27.384817 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897deb1-78f4-4b6f-9c3c-112e79d7bb3a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:40:27.386609 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b897deb1-78f4-4b6f-9c3c-112e79d7bb3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:40:27.447807 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897deb1-78f4-4b6f-9c3c-112e79d7bb3a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:40:27.452113 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c3e16-0ba0-4a1a-ad9f-50b7dc4e7e01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce66e520f6f84eab9e85c81022a0c743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:40:27.452741 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c3e16-0ba0-4a1a-ad9f-50b7dc4e7e01 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:40:27.453014 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c3e16-0ba0-4a1a-ad9f-50b7dc4e7e01 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:40:27.453261 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c3e16-0ba0-4a1a-ad9f-50b7dc4e7e01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:40:27.462144 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c3e16-0ba0-4a1a-ad9f-50b7dc4e7e01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:40:27.463565 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c3e16-0ba0-4a1a-ad9f-50b7dc4e7e01 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:40:27.472185 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1455/2922] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:40:27 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:41:08.858745 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1200e1-9fb1-45ae-9350-54ed1aee7856 None None] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:41:08.926931 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1200e1-9fb1-45ae-9350-54ed1aee7856 None None] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:41:08.934686 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36567143-1a66-4768-8b9b-dc7a11f2a72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:41:08.935573 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36567143-1a66-4768-8b9b-dc7a11f2a72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:41:08.935857 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36567143-1a66-4768-8b9b-dc7a11f2a72c admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:41:08.936110 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36567143-1a66-4768-8b9b-dc7a11f2a72c admin admin] PATH_INFO: `/v3/users/6b0611445e56423ba8cfe1f053a10dd1` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:41:08.937585 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36567143-1a66-4768-8b9b-dc7a11f2a72c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b0611445e56423ba8cfe1f053a10dd1)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:41:08.939563 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36567143-1a66-4768-8b9b-dc7a11f2a72c admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:41:08.995797 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-36567143-1a66-4768-8b9b-dc7a11f2a72c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b0611445e56423ba8cfe1f053a10dd1'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:41:09.002696 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-36567143-1a66-4768-8b9b-dc7a11f2a72c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b0611445e56423ba8cfe1f053a10dd1'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:41:09.015185 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-36567143-1a66-4768-8b9b-dc7a11f2a72c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b0611445e56423ba8cfe1f053a10dd1'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:41:09.015968 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-36567143-1a66-4768-8b9b-dc7a11f2a72c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b0611445e56423ba8cfe1f053a10dd1'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:41:09.016665 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-36567143-1a66-4768-8b9b-dc7a11f2a72c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b0611445e56423ba8cfe1f053a10dd1'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:41:09.031214 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1468/2923] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:41:08 2022] DELETE /identity/v3/users/6b0611445e56423ba8cfe1f053a10dd1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:41:09.036004 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a876e4c-b503-491c-9268-a8143127a989 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:41:09.036495 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a876e4c-b503-491c-9268-a8143127a989 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:41:09.036593 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a876e4c-b503-491c-9268-a8143127a989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:41:09.053787 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-8a876e4c-b503-491c-9268-a8143127a989 None None] MFA Rules not processed for user `ca0523bae3774fd3bb058d660150718b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 21:41:09.054949 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8a876e4c-b503-491c-9268-a8143127a989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:41:09.116194 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1456/2924] 10.222.0.31 () {58 vars in 957 bytes} [Thu Feb 10 21:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 21:41:09.126293 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36567143-1a66-4768-8b9b-dc7a11f2a72c admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:41:09.128106 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-36567143-1a66-4768-8b9b-dc7a11f2a72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:41:09.188789 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36567143-1a66-4768-8b9b-dc7a11f2a72c admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:41:09.193281 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422601f-984c-488d-b1f7-f932f40e5433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:41:09.193961 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422601f-984c-488d-b1f7-f932f40e5433 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:41:09.194243 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422601f-984c-488d-b1f7-f932f40e5433 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:41:09.194511 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422601f-984c-488d-b1f7-f932f40e5433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:41:09.205043 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422601f-984c-488d-b1f7-f932f40e5433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:41:09.206522 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422601f-984c-488d-b1f7-f932f40e5433 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:41:09.216948 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1469/2925] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:41:09.516017 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a876e4c-b503-491c-9268-a8143127a989 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:41:09.517689 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8a876e4c-b503-491c-9268-a8143127a989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:41:09.540638 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a876e4c-b503-491c-9268-a8143127a989 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:41:09.548776 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23719274-bd4c-4641-b01b-6062f5678717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:41:09.549702 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23719274-bd4c-4641-b01b-6062f5678717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:41:09.549972 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23719274-bd4c-4641-b01b-6062f5678717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:41:09.550231 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23719274-bd4c-4641-b01b-6062f5678717 admin admin] PATH_INFO: `/v3/projects/6566fcca508c468bab7745882221a700` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:41:09.551747 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23719274-bd4c-4641-b01b-6062f5678717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6566fcca508c468bab7745882221a700)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:41:09.553735 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23719274-bd4c-4641-b01b-6062f5678717 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:41:09.602588 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-23719274-bd4c-4641-b01b-6062f5678717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6566fcca508c468bab7745882221a700', 'request_id': 'req-23719274-bd4c-4641-b01b-6062f5678717'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:41:09.608178 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-23719274-bd4c-4641-b01b-6062f5678717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6566fcca508c468bab7745882221a700', 'request_id': 'req-23719274-bd4c-4641-b01b-6062f5678717'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:41:09.614358 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-23719274-bd4c-4641-b01b-6062f5678717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6566fcca508c468bab7745882221a700', 'request_id': 'req-23719274-bd4c-4641-b01b-6062f5678717'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:41:09.628563 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-23719274-bd4c-4641-b01b-6062f5678717 admin admin] The token cache is being invalidate because project 6566fcca508c468bab7745882221a700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:41:09.628748 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-23719274-bd4c-4641-b01b-6062f5678717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:41:09.629449 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-23719274-bd4c-4641-b01b-6062f5678717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:41:09.631054 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1457/2926] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:41:09 2022] DELETE /identity/v3/projects/6566fcca508c468bab7745882221a700 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:41:51.177145 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422601f-984c-488d-b1f7-f932f40e5433 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:41:51.178866 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-f422601f-984c-488d-b1f7-f932f40e5433 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:41:51.285980 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422601f-984c-488d-b1f7-f932f40e5433 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:41:51.346945 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad0f1a-e7af-4d04-971c-93f0d5a915bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f05eb88abe24af4825259712b497d48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:41:51.347577 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad0f1a-e7af-4d04-971c-93f0d5a915bc service placement] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:41:51.347852 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad0f1a-e7af-4d04-971c-93f0d5a915bc service placement] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:41:51.348386 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad0f1a-e7af-4d04-971c-93f0d5a915bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:41:51.350557 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-f8ad0f1a-e7af-4d04-971c-93f0d5a915bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:41:51.361597 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad0f1a-e7af-4d04-971c-93f0d5a915bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:41:51.363142 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad0f1a-e7af-4d04-971c-93f0d5a915bc service placement] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:41:51.372782 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1470/2927] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:41:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:42:14.912573 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23719274-bd4c-4641-b01b-6062f5678717 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:42:14.914153 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-23719274-bd4c-4641-b01b-6062f5678717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:42:15.011716 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23719274-bd4c-4641-b01b-6062f5678717 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:42:15.017233 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa405a9-a7e6-4caa-9e95-348154308923 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d84b0d7e3d423aa972e58be27c772c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:42:15.017913 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa405a9-a7e6-4caa-9e95-348154308923 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:42:15.018193 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa405a9-a7e6-4caa-9e95-348154308923 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:42:15.018464 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa405a9-a7e6-4caa-9e95-348154308923 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:42:15.020238 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ffa405a9-a7e6-4caa-9e95-348154308923 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:42:15.033019 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa405a9-a7e6-4caa-9e95-348154308923 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:42:15.034625 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa405a9-a7e6-4caa-9e95-348154308923 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:42:15.045078 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1458/2928] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:42:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:42:33.382444 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad0f1a-e7af-4d04-971c-93f0d5a915bc service placement] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:42:33.384530 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-f8ad0f1a-e7af-4d04-971c-93f0d5a915bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:42:33.445910 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad0f1a-e7af-4d04-971c-93f0d5a915bc service placement] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:42:33.450976 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d277acb-6ba9-4445-91b5-f897f1700684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07a9ae7262b44ce88e1338c83360356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:42:33.451622 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d277acb-6ba9-4445-91b5-f897f1700684 service neutron] REQUEST_METHOD: `GET` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:42:33.451897 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d277acb-6ba9-4445-91b5-f897f1700684 service neutron] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:42:33.452217 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d277acb-6ba9-4445-91b5-f897f1700684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:42:33.454677 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-9d277acb-6ba9-4445-91b5-f897f1700684 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:42:33.517852 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d277acb-6ba9-4445-91b5-f897f1700684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:42:33.519278 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d277acb-6ba9-4445-91b5-f897f1700684 service neutron] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:42:33.530720 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1471/2929] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:42:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 21:42:40.198448 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa405a9-a7e6-4caa-9e95-348154308923 service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:42:40.200014 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ffa405a9-a7e6-4caa-9e95-348154308923 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:42:40.216017 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa405a9-a7e6-4caa-9e95-348154308923 service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:42:40.220975 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166075a4-6874-4dbb-a079-dec43cdb0292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:42:40.221878 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166075a4-6874-4dbb-a079-dec43cdb0292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:42:40.222158 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166075a4-6874-4dbb-a079-dec43cdb0292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:42:40.222429 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166075a4-6874-4dbb-a079-dec43cdb0292 admin admin] PATH_INFO: `/v3/users/4f847dd93a4348038e39859597386d15` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:42:40.223658 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166075a4-6874-4dbb-a079-dec43cdb0292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f847dd93a4348038e39859597386d15)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:42:40.225615 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166075a4-6874-4dbb-a079-dec43cdb0292 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:42:40.273061 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-166075a4-6874-4dbb-a079-dec43cdb0292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f847dd93a4348038e39859597386d15'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:42:40.279562 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-166075a4-6874-4dbb-a079-dec43cdb0292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f847dd93a4348038e39859597386d15'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:42:40.291842 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-166075a4-6874-4dbb-a079-dec43cdb0292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f847dd93a4348038e39859597386d15'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:42:40.292576 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-166075a4-6874-4dbb-a079-dec43cdb0292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f847dd93a4348038e39859597386d15'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:42:40.301914 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-166075a4-6874-4dbb-a079-dec43cdb0292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f847dd93a4348038e39859597386d15'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:42:40.307798 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1459/2930] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:42:40 2022] DELETE /identity/v3/users/4f847dd93a4348038e39859597386d15 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:42:40.477256 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d277acb-6ba9-4445-91b5-f897f1700684 service neutron] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:42:40.487846 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d277acb-6ba9-4445-91b5-f897f1700684 service neutron] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:42:40.557653 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c725b24-b6ab-4c55-abeb-beba186fa663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:42:40.558555 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c725b24-b6ab-4c55-abeb-beba186fa663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:42:40.558830 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c725b24-b6ab-4c55-abeb-beba186fa663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:42:40.559098 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c725b24-b6ab-4c55-abeb-beba186fa663 admin admin] PATH_INFO: `/v3/projects/575836d33ef84cb9a778bfd168a1f37f` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:42:40.560446 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c725b24-b6ab-4c55-abeb-beba186fa663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=575836d33ef84cb9a778bfd168a1f37f)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:42:40.562418 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c725b24-b6ab-4c55-abeb-beba186fa663 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:42:40.625582 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2c725b24-b6ab-4c55-abeb-beba186fa663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '575836d33ef84cb9a778bfd168a1f37f', 'request_id': 'req-2c725b24-b6ab-4c55-abeb-beba186fa663'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:42:40.631673 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2c725b24-b6ab-4c55-abeb-beba186fa663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '575836d33ef84cb9a778bfd168a1f37f', 'request_id': 'req-2c725b24-b6ab-4c55-abeb-beba186fa663'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:42:40.638434 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2c725b24-b6ab-4c55-abeb-beba186fa663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '575836d33ef84cb9a778bfd168a1f37f', 'request_id': 'req-2c725b24-b6ab-4c55-abeb-beba186fa663'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:42:40.653109 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2c725b24-b6ab-4c55-abeb-beba186fa663 admin admin] The token cache is being invalidate because project 575836d33ef84cb9a778bfd168a1f37f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:42:40.653377 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2c725b24-b6ab-4c55-abeb-beba186fa663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:42:40.654034 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-2c725b24-b6ab-4c55-abeb-beba186fa663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:42:40.655615 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1472/2931] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:42:40 2022] DELETE /identity/v3/projects/575836d33ef84cb9a778bfd168a1f37f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:42:40.660409 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166075a4-6874-4dbb-a079-dec43cdb0292 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:42:40.662520 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-166075a4-6874-4dbb-a079-dec43cdb0292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:42:40.679623 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166075a4-6874-4dbb-a079-dec43cdb0292 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:42:40.736972 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45563f52-3ce1-4f1e-85d8-33fbbe9dc051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:42:40.737779 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45563f52-3ce1-4f1e-85d8-33fbbe9dc051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:42:40.738052 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45563f52-3ce1-4f1e-85d8-33fbbe9dc051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:42:40.738339 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45563f52-3ce1-4f1e-85d8-33fbbe9dc051 admin admin] PATH_INFO: `/v3/users/06206874bac54c56b20e333a71f5d998` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:42:40.739539 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45563f52-3ce1-4f1e-85d8-33fbbe9dc051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06206874bac54c56b20e333a71f5d998)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:42:40.741461 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45563f52-3ce1-4f1e-85d8-33fbbe9dc051 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:42:40.787795 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-45563f52-3ce1-4f1e-85d8-33fbbe9dc051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06206874bac54c56b20e333a71f5d998'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:42:40.794988 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-45563f52-3ce1-4f1e-85d8-33fbbe9dc051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06206874bac54c56b20e333a71f5d998'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:42:40.807406 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-45563f52-3ce1-4f1e-85d8-33fbbe9dc051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06206874bac54c56b20e333a71f5d998'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:42:40.808064 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-45563f52-3ce1-4f1e-85d8-33fbbe9dc051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06206874bac54c56b20e333a71f5d998'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:42:40.816558 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-45563f52-3ce1-4f1e-85d8-33fbbe9dc051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06206874bac54c56b20e333a71f5d998'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:42:40.822642 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1460/2932] 10.222.0.31 () {58 vars in 1223 bytes} [Thu Feb 10 21:42:40 2022] DELETE /identity/v3/users/06206874bac54c56b20e333a71f5d998 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:42:40.995115 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c725b24-b6ab-4c55-abeb-beba186fa663 admin admin] Authenticating user token {{(pid=79129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:42:40.996660 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.fernet_utils [None req-2c725b24-b6ab-4c55-abeb-beba186fa663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:42:41.009417 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c725b24-b6ab-4c55-abeb-beba186fa663 admin admin] Validating token access rules against request {{(pid=79129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:42:41.068663 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82efb4-6af7-4a29-95f0-f6eb3c621f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca0523bae3774fd3bb058d660150718b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c795df8915a438b8adfbed3181b36a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:42:41.069563 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82efb4-6af7-4a29-95f0-f6eb3c621f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:42:41.069840 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82efb4-6af7-4a29-95f0-f6eb3c621f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:42:41.070104 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82efb4-6af7-4a29-95f0-f6eb3c621f32 admin admin] PATH_INFO: `/v3/projects/fb95747cf2764da5aada624ec2f28f4a` {{(pid=79129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:42:41.071421 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82efb4-6af7-4a29-95f0-f6eb3c621f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb95747cf2764da5aada624ec2f28f4a)` {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:42:41.073648 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82efb4-6af7-4a29-95f0-f6eb3c621f32 admin admin] RBAC: Authorization granted {{(pid=79129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:42:41.120914 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-6c82efb4-6af7-4a29-95f0-f6eb3c621f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb95747cf2764da5aada624ec2f28f4a', 'request_id': 'req-6c82efb4-6af7-4a29-95f0-f6eb3c621f32'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:42:41.126262 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-6c82efb4-6af7-4a29-95f0-f6eb3c621f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb95747cf2764da5aada624ec2f28f4a', 'request_id': 'req-6c82efb4-6af7-4a29-95f0-f6eb3c621f32'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:42:41.132592 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-6c82efb4-6af7-4a29-95f0-f6eb3c621f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb95747cf2764da5aada624ec2f28f4a', 'request_id': 'req-6c82efb4-6af7-4a29-95f0-f6eb3c621f32'} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:42:41.151467 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-6c82efb4-6af7-4a29-95f0-f6eb3c621f32 admin admin] The token cache is being invalidate because project fb95747cf2764da5aada624ec2f28f4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 21:42:41.151780 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-6c82efb4-6af7-4a29-95f0-f6eb3c621f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:42:41.152731 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: DEBUG keystone.notifications [None req-6c82efb4-6af7-4a29-95f0-f6eb3c621f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 21:42:41.155198 dv-cinder-825688-3-iscsi devstack@keystone.service[79129]: [pid: 79129|app: 0|req: 1473/2933] 10.222.0.31 () {58 vars in 1232 bytes} [Thu Feb 10 21:42:40 2022] DELETE /identity/v3/projects/fb95747cf2764da5aada624ec2f28f4a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 21:46:58.199311 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45563f52-3ce1-4f1e-85d8-33fbbe9dc051 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 21:46:58.201770 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-45563f52-3ce1-4f1e-85d8-33fbbe9dc051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:46:58.320295 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45563f52-3ce1-4f1e-85d8-33fbbe9dc051 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 21:46:58.382076 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d9f08-71ff-4cc8-ad72-0011e9e61c62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f05eb88abe24af4825259712b497d48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f35ac6d668442a9ea0347f99eb2881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 21:46:58.382724 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d9f08-71ff-4cc8-ad72-0011e9e61c62 service placement] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 21:46:58.382995 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d9f08-71ff-4cc8-ad72-0011e9e61c62 service placement] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 21:46:58.383260 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d9f08-71ff-4cc8-ad72-0011e9e61c62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 21:46:58.385472 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-105d9f08-71ff-4cc8-ad72-0011e9e61c62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 21:46:58.397506 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d9f08-71ff-4cc8-ad72-0011e9e61c62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 21:46:58.399101 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d9f08-71ff-4cc8-ad72-0011e9e61c62 service placement] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 21:46:58.409555 dv-cinder-825688-3-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1461/2934] 10.222.0.31 () {60 vars in 1365 bytes} [Thu Feb 10 21:46:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)